Jul 10 12:46:10.622869 ip-10-0-135-152 systemd[1]: Starting Kubernetes Kubelet... Jul 10 12:46:10.996080 ip-10-0-135-152 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 12:46:10.996080 ip-10-0-135-152 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 12:46:10.996080 ip-10-0-135-152 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 12:46:10.996080 ip-10-0-135-152 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 12:46:10.996080 ip-10-0-135-152 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 12:46:10.998202 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:10.998112 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 12:46:11.003157 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003140 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 12:46:11.003157 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003157 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003160 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003164 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003166 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003169 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003172 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003175 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003177 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003179 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003182 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003185 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003187 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003190 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003192 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003195 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003197 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003200 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003202 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003205 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003208 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 12:46:11.003223 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003212 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003214 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003217 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003219 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003224 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003227 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003230 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003232 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003235 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003238 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003240 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003244 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003247 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003249 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003252 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003254 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003256 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003259 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003261 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 12:46:11.003722 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003265 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003269 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003272 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003274 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003277 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003279 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003282 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003285 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003288 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003290 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003292 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003295 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003297 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003300 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003304 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003307 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003309 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003312 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003314 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003317 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 12:46:11.004169 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003319 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003321 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003324 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003327 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003329 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003332 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003335 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003337 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003340 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003345 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003348 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003351 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003354 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003357 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003360 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003363 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003366 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003368 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003372 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003375 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 12:46:11.004982 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003379 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003382 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003386 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003389 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003393 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003396 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003399 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003403 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003405 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003408 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003410 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003413 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003415 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003418 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003420 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003423 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003425 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003427 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.003430 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 12:46:11.005880 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005309 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005327 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005338 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005343 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005348 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005354 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005359 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005363 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005368 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005372 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005376 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005380 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005384 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005388 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005392 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005402 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005406 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005411 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005415 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005419 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 12:46:11.006402 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005423 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005429 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005434 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005438 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005442 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005446 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005450 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005455 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005464 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005469 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005474 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005478 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005482 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005487 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005491 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005495 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005500 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005504 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005508 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 12:46:11.006919 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005527 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005532 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005542 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005546 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005550 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005555 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005559 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005563 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005568 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005572 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005576 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005581 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005585 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005589 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005593 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005608 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005612 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005617 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005622 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005626 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 12:46:11.007420 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005631 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005635 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005643 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005650 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005654 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005662 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005671 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005676 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005680 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005684 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005688 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005693 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005697 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005702 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005706 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005713 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005718 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005723 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005733 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 12:46:11.007914 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005738 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005743 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005752 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005761 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005767 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005770 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005775 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005786 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005794 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005799 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005805 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005811 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005816 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005826 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005831 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005836 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005841 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005846 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005850 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005855 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 12:46:11.008365 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.005859 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006504 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006528 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006531 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006534 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006538 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006540 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006543 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006546 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006548 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006551 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006554 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006557 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006559 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006562 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006565 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006567 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006570 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006573 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006576 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 12:46:11.008852 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006579 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006581 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006584 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006587 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006590 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006592 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006595 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006598 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006602 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006606 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006608 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006611 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006614 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006616 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006619 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006621 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006624 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006627 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006629 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006632 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 12:46:11.009333 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006635 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006638 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006640 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006643 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006645 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006649 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006651 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006654 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006656 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006659 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006663 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006666 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006669 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006671 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006674 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006677 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006680 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006684 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006688 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 12:46:11.009822 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006691 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006696 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006700 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006703 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006706 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006709 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006712 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006715 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006718 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006721 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006724 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006727 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006730 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006732 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006735 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006737 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006740 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006742 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006745 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 12:46:11.010283 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006748 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006750 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006753 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006755 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006759 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006762 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006765 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006768 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006771 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006773 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006776 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006778 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006781 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006784 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006786 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006789 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006791 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006794 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006797 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006799 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 12:46:11.010760 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006801 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.006804 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006887 2557 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006897 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006908 2557 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006914 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006921 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006925 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006930 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006935 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006938 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006941 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006944 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006948 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006951 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006954 2557 flags.go:64] FLAG: --cgroup-root="" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006958 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006961 2557 flags.go:64] FLAG: --client-ca-file="" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006965 2557 flags.go:64] FLAG: --cloud-provider="external" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006968 2557 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006972 2557 flags.go:64] FLAG: --cluster-domain="" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006975 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006978 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006982 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 12:46:11.011249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006985 2557 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006989 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006992 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006995 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.006999 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007002 2557 flags.go:64] FLAG: --contention-profiling="false" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007005 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007008 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007011 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007014 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007018 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007021 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007024 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007027 2557 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007030 2557 flags.go:64] FLAG: --enable-server="true" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007033 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007038 2557 flags.go:64] FLAG: --event-burst="100" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007041 2557 flags.go:64] FLAG: --event-qps="50" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007044 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007047 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007050 2557 flags.go:64] FLAG: --eviction-hard="" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007053 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007056 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007059 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007064 2557 flags.go:64] FLAG: --eviction-soft="" Jul 10 12:46:11.011839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007067 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007070 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007073 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007077 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007080 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007083 2557 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007086 2557 flags.go:64] FLAG: --feature-gates="" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007089 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007093 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007096 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007099 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007102 2557 flags.go:64] FLAG: --healthz-port="10248" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007105 2557 flags.go:64] FLAG: --help="false" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007108 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007111 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007114 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007117 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007121 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007124 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007127 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007130 2557 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007132 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007135 2557 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 12:46:11.012420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007139 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007142 2557 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007145 2557 flags.go:64] FLAG: --kube-reserved="" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007148 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007150 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007154 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007156 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007159 2557 flags.go:64] FLAG: --lock-file="" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007163 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007166 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007169 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007175 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007179 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007182 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007185 2557 flags.go:64] FLAG: --logging-format="text" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007188 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007191 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007195 2557 flags.go:64] FLAG: --manifest-url="" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007197 2557 flags.go:64] FLAG: --manifest-url-header="" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007202 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007205 2557 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007209 2557 flags.go:64] FLAG: --max-pods="110" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007212 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007215 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007218 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 12:46:11.012995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007221 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007224 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007227 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007230 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007243 2557 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007246 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007249 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007252 2557 flags.go:64] FLAG: --pod-cidr="" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007255 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007260 2557 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007263 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007266 2557 flags.go:64] FLAG: --pods-per-core="0" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007272 2557 flags.go:64] FLAG: --port="10250" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007275 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007278 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07059ca6728e1e31e" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007281 2557 flags.go:64] FLAG: --qos-reserved="" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007285 2557 flags.go:64] FLAG: --read-only-port="10255" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007288 2557 flags.go:64] FLAG: --register-node="true" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007291 2557 flags.go:64] FLAG: --register-with-taints="" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007295 2557 flags.go:64] FLAG: --registry-burst="10" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007298 2557 flags.go:64] FLAG: --registry-qps="5" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007302 2557 flags.go:64] FLAG: --reserved-cpus="" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007304 2557 flags.go:64] FLAG: --reserved-memory="" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007308 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007311 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 12:46:11.013649 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007314 2557 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007317 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007320 2557 flags.go:64] FLAG: --runonce="false" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007322 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007326 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007329 2557 flags.go:64] FLAG: --seccomp-default="false" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007332 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007334 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007338 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007341 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007344 2557 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007347 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007350 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007353 2557 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007355 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007359 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007361 2557 flags.go:64] FLAG: --system-cgroups="" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007364 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007370 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007374 2557 flags.go:64] FLAG: --tls-cert-file="" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007377 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007381 2557 flags.go:64] FLAG: --tls-min-version="" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007384 2557 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007388 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007391 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 12:46:11.014288 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007394 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007397 2557 flags.go:64] FLAG: --v="2" Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007401 2557 flags.go:64] FLAG: --version="false" Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007406 2557 flags.go:64] FLAG: --vmodule="" Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007409 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.007413 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007551 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007556 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007559 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007562 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007564 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007567 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007570 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007573 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007576 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007578 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007581 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007584 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007587 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007589 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007592 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 12:46:11.014903 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007595 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007597 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007600 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007603 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007605 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007611 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007614 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007618 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007621 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007627 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007630 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007633 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007636 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007639 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007641 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007645 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007647 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007650 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007653 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 12:46:11.015414 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007655 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007658 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007660 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007663 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007665 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007668 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007671 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007674 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007676 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007679 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007681 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007684 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007687 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007689 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007692 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007696 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007699 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007702 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007707 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 12:46:11.015886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007710 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007713 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007716 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007720 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007722 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007725 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007728 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007731 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007733 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007736 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007739 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007742 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007744 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007747 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007750 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007752 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007755 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007757 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007760 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007762 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 12:46:11.016377 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007765 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007768 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007771 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007775 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007778 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007781 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007784 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007786 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007789 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007791 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007794 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007798 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007801 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007803 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007806 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007809 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007813 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007815 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007818 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007820 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 12:46:11.016868 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007823 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007826 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007829 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007833 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007835 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.007838 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.008326 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.014829 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.014846 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.014866 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.014873 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014927 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014932 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014936 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 12:46:11.017347 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014939 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014942 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014944 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014947 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014950 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014953 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014955 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014958 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014961 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014963 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014966 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014969 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014973 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014977 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014980 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014983 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014986 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014989 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014992 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014994 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 12:46:11.017719 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.014997 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015001 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015003 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015006 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015008 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015011 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015015 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015018 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015020 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015023 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015025 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015028 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015031 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015033 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015036 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015038 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015041 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015043 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015046 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015048 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 12:46:11.018180 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015051 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015053 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015056 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015058 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015061 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015063 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015066 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015069 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015071 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015074 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015076 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015079 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015081 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015084 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015086 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015089 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015092 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015094 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015098 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015101 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 12:46:11.018678 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015104 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015106 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015109 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015111 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015114 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015117 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015119 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015122 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015124 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015126 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015129 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015133 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015136 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015140 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015144 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015147 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015151 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015154 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015157 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015159 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 12:46:11.019148 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015162 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015165 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015167 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015169 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015172 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015174 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015178 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015180 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015183 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015185 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015189 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015193 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015198 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015202 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015205 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 12:46:11.019649 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015208 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.015214 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015323 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015327 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015330 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015333 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015335 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015338 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015341 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015343 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015346 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015349 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015351 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015354 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015356 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 12:46:11.020004 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015359 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015361 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015364 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015367 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015369 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015373 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015376 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015379 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015382 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015385 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015388 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015390 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015393 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015396 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015399 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015402 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015405 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015407 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015410 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015413 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 12:46:11.020383 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015415 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015418 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015421 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015424 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015426 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015430 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015433 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015435 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015438 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015440 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015443 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015445 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015448 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015450 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015453 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015455 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015458 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015460 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015462 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015465 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 12:46:11.020866 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015468 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015470 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015473 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015475 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015478 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015481 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015483 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015486 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015490 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015493 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015495 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015498 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015500 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015503 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015505 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015508 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015525 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015529 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015532 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015534 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 12:46:11.021391 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015537 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015540 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015542 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015545 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015548 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015550 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015553 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015555 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015557 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015560 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015562 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015565 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015568 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015570 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015574 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015578 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015581 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015584 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 12:46:11.021886 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015586 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 12:46:11.022324 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015589 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 12:46:11.022324 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015591 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 12:46:11.022324 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015595 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 12:46:11.022324 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015597 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 12:46:11.022324 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015600 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 12:46:11.022324 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015602 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 12:46:11.022324 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:11.015605 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 12:46:11.022324 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.015610 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 12:46:11.022324 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.015715 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 12:46:11.022324 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.020790 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 12:46:11.022642 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.022436 2557 server.go:1019] "Starting client certificate rotation" Jul 10 12:46:11.022642 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.022552 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 12:46:11.022642 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.022601 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 12:46:11.025487 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.025462 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 12:46:11.030534 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.030506 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 12:46:11.041453 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.041433 2557 log.go:25] "Validated CRI v1 runtime API" Jul 10 12:46:11.045543 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.045525 2557 log.go:25] "Validated CRI v1 image API" Jul 10 12:46:11.046393 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.046380 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 12:46:11.049709 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.049689 2557 fs.go:135] Filesystem UUIDs: map[7101960b-159c-4479-a29e-29277bc6242c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8868887c-2a11-4db0-9ebd-edaf0b4c07b9:/dev/nvme0n1p3] Jul 10 12:46:11.049767 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.049708 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 12:46:11.054792 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.054667 2557 manager.go:216] Machine: {Timestamp:2026-07-10 12:46:11.053417112 +0000 UTC m=+0.319361309 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101883 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec270bbf483cbb183f5cf765b0c1a9fe SystemUUID:ec270bbf-483c-bb18-3f5c-f765b0c1a9fe BootID:f4af11bb-f5a1-40c7-8d56-def1c4c28f4b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b4:47:3d:ff:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b4:47:3d:ff:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:3e:48:23:a6:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 12:46:11.054792 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.054780 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 12:46:11.054937 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.054868 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 12:46:11.057990 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.057954 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 12:46:11.058164 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.057993 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-152.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 12:46:11.058379 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.058362 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 12:46:11.058732 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.058720 2557 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 12:46:11.058781 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.058737 2557 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 12:46:11.058781 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.058748 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 12:46:11.059375 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.059364 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 12:46:11.060848 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.060836 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 12:46:11.063868 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.063854 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 10 12:46:11.064001 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.063990 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 12:46:11.064055 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.064031 2557 kubelet.go:486] "Attempting to sync node with API server" Jul 10 12:46:11.064055 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.064052 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 12:46:11.064136 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.064074 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 12:46:11.064136 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.064088 2557 kubelet.go:398] "Adding apiserver pod source" Jul 10 12:46:11.064136 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.064101 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 12:46:11.064491 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.064476 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 12:46:11.064581 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.064499 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 12:46:11.067202 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.067187 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 12:46:11.068842 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.068826 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 12:46:11.068916 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.068865 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 12:46:11.069060 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069047 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 12:46:11.069121 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069066 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 12:46:11.069121 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069076 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 12:46:11.069121 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069086 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 12:46:11.069121 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069099 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 12:46:11.069121 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069107 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 12:46:11.069618 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069607 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 12:46:11.069677 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069620 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 12:46:11.069677 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069630 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 12:46:11.069677 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069638 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 12:46:11.069677 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069652 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 12:46:11.069677 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069664 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 12:46:11.069878 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069738 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 12:46:11.069878 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.069748 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 12:46:11.072970 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.072954 2557 server.go:1268] "Started kubelet" Jul 10 12:46:11.073082 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.073057 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 12:46:11.073651 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.073582 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 12:46:11.073844 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.073816 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 12:46:11.074392 ip-10-0-135-152 systemd[1]: Started Kubernetes Kubelet. Jul 10 12:46:11.077711 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.077685 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 12:46:11.079752 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.079732 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 12:46:11.080060 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.080044 2557 server.go:310] "Adding debug handlers to kubelet server" Jul 10 12:46:11.082233 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.082213 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-152.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 12:46:11.082303 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.082250 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 12:46:11.082635 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.082616 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 12:46:11.083315 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.082407 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-152.ec2.internal.18c0ee654014cbf8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-152.ec2.internal,UID:ip-10-0-135-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-152.ec2.internal,},FirstTimestamp:2026-07-10 12:46:11.07292876 +0000 UTC m=+0.338873019,LastTimestamp:2026-07-10 12:46:11.07292876 +0000 UTC m=+0.338873019,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-152.ec2.internal,}" Jul 10 12:46:11.084211 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.084198 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 12:46:11.084273 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.084218 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 12:46:11.084549 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.084336 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:11.084838 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.084823 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 12:46:11.084838 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.084828 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 12:46:11.084838 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.084840 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 12:46:11.085018 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.084925 2557 reconstruct.go:97] "Volume reconstruction finished" Jul 10 12:46:11.085018 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.084935 2557 reconciler.go:29] "Reconciler: start to sync state" Jul 10 12:46:11.085103 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.085089 2557 factory.go:55] Registering systemd factory Jul 10 12:46:11.085147 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.085105 2557 factory.go:223] Registration of the systemd container factory successfully Jul 10 12:46:11.085329 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.085311 2557 factory.go:153] Registering CRI-O factory Jul 10 12:46:11.085329 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.085331 2557 factory.go:223] Registration of the crio container factory successfully Jul 10 12:46:11.085445 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.085378 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 12:46:11.085445 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.085398 2557 factory.go:103] Registering Raw factory Jul 10 12:46:11.085445 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.085402 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r6lh8" Jul 10 12:46:11.085445 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.085409 2557 manager.go:1196] Started watching for new ooms in manager Jul 10 12:46:11.086005 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.085990 2557 manager.go:349] Starting recovery of all containers Jul 10 12:46:11.093760 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.093584 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r6lh8" Jul 10 12:46:11.095428 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.095410 2557 manager.go:354] Recovery completed Jul 10 12:46:11.095700 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.095676 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 12:46:11.095809 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.095788 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 12:46:11.101046 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.101027 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 12:46:11.103167 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.103149 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientMemory" Jul 10 12:46:11.103241 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.103181 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 12:46:11.103241 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.103193 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientPID" Jul 10 12:46:11.103769 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.103751 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 12:46:11.103769 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.103767 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 12:46:11.103848 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.103768 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 12:46:11.103848 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.103834 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 10 12:46:11.104487 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.104469 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientMemory" Jul 10 12:46:11.104600 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.104497 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 12:46:11.104600 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.104534 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientPID" Jul 10 12:46:11.104847 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.104834 2557 policy_none.go:49] "None policy: Start" Jul 10 12:46:11.104901 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.104853 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 12:46:11.104901 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.104867 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 12:46:11.105472 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.105405 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-152.ec2.internal.18c0ee6541e22de1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-152.ec2.internal,UID:ip-10-0-135-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-152.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-152.ec2.internal,},FirstTimestamp:2026-07-10 12:46:11.103165921 +0000 UTC m=+0.369110119,LastTimestamp:2026-07-10 12:46:11.103165921 +0000 UTC m=+0.369110119,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-152.ec2.internal,}" Jul 10 12:46:11.105753 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.105743 2557 policy_none.go:47] "Start" Jul 10 12:46:11.150257 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.150217 2557 manager.go:337] "Starting Device Plugin manager" Jul 10 12:46:11.150383 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.150269 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 12:46:11.150383 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.150280 2557 server.go:87] "Starting device plugin registration server" Jul 10 12:46:11.150645 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.150628 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 12:46:11.150752 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.150644 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 12:46:11.150806 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.150745 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 12:46:11.150895 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.150875 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 12:46:11.150974 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.150911 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 12:46:11.151406 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.151377 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 12:46:11.151471 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.151431 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:11.224657 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.224617 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 12:46:11.225887 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.225871 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 12:46:11.226026 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.225915 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 12:46:11.226026 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.225944 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 12:46:11.226026 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.225989 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 12:46:11.228317 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.228298 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 12:46:11.251384 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.251295 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 12:46:11.252302 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.252283 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientMemory" Jul 10 12:46:11.252413 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.252316 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 12:46:11.252413 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.252330 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientPID" Jul 10 12:46:11.252413 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.252355 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.258658 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.258637 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.258728 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.258668 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-152.ec2.internal\": node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:11.275365 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.275333 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:11.326765 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.326725 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-152.ec2.internal"] Jul 10 12:46:11.326930 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.326826 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 12:46:11.328386 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.328370 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientMemory" Jul 10 12:46:11.328455 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.328401 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 12:46:11.328455 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.328414 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientPID" Jul 10 12:46:11.329800 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.329788 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 12:46:11.329970 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.329955 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.330028 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.329988 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 12:46:11.330572 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.330557 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientMemory" Jul 10 12:46:11.330642 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.330586 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 12:46:11.330642 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.330595 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientPID" Jul 10 12:46:11.330642 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.330558 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientMemory" Jul 10 12:46:11.330726 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.330654 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 12:46:11.330726 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.330665 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientPID" Jul 10 12:46:11.331529 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.331503 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.331612 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.331541 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 12:46:11.332161 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.332145 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientMemory" Jul 10 12:46:11.332242 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.332173 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 12:46:11.332242 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.332184 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeHasSufficientPID" Jul 10 12:46:11.356347 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.356322 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-152.ec2.internal\" not found" node="ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.360787 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.360768 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-152.ec2.internal\" not found" node="ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.376057 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.376033 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:11.386378 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.386356 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63989a6b5c873d17c684e53f01f88621-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal\" (UID: \"63989a6b5c873d17c684e53f01f88621\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.386459 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.386383 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63989a6b5c873d17c684e53f01f88621-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal\" (UID: \"63989a6b5c873d17c684e53f01f88621\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.386459 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.386400 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d584449cbcb95d6d238a8af1d56645ac-config\") pod \"kube-apiserver-proxy-ip-10-0-135-152.ec2.internal\" (UID: \"d584449cbcb95d6d238a8af1d56645ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.476755 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.476715 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:11.487107 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.487081 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63989a6b5c873d17c684e53f01f88621-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal\" (UID: \"63989a6b5c873d17c684e53f01f88621\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.487257 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.487112 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63989a6b5c873d17c684e53f01f88621-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal\" (UID: \"63989a6b5c873d17c684e53f01f88621\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.487257 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.487131 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d584449cbcb95d6d238a8af1d56645ac-config\") pod \"kube-apiserver-proxy-ip-10-0-135-152.ec2.internal\" (UID: \"d584449cbcb95d6d238a8af1d56645ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.487257 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.487188 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/63989a6b5c873d17c684e53f01f88621-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal\" (UID: \"63989a6b5c873d17c684e53f01f88621\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.487257 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.487249 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d584449cbcb95d6d238a8af1d56645ac-config\") pod \"kube-apiserver-proxy-ip-10-0-135-152.ec2.internal\" (UID: \"d584449cbcb95d6d238a8af1d56645ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.487391 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.487286 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63989a6b5c873d17c684e53f01f88621-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal\" (UID: \"63989a6b5c873d17c684e53f01f88621\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.577624 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.577556 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:11.659163 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.659121 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.663450 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.663434 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-152.ec2.internal" Jul 10 12:46:11.678261 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.678236 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:11.778756 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.778717 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:11.879277 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.879200 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:11.979583 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:11.979549 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:11.981892 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:11.980634 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 12:46:12.021599 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:12.021554 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 12:46:12.022107 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:12.021726 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 12:46:12.022107 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:12.021725 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 12:46:12.080092 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:12.080057 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:12.097298 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:12.097249 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 12:41:13 +0000 UTC" deadline="2028-01-27 16:16:12.1936377 +0000 UTC" Jul 10 12:46:12.097298 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:12.097292 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13587h30m0.09634849s" Jul 10 12:46:12.180202 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:12.180156 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:12.248338 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:12.248304 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd584449cbcb95d6d238a8af1d56645ac.slice/crio-24b1a1fe7f742290b8db9f49f27f389a3a2feabb16d81a87dc388d35862b715f WatchSource:0}: Error finding container 24b1a1fe7f742290b8db9f49f27f389a3a2feabb16d81a87dc388d35862b715f: Status 404 returned error can't find the container with id 24b1a1fe7f742290b8db9f49f27f389a3a2feabb16d81a87dc388d35862b715f Jul 10 12:46:12.251310 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:12.251295 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 12:46:12.279846 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:12.279824 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63989a6b5c873d17c684e53f01f88621.slice/crio-b24b16ee658b7a3877e1ead57e86a9ed5e5d1b03bab355d622fda4f32f8745ca WatchSource:0}: Error finding container b24b16ee658b7a3877e1ead57e86a9ed5e5d1b03bab355d622fda4f32f8745ca: Status 404 returned error can't find the container with id b24b16ee658b7a3877e1ead57e86a9ed5e5d1b03bab355d622fda4f32f8745ca Jul 10 12:46:12.280403 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:12.280383 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:12.380799 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:12.380760 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:12.481360 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:12.481276 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:14.616932 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:14.616903 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-152.ec2.internal\" not found" Jul 10 12:46:14.637907 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:14.637881 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 12:46:14.653785 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:14.653762 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 12:46:14.719874 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:14.719848 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" Jul 10 12:46:14.731292 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:14.731273 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 12:46:14.732258 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:14.732244 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-152.ec2.internal" Jul 10 12:46:14.740819 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:14.740802 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 12:46:15.100069 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.100040 2557 apiserver.go:52] "Watching apiserver" Jul 10 12:46:15.108256 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.108230 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 12:46:15.109286 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.109260 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-v78dm","openshift-image-registry/node-ca-xbzrz","openshift-multus/multus-additional-cni-plugins-lh7hv","openshift-network-diagnostics/network-check-target-kg958","openshift-cluster-node-tuning-operator/tuned-r8qxk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal","openshift-multus/multus-7b9x4","openshift-multus/network-metrics-daemon-rtskf","openshift-network-operator/iptables-alerter-6jqcl","openshift-ovn-kubernetes/ovnkube-node-l2sqc","kube-system/global-pull-secret-syncer-thrnw","kube-system/konnectivity-agent-zd5ws","kube-system/kube-apiserver-proxy-ip-10-0-135-152.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r"] Jul 10 12:46:15.111865 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.111832 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.114149 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.114124 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:15.114245 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.114219 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:15.114377 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.114362 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 12:46:15.114442 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.114380 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 12:46:15.114512 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.114368 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tpt8g\"" Jul 10 12:46:15.114569 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.114503 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 12:46:15.114620 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.114590 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 12:46:15.116338 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.116320 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.118736 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.118636 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 12:46:15.119037 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.119016 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p4blf\"" Jul 10 12:46:15.119129 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.119043 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 12:46:15.119330 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.119314 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 12:46:15.119404 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.119376 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:15.119466 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.119447 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:15.120848 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.120826 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.123165 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.123004 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 12:46:15.123165 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.123119 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nqwr4\"" Jul 10 12:46:15.123362 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.123330 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 12:46:15.123727 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.123705 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.127065 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.127028 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 12:46:15.127065 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.127036 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-49zhw\"" Jul 10 12:46:15.127802 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.127542 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6jqcl" Jul 10 12:46:15.128215 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.128195 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 12:46:15.128300 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.128291 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 12:46:15.130107 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.130085 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:15.130187 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.130107 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 12:46:15.130187 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.130152 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:15.130369 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.130331 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 12:46:15.130500 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.130482 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bdw9x\"" Jul 10 12:46:15.130645 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.130623 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 12:46:15.131862 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.131818 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-sys\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.131862 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.131847 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-host\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.132070 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.131881 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6brh\" (UniqueName: \"kubernetes.io/projected/0520f514-4726-4414-a558-5d6cbf839698-kube-api-access-v6brh\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.132070 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.131902 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-cnibin\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.132070 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.131923 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c33427ab-8871-428e-8eab-5d11cd0f2c65-cni-binary-copy\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.132070 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.131942 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-multus-socket-dir-parent\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.132070 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.131964 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-var-lib-kubelet\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.132309 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132165 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xbzrz" Jul 10 12:46:15.132391 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132371 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-multus-conf-dir\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.132582 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132557 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-etc-kubernetes\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.132673 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132595 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f52d9bdf-1792-4e26-8b37-c2913530a624-os-release\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.132673 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132622 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-run\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.132673 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132646 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-hostroot\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.132830 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132374 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 12:46:15.132830 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132680 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-sysconfig\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.132830 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132746 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f52d9bdf-1792-4e26-8b37-c2913530a624-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.132830 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132771 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-dbus\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:15.132830 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132794 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f52d9bdf-1792-4e26-8b37-c2913530a624-cnibin\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.132830 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132818 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-sysctl-conf\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.133113 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132840 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-systemd\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.133113 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132861 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-system-cni-dir\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.133113 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132883 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-run-netns\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.133113 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132906 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf4n2\" (UniqueName: \"kubernetes.io/projected/f52d9bdf-1792-4e26-8b37-c2913530a624-kube-api-access-gf4n2\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.133113 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132927 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-var-lib-kubelet\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.133113 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132944 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c33427ab-8871-428e-8eab-5d11cd0f2c65-multus-daemon-config\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.133113 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132958 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-run-multus-certs\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.133113 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.132983 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg9qc\" (UniqueName: \"kubernetes.io/projected/c33427ab-8871-428e-8eab-5d11cd0f2c65-kube-api-access-qg9qc\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.133113 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133019 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-os-release\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.133113 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133060 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:15.133113 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133093 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-modprobe-d\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.133113 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133116 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-kubernetes\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133153 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-sysctl-d\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133199 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-lib-modules\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133231 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0520f514-4726-4414-a558-5d6cbf839698-tmp\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133262 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f52d9bdf-1792-4e26-8b37-c2913530a624-cni-binary-copy\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133295 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-multus-cni-dir\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133341 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-var-lib-cni-bin\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133381 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-kubelet-config\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133404 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f52d9bdf-1792-4e26-8b37-c2913530a624-system-cni-dir\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133426 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f52d9bdf-1792-4e26-8b37-c2913530a624-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133497 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0520f514-4726-4414-a558-5d6cbf839698-etc-tuned\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133521 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-run-k8s-cni-cncf-io\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133543 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-var-lib-cni-multus\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133566 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f52d9bdf-1792-4e26-8b37-c2913530a624-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.133757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.133592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwj7z\" (UniqueName: \"kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z\") pod \"network-check-target-kg958\" (UID: \"4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e\") " pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:15.134419 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.134372 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 12:46:15.134656 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.134635 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 12:46:15.134656 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.134649 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gbk2h\"" Jul 10 12:46:15.134791 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.134693 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 12:46:15.134940 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.134922 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.137532 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.137321 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v78dm" Jul 10 12:46:15.137854 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.137834 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 12:46:15.137934 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.137907 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 12:46:15.138066 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.138050 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 12:46:15.138419 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.138172 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 12:46:15.138419 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.138275 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k7w59\"" Jul 10 12:46:15.138419 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.137843 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 12:46:15.138614 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.138511 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 12:46:15.139926 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.139869 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zd5ws" Jul 10 12:46:15.139926 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.139905 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 12:46:15.140341 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.140172 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ps5h7\"" Jul 10 12:46:15.140341 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.140257 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 12:46:15.142207 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.141968 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 12:46:15.142300 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.142278 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-clqj7\"" Jul 10 12:46:15.142547 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.142522 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 12:46:15.152471 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.152395 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hz582" Jul 10 12:46:15.159852 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.159826 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hz582" Jul 10 12:46:15.221451 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.221373 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 12:46:15.234130 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234099 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-etc-openvswitch\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.234294 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234141 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-ovnkube-script-lib\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.234294 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234165 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c99a6b22-f975-4aed-8a4a-650d1eb2b36b-host-slash\") pod \"iptables-alerter-6jqcl\" (UID: \"c99a6b22-f975-4aed-8a4a-650d1eb2b36b\") " pod="openshift-network-operator/iptables-alerter-6jqcl" Jul 10 12:46:15.234294 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234211 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25c28891-e02d-475f-a145-486db0b0e335-host\") pod \"node-ca-xbzrz\" (UID: \"25c28891-e02d-475f-a145-486db0b0e335\") " pod="openshift-image-registry/node-ca-xbzrz" Jul 10 12:46:15.234294 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234271 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f52d9bdf-1792-4e26-8b37-c2913530a624-cnibin\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.234525 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234307 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-sysctl-conf\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.234525 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234362 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f52d9bdf-1792-4e26-8b37-c2913530a624-cnibin\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.234525 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234392 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:15.234525 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234422 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-system-cni-dir\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.234525 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234442 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-run-netns\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.234525 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234465 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cxv2\" (UniqueName: \"kubernetes.io/projected/32444ef9-93e0-4ddc-9645-5d32a3548eee-kube-api-access-4cxv2\") pod \"node-resolver-v78dm\" (UID: \"32444ef9-93e0-4ddc-9645-5d32a3548eee\") " pod="openshift-dns/node-resolver-v78dm" Jul 10 12:46:15.234525 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234491 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c33427ab-8871-428e-8eab-5d11cd0f2c65-multus-daemon-config\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.234525 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234508 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-sysctl-conf\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.234525 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234514 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg9qc\" (UniqueName: \"kubernetes.io/projected/c33427ab-8871-428e-8eab-5d11cd0f2c65-kube-api-access-qg9qc\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234539 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzpqz\" (UniqueName: \"kubernetes.io/projected/25c28891-e02d-475f-a145-486db0b0e335-kube-api-access-mzpqz\") pod \"node-ca-xbzrz\" (UID: \"25c28891-e02d-475f-a145-486db0b0e335\") " pod="openshift-image-registry/node-ca-xbzrz" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234558 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-run-netns\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234564 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234592 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-modprobe-d\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234641 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-lib-modules\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234666 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-slash\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234688 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f52d9bdf-1792-4e26-8b37-c2913530a624-cni-binary-copy\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234709 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-multus-cni-dir\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234733 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-var-lib-cni-bin\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234756 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f52d9bdf-1792-4e26-8b37-c2913530a624-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0520f514-4726-4414-a558-5d6cbf839698-etc-tuned\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234803 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpcdn\" (UniqueName: \"kubernetes.io/projected/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-kube-api-access-zpcdn\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234833 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwj7z\" (UniqueName: \"kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z\") pod \"network-check-target-kg958\" (UID: \"4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e\") " pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234856 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-sys\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234883 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-host\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.234965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234907 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-cni-bin\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234931 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234930 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-lib-modules\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234513 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-system-cni-dir\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.234956 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c33427ab-8871-428e-8eab-5d11cd0f2c65-cni-binary-copy\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235007 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-multus-conf-dir\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235035 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-etc-kubernetes\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235061 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f52d9bdf-1792-4e26-8b37-c2913530a624-os-release\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235087 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-log-socket\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235114 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235139 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-hostroot\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235164 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-sysconfig\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235178 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c33427ab-8871-428e-8eab-5d11cd0f2c65-multus-daemon-config\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235188 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25c28891-e02d-475f-a145-486db0b0e335-serviceca\") pod \"node-ca-xbzrz\" (UID: \"25c28891-e02d-475f-a145-486db0b0e335\") " pod="openshift-image-registry/node-ca-xbzrz" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235213 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-systemd-units\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235236 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-run-systemd\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235260 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-socket-dir\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.235774 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235270 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f52d9bdf-1792-4e26-8b37-c2913530a624-os-release\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235283 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-etc-selinux\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235308 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmnbn\" (UniqueName: \"kubernetes.io/projected/c99a6b22-f975-4aed-8a4a-650d1eb2b36b-kube-api-access-bmnbn\") pod \"iptables-alerter-6jqcl\" (UID: \"c99a6b22-f975-4aed-8a4a-650d1eb2b36b\") " pod="openshift-network-operator/iptables-alerter-6jqcl" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235333 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f52d9bdf-1792-4e26-8b37-c2913530a624-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.235375 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235381 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-dbus\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235399 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c33427ab-8871-428e-8eab-5d11cd0f2c65-cni-binary-copy\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235407 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-systemd\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235433 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-run-ovn\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.235450 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret podName:2b18e6b0-54a0-4f26-a217-e58f61c6d45c nodeName:}" failed. No retries permitted until 2026-07-10 12:46:15.735429985 +0000 UTC m=+2.966540398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret") pod "global-pull-secret-syncer-thrnw" (UID: "2b18e6b0-54a0-4f26-a217-e58f61c6d45c") : object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235495 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-multus-conf-dir\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235584 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-modprobe-d\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235617 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-etc-kubernetes\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235823 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-env-overrides\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235857 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf4n2\" (UniqueName: \"kubernetes.io/projected/f52d9bdf-1792-4e26-8b37-c2913530a624-kube-api-access-gf4n2\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235887 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-var-lib-kubelet\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235911 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-run-openvswitch\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.236557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235966 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32444ef9-93e0-4ddc-9645-5d32a3548eee-tmp-dir\") pod \"node-resolver-v78dm\" (UID: \"32444ef9-93e0-4ddc-9645-5d32a3548eee\") " pod="openshift-dns/node-resolver-v78dm" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235993 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-run-multus-certs\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.235999 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f52d9bdf-1792-4e26-8b37-c2913530a624-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236017 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-node-log\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236033 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f52d9bdf-1792-4e26-8b37-c2913530a624-cni-binary-copy\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32444ef9-93e0-4ddc-9645-5d32a3548eee-hosts-file\") pod \"node-resolver-v78dm\" (UID: \"32444ef9-93e0-4ddc-9645-5d32a3548eee\") " pod="openshift-dns/node-resolver-v78dm" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236064 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-registration-dir\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236089 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-os-release\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236112 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-kubernetes\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236138 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-sysctl-d\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236161 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0520f514-4726-4414-a558-5d6cbf839698-tmp\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236185 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9b7h\" (UniqueName: \"kubernetes.io/projected/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-kube-api-access-x9b7h\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236221 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-sys-fs\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236248 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-kubelet-config\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236276 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f52d9bdf-1792-4e26-8b37-c2913530a624-system-cni-dir\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236281 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-sys\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236303 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 12:46:15.237609 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236327 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f52d9bdf-1792-4e26-8b37-c2913530a624-system-cni-dir\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236336 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-host\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236375 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-run-netns\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236406 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-cni-netd\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236443 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-var-lib-cni-bin\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236460 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-os-release\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236500 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-var-lib-kubelet\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236533 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-run-multus-certs\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236565 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-ovnkube-config\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236591 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-ovn-node-metrics-cert\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236622 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdb963f2-e593-4dca-ba8b-807e88492383-agent-certs\") pod \"konnectivity-agent-zd5ws\" (UID: \"cdb963f2-e593-4dca-ba8b-807e88492383\") " pod="kube-system/konnectivity-agent-zd5ws" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236652 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-run-k8s-cni-cncf-io\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236661 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-kubernetes\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236687 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-var-lib-cni-multus\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236716 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f52d9bdf-1792-4e26-8b37-c2913530a624-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236735 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-var-lib-cni-multus\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236744 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6brh\" (UniqueName: \"kubernetes.io/projected/0520f514-4726-4414-a558-5d6cbf839698-kube-api-access-v6brh\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.238399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236768 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j77wd\" (UniqueName: \"kubernetes.io/projected/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-kube-api-access-j77wd\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236788 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-var-lib-openvswitch\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236823 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-device-dir\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236845 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-sysctl-d\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c99a6b22-f975-4aed-8a4a-650d1eb2b36b-iptables-alerter-script\") pod \"iptables-alerter-6jqcl\" (UID: \"c99a6b22-f975-4aed-8a4a-650d1eb2b36b\") " pod="openshift-network-operator/iptables-alerter-6jqcl" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236891 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-cnibin\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236916 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-multus-socket-dir-parent\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236951 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-var-lib-kubelet\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.236977 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-run\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237000 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdb963f2-e593-4dca-ba8b-807e88492383-konnectivity-ca\") pod \"konnectivity-agent-zd5ws\" (UID: \"cdb963f2-e593-4dca-ba8b-807e88492383\") " pod="kube-system/konnectivity-agent-zd5ws" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237030 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-kubelet\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237133 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-run-k8s-cni-cncf-io\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237190 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-multus-socket-dir-parent\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237221 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-cnibin\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237228 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-host-var-lib-kubelet\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237411 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-multus-cni-dir\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237440 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-run\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237516 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c33427ab-8871-428e-8eab-5d11cd0f2c65-hostroot\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.239179 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237570 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f52d9bdf-1792-4e26-8b37-c2913530a624-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.239966 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237626 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-dbus\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:15.239966 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237626 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-systemd\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.239966 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237669 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-kubelet-config\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:15.239966 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237746 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0520f514-4726-4414-a558-5d6cbf839698-etc-sysconfig\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.239966 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.237858 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f52d9bdf-1792-4e26-8b37-c2913530a624-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.240195 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.240097 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0520f514-4726-4414-a558-5d6cbf839698-etc-tuned\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.240195 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.240136 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0520f514-4726-4414-a558-5d6cbf839698-tmp\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.246180 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.246160 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 12:46:15.246180 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.246181 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 12:46:15.246417 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.246194 2557 projected.go:196] Error preparing data for projected volume kube-api-access-vwj7z for pod openshift-network-diagnostics/network-check-target-kg958: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:15.246417 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.246251 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z podName:4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e nodeName:}" failed. No retries permitted until 2026-07-10 12:46:15.746234114 +0000 UTC m=+2.977344546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vwj7z" (UniqueName: "kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z") pod "network-check-target-kg958" (UID: "4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:15.249536 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.249512 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6brh\" (UniqueName: \"kubernetes.io/projected/0520f514-4726-4414-a558-5d6cbf839698-kube-api-access-v6brh\") pod \"tuned-r8qxk\" (UID: \"0520f514-4726-4414-a558-5d6cbf839698\") " pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.249994 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.249961 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg9qc\" (UniqueName: \"kubernetes.io/projected/c33427ab-8871-428e-8eab-5d11cd0f2c65-kube-api-access-qg9qc\") pod \"multus-7b9x4\" (UID: \"c33427ab-8871-428e-8eab-5d11cd0f2c65\") " pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.250366 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.250335 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf4n2\" (UniqueName: \"kubernetes.io/projected/f52d9bdf-1792-4e26-8b37-c2913530a624-kube-api-access-gf4n2\") pod \"multus-additional-cni-plugins-lh7hv\" (UID: \"f52d9bdf-1792-4e26-8b37-c2913530a624\") " pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.267416 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.267362 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" event={"ID":"63989a6b5c873d17c684e53f01f88621","Type":"ContainerStarted","Data":"b24b16ee658b7a3877e1ead57e86a9ed5e5d1b03bab355d622fda4f32f8745ca"} Jul 10 12:46:15.268841 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.268810 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-152.ec2.internal" event={"ID":"d584449cbcb95d6d238a8af1d56645ac","Type":"ContainerStarted","Data":"24b1a1fe7f742290b8db9f49f27f389a3a2feabb16d81a87dc388d35862b715f"} Jul 10 12:46:15.278856 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.278826 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 12:46:15.338237 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338200 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-slash\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.338438 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338252 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpcdn\" (UniqueName: \"kubernetes.io/projected/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-kube-api-access-zpcdn\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.338438 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338299 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-cni-bin\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.338438 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338321 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.338438 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338361 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-log-socket\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.338438 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338387 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.338438 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338412 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25c28891-e02d-475f-a145-486db0b0e335-serviceca\") pod \"node-ca-xbzrz\" (UID: \"25c28891-e02d-475f-a145-486db0b0e335\") " pod="openshift-image-registry/node-ca-xbzrz" Jul 10 12:46:15.338438 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338434 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-systemd-units\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338468 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-run-systemd\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338495 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-socket-dir\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338517 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-etc-selinux\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338546 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmnbn\" (UniqueName: \"kubernetes.io/projected/c99a6b22-f975-4aed-8a4a-650d1eb2b36b-kube-api-access-bmnbn\") pod \"iptables-alerter-6jqcl\" (UID: \"c99a6b22-f975-4aed-8a4a-650d1eb2b36b\") " pod="openshift-network-operator/iptables-alerter-6jqcl" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338574 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-run-ovn\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338595 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-env-overrides\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338621 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-run-openvswitch\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338646 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32444ef9-93e0-4ddc-9645-5d32a3548eee-tmp-dir\") pod \"node-resolver-v78dm\" (UID: \"32444ef9-93e0-4ddc-9645-5d32a3548eee\") " pod="openshift-dns/node-resolver-v78dm" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338670 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-node-log\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338695 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32444ef9-93e0-4ddc-9645-5d32a3548eee-hosts-file\") pod \"node-resolver-v78dm\" (UID: \"32444ef9-93e0-4ddc-9645-5d32a3548eee\") " pod="openshift-dns/node-resolver-v78dm" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338719 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-registration-dir\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338746 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9b7h\" (UniqueName: \"kubernetes.io/projected/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-kube-api-access-x9b7h\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338769 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-sys-fs\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338794 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-run-netns\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.338813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338816 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-cni-netd\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338839 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-ovnkube-config\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338863 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-ovn-node-metrics-cert\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338887 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdb963f2-e593-4dca-ba8b-807e88492383-agent-certs\") pod \"konnectivity-agent-zd5ws\" (UID: \"cdb963f2-e593-4dca-ba8b-807e88492383\") " pod="kube-system/konnectivity-agent-zd5ws" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338917 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j77wd\" (UniqueName: \"kubernetes.io/projected/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-kube-api-access-j77wd\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338941 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-var-lib-openvswitch\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338964 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-device-dir\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.338989 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c99a6b22-f975-4aed-8a4a-650d1eb2b36b-iptables-alerter-script\") pod \"iptables-alerter-6jqcl\" (UID: \"c99a6b22-f975-4aed-8a4a-650d1eb2b36b\") " pod="openshift-network-operator/iptables-alerter-6jqcl" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339019 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdb963f2-e593-4dca-ba8b-807e88492383-konnectivity-ca\") pod \"konnectivity-agent-zd5ws\" (UID: \"cdb963f2-e593-4dca-ba8b-807e88492383\") " pod="kube-system/konnectivity-agent-zd5ws" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-kubelet\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339067 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-etc-openvswitch\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339091 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-ovnkube-script-lib\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339115 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c99a6b22-f975-4aed-8a4a-650d1eb2b36b-host-slash\") pod \"iptables-alerter-6jqcl\" (UID: \"c99a6b22-f975-4aed-8a4a-650d1eb2b36b\") " pod="openshift-network-operator/iptables-alerter-6jqcl" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339138 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25c28891-e02d-475f-a145-486db0b0e335-host\") pod \"node-ca-xbzrz\" (UID: \"25c28891-e02d-475f-a145-486db0b0e335\") " pod="openshift-image-registry/node-ca-xbzrz" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339164 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339192 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cxv2\" (UniqueName: \"kubernetes.io/projected/32444ef9-93e0-4ddc-9645-5d32a3548eee-kube-api-access-4cxv2\") pod \"node-resolver-v78dm\" (UID: \"32444ef9-93e0-4ddc-9645-5d32a3548eee\") " pod="openshift-dns/node-resolver-v78dm" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339218 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzpqz\" (UniqueName: \"kubernetes.io/projected/25c28891-e02d-475f-a145-486db0b0e335-kube-api-access-mzpqz\") pod \"node-ca-xbzrz\" (UID: \"25c28891-e02d-475f-a145-486db0b0e335\") " pod="openshift-image-registry/node-ca-xbzrz" Jul 10 12:46:15.339556 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339245 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.340205 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339369 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.340205 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339419 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-slash\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.340205 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339704 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-cni-bin\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.340205 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339745 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-sys-fs\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.340205 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339760 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-cni-netd\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.340205 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.339791 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-run-ovn\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.340205 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340094 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.340205 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340147 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-log-socket\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.340591 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340207 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-run-systemd\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.340591 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340217 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-node-log\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.340591 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340273 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-run-openvswitch\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.340591 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340303 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-etc-selinux\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.340591 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340321 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-socket-dir\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.340591 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340358 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-ovnkube-config\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.340591 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340375 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-registration-dir\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.340591 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340398 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-run-netns\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.340591 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340429 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32444ef9-93e0-4ddc-9645-5d32a3548eee-hosts-file\") pod \"node-resolver-v78dm\" (UID: \"32444ef9-93e0-4ddc-9645-5d32a3548eee\") " pod="openshift-dns/node-resolver-v78dm" Jul 10 12:46:15.340591 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340471 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-etc-openvswitch\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.341116 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340606 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32444ef9-93e0-4ddc-9645-5d32a3548eee-tmp-dir\") pod \"node-resolver-v78dm\" (UID: \"32444ef9-93e0-4ddc-9645-5d32a3548eee\") " pod="openshift-dns/node-resolver-v78dm" Jul 10 12:46:15.341116 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340698 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-var-lib-openvswitch\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.341116 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.340769 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-device-dir\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.341116 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.341008 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25c28891-e02d-475f-a145-486db0b0e335-serviceca\") pod \"node-ca-xbzrz\" (UID: \"25c28891-e02d-475f-a145-486db0b0e335\") " pod="openshift-image-registry/node-ca-xbzrz" Jul 10 12:46:15.341116 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.341079 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-systemd-units\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.341371 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.341133 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25c28891-e02d-475f-a145-486db0b0e335-host\") pod \"node-ca-xbzrz\" (UID: \"25c28891-e02d-475f-a145-486db0b0e335\") " pod="openshift-image-registry/node-ca-xbzrz" Jul 10 12:46:15.341371 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.341283 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c99a6b22-f975-4aed-8a4a-650d1eb2b36b-iptables-alerter-script\") pod \"iptables-alerter-6jqcl\" (UID: \"c99a6b22-f975-4aed-8a4a-650d1eb2b36b\") " pod="openshift-network-operator/iptables-alerter-6jqcl" Jul 10 12:46:15.341725 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.341616 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-ovnkube-script-lib\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.341725 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.341678 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c99a6b22-f975-4aed-8a4a-650d1eb2b36b-host-slash\") pod \"iptables-alerter-6jqcl\" (UID: \"c99a6b22-f975-4aed-8a4a-650d1eb2b36b\") " pod="openshift-network-operator/iptables-alerter-6jqcl" Jul 10 12:46:15.342012 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.341815 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdb963f2-e593-4dca-ba8b-807e88492383-konnectivity-ca\") pod \"konnectivity-agent-zd5ws\" (UID: \"cdb963f2-e593-4dca-ba8b-807e88492383\") " pod="kube-system/konnectivity-agent-zd5ws" Jul 10 12:46:15.342012 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.341876 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-kubelet\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.342012 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.341914 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.342180 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.342106 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:15.342180 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.342172 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs podName:c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b nodeName:}" failed. No retries permitted until 2026-07-10 12:46:15.842153565 +0000 UTC m=+3.073263995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs") pod "network-metrics-daemon-rtskf" (UID: "c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:15.342866 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.342830 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-env-overrides\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.343359 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.343282 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdb963f2-e593-4dca-ba8b-807e88492383-agent-certs\") pod \"konnectivity-agent-zd5ws\" (UID: \"cdb963f2-e593-4dca-ba8b-807e88492383\") " pod="kube-system/konnectivity-agent-zd5ws" Jul 10 12:46:15.344437 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.344416 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-ovn-node-metrics-cert\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.355453 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.355317 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzpqz\" (UniqueName: \"kubernetes.io/projected/25c28891-e02d-475f-a145-486db0b0e335-kube-api-access-mzpqz\") pod \"node-ca-xbzrz\" (UID: \"25c28891-e02d-475f-a145-486db0b0e335\") " pod="openshift-image-registry/node-ca-xbzrz" Jul 10 12:46:15.355919 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.355875 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9b7h\" (UniqueName: \"kubernetes.io/projected/01a94845-a8c9-4a5a-9bfe-1e7f800681b4-kube-api-access-x9b7h\") pod \"ovnkube-node-l2sqc\" (UID: \"01a94845-a8c9-4a5a-9bfe-1e7f800681b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.357733 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.357695 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j77wd\" (UniqueName: \"kubernetes.io/projected/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-kube-api-access-j77wd\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:15.357733 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.357719 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmnbn\" (UniqueName: \"kubernetes.io/projected/c99a6b22-f975-4aed-8a4a-650d1eb2b36b-kube-api-access-bmnbn\") pod \"iptables-alerter-6jqcl\" (UID: \"c99a6b22-f975-4aed-8a4a-650d1eb2b36b\") " pod="openshift-network-operator/iptables-alerter-6jqcl" Jul 10 12:46:15.357848 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.357726 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cxv2\" (UniqueName: \"kubernetes.io/projected/32444ef9-93e0-4ddc-9645-5d32a3548eee-kube-api-access-4cxv2\") pod \"node-resolver-v78dm\" (UID: \"32444ef9-93e0-4ddc-9645-5d32a3548eee\") " pod="openshift-dns/node-resolver-v78dm" Jul 10 12:46:15.358167 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.358145 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpcdn\" (UniqueName: \"kubernetes.io/projected/9888afc1-7cf8-4c64-899b-b6bbdd4c382b-kube-api-access-zpcdn\") pod \"aws-ebs-csi-driver-node-8j44r\" (UID: \"9888afc1-7cf8-4c64-899b-b6bbdd4c382b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.422989 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.422950 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7b9x4" Jul 10 12:46:15.431257 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.431049 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lh7hv" Jul 10 12:46:15.435512 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:15.435479 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33427ab_8871_428e_8eab_5d11cd0f2c65.slice/crio-fa1fcc48cff7aac09bc055dc4c98d98800df05dd8860d74bc53c4b0620774f59 WatchSource:0}: Error finding container fa1fcc48cff7aac09bc055dc4c98d98800df05dd8860d74bc53c4b0620774f59: Status 404 returned error can't find the container with id fa1fcc48cff7aac09bc055dc4c98d98800df05dd8860d74bc53c4b0620774f59 Jul 10 12:46:15.441626 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:15.441595 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52d9bdf_1792_4e26_8b37_c2913530a624.slice/crio-4513f8dd322ca074a8c922f74448a495889f83b55efbe93e39b883ed4ea4f50b WatchSource:0}: Error finding container 4513f8dd322ca074a8c922f74448a495889f83b55efbe93e39b883ed4ea4f50b: Status 404 returned error can't find the container with id 4513f8dd322ca074a8c922f74448a495889f83b55efbe93e39b883ed4ea4f50b Jul 10 12:46:15.442485 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.442461 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" Jul 10 12:46:15.455559 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.455531 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" Jul 10 12:46:15.463585 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.463561 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6jqcl" Jul 10 12:46:15.471330 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.471301 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xbzrz" Jul 10 12:46:15.479176 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.479154 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:15.486954 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.486930 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v78dm" Jul 10 12:46:15.491763 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.491737 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zd5ws" Jul 10 12:46:15.742688 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.742600 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:15.742852 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.742773 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:15.742852 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.742848 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret podName:2b18e6b0-54a0-4f26-a217-e58f61c6d45c nodeName:}" failed. No retries permitted until 2026-07-10 12:46:16.742825452 +0000 UTC m=+3.973935870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret") pod "global-pull-secret-syncer-thrnw" (UID: "2b18e6b0-54a0-4f26-a217-e58f61c6d45c") : object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:15.788869 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:15.788835 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9888afc1_7cf8_4c64_899b_b6bbdd4c382b.slice/crio-08369e9daaa08ccdeeb9d7d5e266568eb8e6f50d84346c412fd3dedd45fb9e4c WatchSource:0}: Error finding container 08369e9daaa08ccdeeb9d7d5e266568eb8e6f50d84346c412fd3dedd45fb9e4c: Status 404 returned error can't find the container with id 08369e9daaa08ccdeeb9d7d5e266568eb8e6f50d84346c412fd3dedd45fb9e4c Jul 10 12:46:15.843251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.843219 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:15.843427 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:15.843269 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwj7z\" (UniqueName: \"kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z\") pod \"network-check-target-kg958\" (UID: \"4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e\") " pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:15.843427 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.843399 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:15.843535 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.843460 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs podName:c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b nodeName:}" failed. No retries permitted until 2026-07-10 12:46:16.843444142 +0000 UTC m=+4.074554558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs") pod "network-metrics-daemon-rtskf" (UID: "c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:15.843535 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.843407 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 12:46:15.843535 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.843517 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 12:46:15.843535 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.843529 2557 projected.go:196] Error preparing data for projected volume kube-api-access-vwj7z for pod openshift-network-diagnostics/network-check-target-kg958: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:15.843690 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:15.843579 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z podName:4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e nodeName:}" failed. No retries permitted until 2026-07-10 12:46:16.843564063 +0000 UTC m=+4.074674475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwj7z" (UniqueName: "kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z") pod "network-check-target-kg958" (UID: "4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:16.029631 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:16.029551 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 12:46:16.163715 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:16.163657 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 12:41:15 +0000 UTC" deadline="2028-03-03 10:03:01.510076604 +0000 UTC" Jul 10 12:46:16.163715 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:16.163705 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14445h16m45.346375356s" Jul 10 12:46:16.271496 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:16.271466 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" event={"ID":"9888afc1-7cf8-4c64-899b-b6bbdd4c382b","Type":"ContainerStarted","Data":"08369e9daaa08ccdeeb9d7d5e266568eb8e6f50d84346c412fd3dedd45fb9e4c"} Jul 10 12:46:16.272606 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:16.272575 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh7hv" event={"ID":"f52d9bdf-1792-4e26-8b37-c2913530a624","Type":"ContainerStarted","Data":"4513f8dd322ca074a8c922f74448a495889f83b55efbe93e39b883ed4ea4f50b"} Jul 10 12:46:16.273709 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:16.273681 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7b9x4" event={"ID":"c33427ab-8871-428e-8eab-5d11cd0f2c65","Type":"ContainerStarted","Data":"fa1fcc48cff7aac09bc055dc4c98d98800df05dd8860d74bc53c4b0620774f59"} Jul 10 12:46:16.456075 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:16.456046 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0520f514_4726_4414_a558_5d6cbf839698.slice/crio-7fb600d66b19e5aae441b3b3fde7ed1b069272c976b03eafe7acc1a1594b30c7 WatchSource:0}: Error finding container 7fb600d66b19e5aae441b3b3fde7ed1b069272c976b03eafe7acc1a1594b30c7: Status 404 returned error can't find the container with id 7fb600d66b19e5aae441b3b3fde7ed1b069272c976b03eafe7acc1a1594b30c7 Jul 10 12:46:16.458266 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:16.458189 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c28891_e02d_475f_a145_486db0b0e335.slice/crio-6d03d72bcd43c22137c330457ce69111ff47d506caf315d5971115437c647bba WatchSource:0}: Error finding container 6d03d72bcd43c22137c330457ce69111ff47d506caf315d5971115437c647bba: Status 404 returned error can't find the container with id 6d03d72bcd43c22137c330457ce69111ff47d506caf315d5971115437c647bba Jul 10 12:46:16.460521 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:16.460502 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32444ef9_93e0_4ddc_9645_5d32a3548eee.slice/crio-935f9982185f86579769e7813fa912c0d5e1f00897bcea2538808ddd6ab8c694 WatchSource:0}: Error finding container 935f9982185f86579769e7813fa912c0d5e1f00897bcea2538808ddd6ab8c694: Status 404 returned error can't find the container with id 935f9982185f86579769e7813fa912c0d5e1f00897bcea2538808ddd6ab8c694 Jul 10 12:46:16.462025 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:16.462006 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a94845_a8c9_4a5a_9bfe_1e7f800681b4.slice/crio-fb01098930fd3d73270a1e37c05eadc13c57e255a8d2468967db106c1bf3d720 WatchSource:0}: Error finding container fb01098930fd3d73270a1e37c05eadc13c57e255a8d2468967db106c1bf3d720: Status 404 returned error can't find the container with id fb01098930fd3d73270a1e37c05eadc13c57e255a8d2468967db106c1bf3d720 Jul 10 12:46:16.464765 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:16.464684 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb963f2_e593_4dca_ba8b_807e88492383.slice/crio-4c90010a1ca35c36f127aa8e0bb08ba60b25888b87cf313704a511a7524e5736 WatchSource:0}: Error finding container 4c90010a1ca35c36f127aa8e0bb08ba60b25888b87cf313704a511a7524e5736: Status 404 returned error can't find the container with id 4c90010a1ca35c36f127aa8e0bb08ba60b25888b87cf313704a511a7524e5736 Jul 10 12:46:16.749370 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:16.748927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:16.749370 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:16.749213 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:16.749370 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:16.749297 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret podName:2b18e6b0-54a0-4f26-a217-e58f61c6d45c nodeName:}" failed. No retries permitted until 2026-07-10 12:46:18.749275595 +0000 UTC m=+5.980386008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret") pod "global-pull-secret-syncer-thrnw" (UID: "2b18e6b0-54a0-4f26-a217-e58f61c6d45c") : object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:16.849789 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:16.849722 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:16.849935 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:16.849794 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwj7z\" (UniqueName: \"kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z\") pod \"network-check-target-kg958\" (UID: \"4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e\") " pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:16.849935 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:16.849901 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:16.850052 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:16.849968 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs podName:c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b nodeName:}" failed. No retries permitted until 2026-07-10 12:46:18.849953671 +0000 UTC m=+6.081064082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs") pod "network-metrics-daemon-rtskf" (UID: "c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:16.850052 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:16.849909 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 12:46:16.850052 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:16.850010 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 12:46:16.850052 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:16.850020 2557 projected.go:196] Error preparing data for projected volume kube-api-access-vwj7z for pod openshift-network-diagnostics/network-check-target-kg958: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:16.850246 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:16.850064 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z podName:4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e nodeName:}" failed. No retries permitted until 2026-07-10 12:46:18.850052774 +0000 UTC m=+6.081163185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwj7z" (UniqueName: "kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z") pod "network-check-target-kg958" (UID: "4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:17.164564 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.164521 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 12:41:15 +0000 UTC" deadline="2028-02-17 23:42:22.593400385 +0000 UTC" Jul 10 12:46:17.164564 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.164562 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14098h56m5.428842363s" Jul 10 12:46:17.261498 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.261462 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:17.261674 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.261462 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:17.261674 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:17.261601 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:17.261674 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.261650 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:17.261827 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:17.261717 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:17.261827 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:17.261781 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:17.282760 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.282727 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v78dm" event={"ID":"32444ef9-93e0-4ddc-9645-5d32a3548eee","Type":"ContainerStarted","Data":"935f9982185f86579769e7813fa912c0d5e1f00897bcea2538808ddd6ab8c694"} Jul 10 12:46:17.285585 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.285530 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" event={"ID":"0520f514-4726-4414-a558-5d6cbf839698","Type":"ContainerStarted","Data":"7fb600d66b19e5aae441b3b3fde7ed1b069272c976b03eafe7acc1a1594b30c7"} Jul 10 12:46:17.294391 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.293984 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-152.ec2.internal" event={"ID":"d584449cbcb95d6d238a8af1d56645ac","Type":"ContainerStarted","Data":"84f636cb1513aa9cd590d0af6ed56acef420955ea6e6c6c429fcb2b8b8a1a46f"} Jul 10 12:46:17.297788 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.297753 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6jqcl" event={"ID":"c99a6b22-f975-4aed-8a4a-650d1eb2b36b","Type":"ContainerStarted","Data":"84e456189ec8331854494837e3c5a5b71f4a3993ef8302e38ed25a67ac180f96"} Jul 10 12:46:17.302517 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.302488 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zd5ws" event={"ID":"cdb963f2-e593-4dca-ba8b-807e88492383","Type":"ContainerStarted","Data":"4c90010a1ca35c36f127aa8e0bb08ba60b25888b87cf313704a511a7524e5736"} Jul 10 12:46:17.317297 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.317263 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" event={"ID":"01a94845-a8c9-4a5a-9bfe-1e7f800681b4","Type":"ContainerStarted","Data":"fb01098930fd3d73270a1e37c05eadc13c57e255a8d2468967db106c1bf3d720"} Jul 10 12:46:17.326225 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.326192 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xbzrz" event={"ID":"25c28891-e02d-475f-a145-486db0b0e335","Type":"ContainerStarted","Data":"6d03d72bcd43c22137c330457ce69111ff47d506caf315d5971115437c647bba"} Jul 10 12:46:17.334160 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.334131 2557 generic.go:356] "Generic (PLEG): container finished" podID="63989a6b5c873d17c684e53f01f88621" containerID="f514018249b5bf0135527fdefc856a919b920a5950dd8cccb41efdfef6d403c6" exitCode=0 Jul 10 12:46:17.334291 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.334175 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" event={"ID":"63989a6b5c873d17c684e53f01f88621","Type":"ContainerDied","Data":"f514018249b5bf0135527fdefc856a919b920a5950dd8cccb41efdfef6d403c6"} Jul 10 12:46:17.352267 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:17.351446 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-152.ec2.internal" podStartSLOduration=3.351392262 podStartE2EDuration="3.351392262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:17.310738766 +0000 UTC m=+4.541849197" watchObservedRunningTime="2026-07-10 12:46:17.351392262 +0000 UTC m=+4.582502699" Jul 10 12:46:18.353460 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:18.353428 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" event={"ID":"63989a6b5c873d17c684e53f01f88621","Type":"ContainerStarted","Data":"277dabc6598070c8038c9abecc7482252cefc286332b6713221180f5d5239d18"} Jul 10 12:46:18.765217 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:18.764613 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:18.765217 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:18.764764 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:18.765217 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:18.764820 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret podName:2b18e6b0-54a0-4f26-a217-e58f61c6d45c nodeName:}" failed. No retries permitted until 2026-07-10 12:46:22.764801936 +0000 UTC m=+9.995912352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret") pod "global-pull-secret-syncer-thrnw" (UID: "2b18e6b0-54a0-4f26-a217-e58f61c6d45c") : object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:18.865294 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:18.865263 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:18.865492 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:18.865324 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwj7z\" (UniqueName: \"kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z\") pod \"network-check-target-kg958\" (UID: \"4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e\") " pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:18.865560 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:18.865490 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 12:46:18.865560 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:18.865511 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 12:46:18.865560 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:18.865522 2557 projected.go:196] Error preparing data for projected volume kube-api-access-vwj7z for pod openshift-network-diagnostics/network-check-target-kg958: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:18.865560 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:18.865549 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:18.865741 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:18.865575 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z podName:4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e nodeName:}" failed. No retries permitted until 2026-07-10 12:46:22.865557611 +0000 UTC m=+10.096668036 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwj7z" (UniqueName: "kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z") pod "network-check-target-kg958" (UID: "4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:18.865741 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:18.865608 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs podName:c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b nodeName:}" failed. No retries permitted until 2026-07-10 12:46:22.865591626 +0000 UTC m=+10.096702038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs") pod "network-metrics-daemon-rtskf" (UID: "c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:19.262545 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:19.262467 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:19.262736 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:19.262590 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:19.262995 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:19.262974 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:19.263101 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:19.263077 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:19.264908 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:19.264888 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:19.264992 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:19.264977 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:21.261656 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:21.261416 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:21.261656 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:21.261452 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:21.261656 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:21.261416 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:21.261656 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:21.261560 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:21.261656 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:21.261629 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:21.262302 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:21.261700 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:22.798590 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:22.798552 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:22.799074 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:22.798712 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:22.799074 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:22.798779 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret podName:2b18e6b0-54a0-4f26-a217-e58f61c6d45c nodeName:}" failed. No retries permitted until 2026-07-10 12:46:30.798759145 +0000 UTC m=+18.029869570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret") pod "global-pull-secret-syncer-thrnw" (UID: "2b18e6b0-54a0-4f26-a217-e58f61c6d45c") : object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:22.899395 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:22.899342 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:22.899573 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:22.899525 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:22.899642 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:22.899602 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs podName:c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b nodeName:}" failed. No retries permitted until 2026-07-10 12:46:30.899580523 +0000 UTC m=+18.130690958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs") pod "network-metrics-daemon-rtskf" (UID: "c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:22.899707 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:22.899647 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwj7z\" (UniqueName: \"kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z\") pod \"network-check-target-kg958\" (UID: \"4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e\") " pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:22.899900 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:22.899795 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 12:46:22.899900 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:22.899818 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 12:46:22.899900 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:22.899833 2557 projected.go:196] Error preparing data for projected volume kube-api-access-vwj7z for pod openshift-network-diagnostics/network-check-target-kg958: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:22.899900 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:22.899871 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z podName:4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e nodeName:}" failed. No retries permitted until 2026-07-10 12:46:30.899858256 +0000 UTC m=+18.130968681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwj7z" (UniqueName: "kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z") pod "network-check-target-kg958" (UID: "4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:23.262235 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:23.262155 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:23.262412 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:23.262289 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:23.262613 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:23.262584 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:23.262695 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:23.262687 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:23.262755 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:23.262693 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:23.262809 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:23.262752 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:25.262063 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:25.261999 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:25.262598 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:25.261995 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:25.262598 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:25.261996 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:25.262598 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:25.262212 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:25.262598 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:25.262310 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:25.262598 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:25.262431 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:27.261913 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:27.261882 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:27.262358 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:27.261919 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:27.262358 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:27.261885 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:27.262358 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:27.262015 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:27.262358 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:27.262090 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:27.262358 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:27.262154 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:29.261650 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:29.261621 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:29.262092 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:29.261630 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:29.262092 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:29.261729 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:29.262092 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:29.261745 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:29.262092 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:29.261804 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:29.262092 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:29.261866 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:30.857856 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:30.857819 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:30.858291 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:30.857979 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:30.858291 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:30.858041 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret podName:2b18e6b0-54a0-4f26-a217-e58f61c6d45c nodeName:}" failed. No retries permitted until 2026-07-10 12:46:46.858027216 +0000 UTC m=+34.089137628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret") pod "global-pull-secret-syncer-thrnw" (UID: "2b18e6b0-54a0-4f26-a217-e58f61c6d45c") : object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:30.958176 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:30.958139 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:30.958280 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:30.958195 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwj7z\" (UniqueName: \"kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z\") pod \"network-check-target-kg958\" (UID: \"4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e\") " pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:30.958340 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:30.958313 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 12:46:30.958340 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:30.958318 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:30.958460 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:30.958416 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs podName:c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b nodeName:}" failed. No retries permitted until 2026-07-10 12:46:46.958394958 +0000 UTC m=+34.189505383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs") pod "network-metrics-daemon-rtskf" (UID: "c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:30.958460 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:30.958326 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 12:46:30.958460 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:30.958437 2557 projected.go:196] Error preparing data for projected volume kube-api-access-vwj7z for pod openshift-network-diagnostics/network-check-target-kg958: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:30.958611 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:30.958478 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z podName:4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e nodeName:}" failed. No retries permitted until 2026-07-10 12:46:46.958468151 +0000 UTC m=+34.189578561 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwj7z" (UniqueName: "kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z") pod "network-check-target-kg958" (UID: "4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:31.261066 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:31.261028 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:31.261256 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:31.261160 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:31.261256 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:31.261176 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:31.261405 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:31.261270 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:31.261405 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:31.261277 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:31.261506 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:31.261407 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:33.262455 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:33.262420 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:33.262915 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:33.262535 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:33.262915 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:33.262551 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:33.262915 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:33.262654 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:33.262915 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:33.262684 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:33.262915 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:33.262751 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:35.263191 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.262929 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:35.263710 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:35.263399 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:35.263710 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.263058 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:35.263710 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:35.263570 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:35.263710 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.262929 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:35.263900 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:35.263799 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:35.391531 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.391216 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" event={"ID":"01a94845-a8c9-4a5a-9bfe-1e7f800681b4","Type":"ContainerStarted","Data":"565207afebfaafe87089a560ff18bd73e92b3dd20efc035d9c18f090f3a8949c"} Jul 10 12:46:35.391531 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.391519 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" event={"ID":"01a94845-a8c9-4a5a-9bfe-1e7f800681b4","Type":"ContainerStarted","Data":"1ee7d92ffd872408c1429e27e51297c2366602e9f59c18080e0a5c732fd0ac46"} Jul 10 12:46:35.393009 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.392975 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xbzrz" event={"ID":"25c28891-e02d-475f-a145-486db0b0e335","Type":"ContainerStarted","Data":"3765b439dbcc761e44389ef5c4651f248ba16b0be7dc8fdf333d85f0805212ae"} Jul 10 12:46:35.394641 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.394611 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" event={"ID":"9888afc1-7cf8-4c64-899b-b6bbdd4c382b","Type":"ContainerStarted","Data":"de9c5140908de21c8f3a73ae412f94ef04095755aea1183bcb201d0162d5208d"} Jul 10 12:46:35.396094 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.396070 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v78dm" event={"ID":"32444ef9-93e0-4ddc-9645-5d32a3548eee","Type":"ContainerStarted","Data":"ba7aa40dcffd1f811ec6e3b35764b325e20e1b3bae73e7ce67fcc422593bca33"} Jul 10 12:46:35.397877 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.397843 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" event={"ID":"0520f514-4726-4414-a558-5d6cbf839698","Type":"ContainerStarted","Data":"d275310e0103c96485354375c9f263a1fa19ebcf15d18ccb91a9236e62b1adc1"} Jul 10 12:46:35.399821 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.399729 2557 generic.go:356] "Generic (PLEG): container finished" podID="f52d9bdf-1792-4e26-8b37-c2913530a624" containerID="00a3f332cb3cc1b86c707d63628ec3abaec583b35a4105afd421e9ee893df7bd" exitCode=0 Jul 10 12:46:35.399821 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.399807 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh7hv" event={"ID":"f52d9bdf-1792-4e26-8b37-c2913530a624","Type":"ContainerDied","Data":"00a3f332cb3cc1b86c707d63628ec3abaec583b35a4105afd421e9ee893df7bd"} Jul 10 12:46:35.401436 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.401411 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7b9x4" event={"ID":"c33427ab-8871-428e-8eab-5d11cd0f2c65","Type":"ContainerStarted","Data":"d915521dd2ca82dabcc5990fe5f7ec93a5fcbf8a7814e5ba7cb537d9c4dec107"} Jul 10 12:46:35.402800 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.402749 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zd5ws" event={"ID":"cdb963f2-e593-4dca-ba8b-807e88492383","Type":"ContainerStarted","Data":"0835e174e4ac2e28473c633bedd325795b03bf16d0cc489b8f337dacdc0e283a"} Jul 10 12:46:35.406865 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.406827 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-152.ec2.internal" podStartSLOduration=21.406816463 podStartE2EDuration="21.406816463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:18.371316944 +0000 UTC m=+5.602427378" watchObservedRunningTime="2026-07-10 12:46:35.406816463 +0000 UTC m=+22.637926895" Jul 10 12:46:35.407366 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.407313 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xbzrz" podStartSLOduration=4.069054596 podStartE2EDuration="22.407304189s" totalImagesPullingTime="18.338249593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:35.406547755 +0000 UTC m=+22.637658189" watchObservedRunningTime="2026-07-10 12:46:35.407304189 +0000 UTC m=+22.638414622" Jul 10 12:46:35.420880 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.420827 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zd5ws" podStartSLOduration=4.033187752 podStartE2EDuration="22.42081383s" totalImagesPullingTime="18.387626078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:35.420304339 +0000 UTC m=+22.651414773" watchObservedRunningTime="2026-07-10 12:46:35.42081383 +0000 UTC m=+22.651924262" Jul 10 12:46:35.435327 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.435279 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v78dm" podStartSLOduration=4.014705623 podStartE2EDuration="22.43526491s" totalImagesPullingTime="18.420559287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:35.434704143 +0000 UTC m=+22.665814576" watchObservedRunningTime="2026-07-10 12:46:35.43526491 +0000 UTC m=+22.666375342" Jul 10 12:46:35.456222 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.456179 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7b9x4" podStartSLOduration=2.641803619 podStartE2EDuration="22.456163041s" totalImagesPullingTime="19.814359422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:35.455638811 +0000 UTC m=+22.686749246" watchObservedRunningTime="2026-07-10 12:46:35.456163041 +0000 UTC m=+22.687273474" Jul 10 12:46:35.493724 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:35.493682 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r8qxk" podStartSLOduration=4.072667034 podStartE2EDuration="22.49366543s" totalImagesPullingTime="18.420998396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:35.493379928 +0000 UTC m=+22.724490361" watchObservedRunningTime="2026-07-10 12:46:35.49366543 +0000 UTC m=+22.724775862" Jul 10 12:46:36.406368 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:36.406314 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6jqcl" event={"ID":"c99a6b22-f975-4aed-8a4a-650d1eb2b36b","Type":"ContainerStarted","Data":"082f004a8ed7bc6e73d491d6b19a66637cc38036f71deb47dcc378392aec0594"} Jul 10 12:46:36.409951 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:36.409916 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" event={"ID":"01a94845-a8c9-4a5a-9bfe-1e7f800681b4","Type":"ContainerStarted","Data":"0a0ba9c535abe8d28ecec360fa78d6d1b32df297582456b1c74c2fe642b88362"} Jul 10 12:46:36.410087 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:36.409999 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" event={"ID":"01a94845-a8c9-4a5a-9bfe-1e7f800681b4","Type":"ContainerStarted","Data":"fa49f89c7ed6bfc845e00b12c114b720fc970b83994343420b22c5e44d753346"} Jul 10 12:46:36.410087 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:36.410047 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" event={"ID":"01a94845-a8c9-4a5a-9bfe-1e7f800681b4","Type":"ContainerStarted","Data":"0916ec4279c938cb439cceec92b99ebcb1a571671e74a82a47a9e8863fd82b18"} Jul 10 12:46:36.410196 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:36.410093 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" event={"ID":"01a94845-a8c9-4a5a-9bfe-1e7f800681b4","Type":"ContainerStarted","Data":"8f2a2ea7ca2d319e2157b1687d1f2ad867e92a536bc26991f3fb852cc9bb4d60"} Jul 10 12:46:36.422487 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:36.422439 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6jqcl" podStartSLOduration=5.034710972 podStartE2EDuration="23.422425807s" totalImagesPullingTime="18.387714835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:36.421944845 +0000 UTC m=+23.653055279" watchObservedRunningTime="2026-07-10 12:46:36.422425807 +0000 UTC m=+23.653536239" Jul 10 12:46:36.587883 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:36.587844 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 12:46:37.199045 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:37.198933 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T12:46:36.587866256Z","UUID":"8fe58b98-5333-4536-8953-a3809d4798cf","Handler":null,"Name":"","Endpoint":""} Jul 10 12:46:37.200536 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:37.200509 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 12:46:37.200644 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:37.200546 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 12:46:37.261762 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:37.261725 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:37.261939 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:37.261834 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:37.261939 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:37.261855 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:37.262011 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:37.261726 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:37.262042 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:37.261937 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:37.262076 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:37.262055 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:37.414364 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:37.414307 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" event={"ID":"9888afc1-7cf8-4c64-899b-b6bbdd4c382b","Type":"ContainerStarted","Data":"dc8063c12f6ea0c6ade8432b0e073269fb74d3cc25b5e0d4aec0217a9c68fa98"} Jul 10 12:46:38.422991 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:38.422721 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" event={"ID":"01a94845-a8c9-4a5a-9bfe-1e7f800681b4","Type":"ContainerStarted","Data":"f5e7a03f71a2ec553c29796fa9fcc5d6a92e1b6ca498890ba83a1e8945c33264"} Jul 10 12:46:38.424954 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:38.424929 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" event={"ID":"9888afc1-7cf8-4c64-899b-b6bbdd4c382b","Type":"ContainerStarted","Data":"1a4518ad357ae8c87091f9d5ac8b3b15a22ab38425549605888d77f8c75c4610"} Jul 10 12:46:38.441949 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:38.441909 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j44r" podStartSLOduration=3.694155379 podStartE2EDuration="25.441894693s" totalImagesPullingTime="21.747739314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:38.441419526 +0000 UTC m=+25.672529959" watchObservedRunningTime="2026-07-10 12:46:38.441894693 +0000 UTC m=+25.673005126" Jul 10 12:46:39.165864 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:39.165823 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zd5ws" Jul 10 12:46:39.166524 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:39.166505 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zd5ws" Jul 10 12:46:39.261335 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:39.261290 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:39.261537 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:39.261290 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:39.261537 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:39.261410 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:39.261537 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:39.261425 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:39.261537 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:39.261516 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:39.261750 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:39.261574 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:39.427611 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:39.427525 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zd5ws" Jul 10 12:46:39.428137 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:39.427875 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zd5ws" Jul 10 12:46:41.261722 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:41.261547 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:41.262254 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:41.261593 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:41.262254 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:41.261803 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:41.262254 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:41.261897 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:41.262254 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:41.261614 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:41.262254 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:41.261999 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:41.434846 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:41.434765 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" event={"ID":"01a94845-a8c9-4a5a-9bfe-1e7f800681b4","Type":"ContainerStarted","Data":"1aa4af65df1952325da7e2f13b62be7ea1f089f89451bc24b9b0ed945d606d03"} Jul 10 12:46:41.435009 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:41.434989 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:41.439929 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:41.439897 2557 generic.go:356] "Generic (PLEG): container finished" podID="f52d9bdf-1792-4e26-8b37-c2913530a624" containerID="9868fc778c7c98691e0a3e8413762daae0ac1a630de59f4c2ecbb8fc96854b25" exitCode=0 Jul 10 12:46:41.440086 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:41.439962 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh7hv" event={"ID":"f52d9bdf-1792-4e26-8b37-c2913530a624","Type":"ContainerDied","Data":"9868fc778c7c98691e0a3e8413762daae0ac1a630de59f4c2ecbb8fc96854b25"} Jul 10 12:46:41.451519 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:41.451496 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:41.465077 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:41.465026 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" podStartSLOduration=10.03297087 podStartE2EDuration="28.465014148s" totalImagesPullingTime="18.432043278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:41.464597004 +0000 UTC m=+28.695707436" watchObservedRunningTime="2026-07-10 12:46:41.465014148 +0000 UTC m=+28.696124581" Jul 10 12:46:42.442762 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:42.442726 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:42.443308 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:42.442823 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:42.457964 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:42.457936 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:46:43.109886 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:43.109816 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-thrnw"] Jul 10 12:46:43.110018 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:43.109932 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:43.110057 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:43.110018 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:43.116181 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:43.115036 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rtskf"] Jul 10 12:46:43.116181 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:43.115152 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kg958"] Jul 10 12:46:43.116181 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:43.115258 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:43.116181 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:43.115399 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:43.116181 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:43.115503 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:43.116181 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:43.115667 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:43.446187 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:43.445935 2557 generic.go:356] "Generic (PLEG): container finished" podID="f52d9bdf-1792-4e26-8b37-c2913530a624" containerID="8ba34bca296d9d3012684430c8d42f0f2f3aa2b6c915003ee6d71286ff349234" exitCode=0 Jul 10 12:46:43.446187 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:43.446026 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh7hv" event={"ID":"f52d9bdf-1792-4e26-8b37-c2913530a624","Type":"ContainerDied","Data":"8ba34bca296d9d3012684430c8d42f0f2f3aa2b6c915003ee6d71286ff349234"} Jul 10 12:46:44.261341 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:44.261307 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:44.261497 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:44.261475 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:45.261607 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:45.261501 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:45.261607 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:45.261554 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:45.262319 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:45.261654 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:45.262319 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:45.261757 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:45.453376 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:45.453331 2557 generic.go:356] "Generic (PLEG): container finished" podID="f52d9bdf-1792-4e26-8b37-c2913530a624" containerID="cdf0d03facce70f3d5b29c1977394b622a1454e2678c51e3f80de3666ec1bb3a" exitCode=0 Jul 10 12:46:45.453501 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:45.453389 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh7hv" event={"ID":"f52d9bdf-1792-4e26-8b37-c2913530a624","Type":"ContainerDied","Data":"cdf0d03facce70f3d5b29c1977394b622a1454e2678c51e3f80de3666ec1bb3a"} Jul 10 12:46:46.261865 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:46.261832 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:46.262245 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:46.261934 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:46.877626 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:46.877592 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:46.877796 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:46.877740 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:46.877849 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:46.877804 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret podName:2b18e6b0-54a0-4f26-a217-e58f61c6d45c nodeName:}" failed. No retries permitted until 2026-07-10 12:47:18.877788338 +0000 UTC m=+66.108898749 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret") pod "global-pull-secret-syncer-thrnw" (UID: "2b18e6b0-54a0-4f26-a217-e58f61c6d45c") : object "kube-system"/"original-pull-secret" not registered Jul 10 12:46:46.978186 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:46.978148 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:46.978373 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:46.978212 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwj7z\" (UniqueName: \"kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z\") pod \"network-check-target-kg958\" (UID: \"4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e\") " pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:46.978373 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:46.978327 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:46.978373 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:46.978338 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 12:46:46.978373 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:46.978373 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 12:46:46.978518 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:46.978385 2557 projected.go:196] Error preparing data for projected volume kube-api-access-vwj7z for pod openshift-network-diagnostics/network-check-target-kg958: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:46.978518 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:46.978410 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs podName:c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b nodeName:}" failed. No retries permitted until 2026-07-10 12:47:18.97839702 +0000 UTC m=+66.209507436 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs") pod "network-metrics-daemon-rtskf" (UID: "c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 12:46:46.978518 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:46.978427 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z podName:4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e nodeName:}" failed. No retries permitted until 2026-07-10 12:47:18.978419694 +0000 UTC m=+66.209530109 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vwj7z" (UniqueName: "kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z") pod "network-check-target-kg958" (UID: "4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 12:46:47.261682 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:47.261635 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:47.261682 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:47.261659 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:47.261914 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:47.261769 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kg958" podUID="4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e" Jul 10 12:46:47.262256 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:47.261907 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtskf" podUID="c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b" Jul 10 12:46:48.261514 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:48.261484 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:48.261694 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:48.261603 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thrnw" podUID="2b18e6b0-54a0-4f26-a217-e58f61c6d45c" Jul 10 12:46:49.066361 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.066326 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-152.ec2.internal" event="NodeReady" Jul 10 12:46:49.066893 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.066498 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 12:46:49.112557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.112527 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rqc9p"] Jul 10 12:46:49.135326 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.135294 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wg7m4"] Jul 10 12:46:49.135511 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.135420 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.138634 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.138607 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 12:46:49.138634 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.138629 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qfssw\"" Jul 10 12:46:49.138822 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.138644 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 12:46:49.149272 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.149248 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rqc9p"] Jul 10 12:46:49.149385 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.149287 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wg7m4"] Jul 10 12:46:49.149434 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.149388 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wg7m4" Jul 10 12:46:49.152222 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.152111 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 12:46:49.152333 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.152290 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 12:46:49.152333 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.152297 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 12:46:49.152513 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.152493 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8vh7j\"" Jul 10 12:46:49.261524 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.261491 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:46:49.261711 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.261535 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:46:49.265752 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.265727 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-99bwq\"" Jul 10 12:46:49.265896 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.265848 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 12:46:49.265896 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.265865 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pmvx9\"" Jul 10 12:46:49.266011 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.265903 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 12:46:49.266011 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.265988 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 12:46:49.295292 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.295260 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4e5935e-a766-4c5e-8bb2-5b12c48ade14-cert\") pod \"ingress-canary-wg7m4\" (UID: \"a4e5935e-a766-4c5e-8bb2-5b12c48ade14\") " pod="openshift-ingress-canary/ingress-canary-wg7m4" Jul 10 12:46:49.295448 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.295300 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4ldn\" (UniqueName: \"kubernetes.io/projected/a4e5935e-a766-4c5e-8bb2-5b12c48ade14-kube-api-access-l4ldn\") pod \"ingress-canary-wg7m4\" (UID: \"a4e5935e-a766-4c5e-8bb2-5b12c48ade14\") " pod="openshift-ingress-canary/ingress-canary-wg7m4" Jul 10 12:46:49.295448 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.295364 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b42f5712-357f-483a-b744-c9d36cbb99ca-config-volume\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.295448 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.295421 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b42f5712-357f-483a-b744-c9d36cbb99ca-tmp-dir\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.295575 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.295451 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85r76\" (UniqueName: \"kubernetes.io/projected/b42f5712-357f-483a-b744-c9d36cbb99ca-kube-api-access-85r76\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.295575 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.295500 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.396728 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.396642 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4e5935e-a766-4c5e-8bb2-5b12c48ade14-cert\") pod \"ingress-canary-wg7m4\" (UID: \"a4e5935e-a766-4c5e-8bb2-5b12c48ade14\") " pod="openshift-ingress-canary/ingress-canary-wg7m4" Jul 10 12:46:49.396728 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.396690 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4ldn\" (UniqueName: \"kubernetes.io/projected/a4e5935e-a766-4c5e-8bb2-5b12c48ade14-kube-api-access-l4ldn\") pod \"ingress-canary-wg7m4\" (UID: \"a4e5935e-a766-4c5e-8bb2-5b12c48ade14\") " pod="openshift-ingress-canary/ingress-canary-wg7m4" Jul 10 12:46:49.396941 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.396759 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b42f5712-357f-483a-b744-c9d36cbb99ca-config-volume\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.396941 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.396785 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b42f5712-357f-483a-b744-c9d36cbb99ca-tmp-dir\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.396941 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.396809 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85r76\" (UniqueName: \"kubernetes.io/projected/b42f5712-357f-483a-b744-c9d36cbb99ca-kube-api-access-85r76\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.397057 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.397025 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.397162 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.397146 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b42f5712-357f-483a-b744-c9d36cbb99ca-tmp-dir\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.397197 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:49.397162 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 12:46:49.397236 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:49.397225 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls podName:b42f5712-357f-483a-b744-c9d36cbb99ca nodeName:}" failed. No retries permitted until 2026-07-10 12:46:49.897211317 +0000 UTC m=+37.128321731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls") pod "dns-default-rqc9p" (UID: "b42f5712-357f-483a-b744-c9d36cbb99ca") : secret "dns-default-metrics-tls" not found Jul 10 12:46:49.397467 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.397445 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b42f5712-357f-483a-b744-c9d36cbb99ca-config-volume\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.407726 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.407700 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85r76\" (UniqueName: \"kubernetes.io/projected/b42f5712-357f-483a-b744-c9d36cbb99ca-kube-api-access-85r76\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.409743 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.409724 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4e5935e-a766-4c5e-8bb2-5b12c48ade14-cert\") pod \"ingress-canary-wg7m4\" (UID: \"a4e5935e-a766-4c5e-8bb2-5b12c48ade14\") " pod="openshift-ingress-canary/ingress-canary-wg7m4" Jul 10 12:46:49.410048 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.410021 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4ldn\" (UniqueName: \"kubernetes.io/projected/a4e5935e-a766-4c5e-8bb2-5b12c48ade14-kube-api-access-l4ldn\") pod \"ingress-canary-wg7m4\" (UID: \"a4e5935e-a766-4c5e-8bb2-5b12c48ade14\") " pod="openshift-ingress-canary/ingress-canary-wg7m4" Jul 10 12:46:49.459011 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.458975 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wg7m4" Jul 10 12:46:49.901463 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:49.901180 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:49.901632 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:49.901371 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 12:46:49.901632 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:49.901613 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls podName:b42f5712-357f-483a-b744-c9d36cbb99ca nodeName:}" failed. No retries permitted until 2026-07-10 12:46:50.901593358 +0000 UTC m=+38.132703793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls") pod "dns-default-rqc9p" (UID: "b42f5712-357f-483a-b744-c9d36cbb99ca") : secret "dns-default-metrics-tls" not found Jul 10 12:46:50.261985 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:50.261946 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:46:50.264860 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:50.264833 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 12:46:50.580377 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:50.580329 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wg7m4"] Jul 10 12:46:50.629888 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:50.629852 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e5935e_a766_4c5e_8bb2_5b12c48ade14.slice/crio-811924d7d0bb8c08716396010eda0d5209772e547540b99414d019e2d8277e47 WatchSource:0}: Error finding container 811924d7d0bb8c08716396010eda0d5209772e547540b99414d019e2d8277e47: Status 404 returned error can't find the container with id 811924d7d0bb8c08716396010eda0d5209772e547540b99414d019e2d8277e47 Jul 10 12:46:50.909697 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:50.909664 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:50.909854 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:50.909832 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 12:46:50.909925 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:50.909915 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls podName:b42f5712-357f-483a-b744-c9d36cbb99ca nodeName:}" failed. No retries permitted until 2026-07-10 12:46:52.909893034 +0000 UTC m=+40.141003467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls") pod "dns-default-rqc9p" (UID: "b42f5712-357f-483a-b744-c9d36cbb99ca") : secret "dns-default-metrics-tls" not found Jul 10 12:46:51.470988 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:51.470958 2557 generic.go:356] "Generic (PLEG): container finished" podID="f52d9bdf-1792-4e26-8b37-c2913530a624" containerID="1de50065f26e27d8c4897095e4a9ddefa3403f36620f6407a4066bbe02b2b3ba" exitCode=0 Jul 10 12:46:51.471477 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:51.471039 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh7hv" event={"ID":"f52d9bdf-1792-4e26-8b37-c2913530a624","Type":"ContainerDied","Data":"1de50065f26e27d8c4897095e4a9ddefa3403f36620f6407a4066bbe02b2b3ba"} Jul 10 12:46:51.472577 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:51.472555 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wg7m4" event={"ID":"a4e5935e-a766-4c5e-8bb2-5b12c48ade14","Type":"ContainerStarted","Data":"811924d7d0bb8c08716396010eda0d5209772e547540b99414d019e2d8277e47"} Jul 10 12:46:52.479287 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:52.479079 2557 generic.go:356] "Generic (PLEG): container finished" podID="f52d9bdf-1792-4e26-8b37-c2913530a624" containerID="d136674973a481879efba40006c7651cee5c6288f92102bbfa360d97dded7257" exitCode=0 Jul 10 12:46:52.479287 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:52.479159 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh7hv" event={"ID":"f52d9bdf-1792-4e26-8b37-c2913530a624","Type":"ContainerDied","Data":"d136674973a481879efba40006c7651cee5c6288f92102bbfa360d97dded7257"} Jul 10 12:46:52.927886 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:52.927846 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:52.928166 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:52.928019 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 12:46:52.928166 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:52.928100 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls podName:b42f5712-357f-483a-b744-c9d36cbb99ca nodeName:}" failed. No retries permitted until 2026-07-10 12:46:56.928077202 +0000 UTC m=+44.159187634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls") pod "dns-default-rqc9p" (UID: "b42f5712-357f-483a-b744-c9d36cbb99ca") : secret "dns-default-metrics-tls" not found Jul 10 12:46:53.484475 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:53.484442 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lh7hv" event={"ID":"f52d9bdf-1792-4e26-8b37-c2913530a624","Type":"ContainerStarted","Data":"ec40017dcc02a70346d603e3c7bd1eecc953b22c9cb9b9bee5a2d4bf2cf0e5da"} Jul 10 12:46:53.508420 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:53.508376 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lh7hv" podStartSLOduration=7.955300589 podStartE2EDuration="40.508336301s" totalImagesPullingTime="32.553035712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:53.507152534 +0000 UTC m=+40.738262966" watchObservedRunningTime="2026-07-10 12:46:53.508336301 +0000 UTC m=+40.739446733" Jul 10 12:46:54.488029 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:54.487987 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wg7m4" event={"ID":"a4e5935e-a766-4c5e-8bb2-5b12c48ade14","Type":"ContainerStarted","Data":"781ad4c14fba5e99dcba82389628251f1b1256f2f91011b03e04f72e117a7660"} Jul 10 12:46:54.504122 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:54.504065 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wg7m4" podStartSLOduration=2.71809479 podStartE2EDuration="5.50405027s" totalImagesPullingTime="2.78595548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:54.503393277 +0000 UTC m=+41.734503711" watchObservedRunningTime="2026-07-10 12:46:54.50405027 +0000 UTC m=+41.735160758" Jul 10 12:46:55.249623 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.249590 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-bb72g"] Jul 10 12:46:55.266808 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.266761 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-bb72g"] Jul 10 12:46:55.266963 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.266888 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.269677 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.269658 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 12:46:55.269802 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.269657 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 10 12:46:55.270662 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.270643 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 12:46:55.270764 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.270677 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 10 12:46:55.270764 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.270682 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8f6vz\"" Jul 10 12:46:55.275307 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.275287 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 10 12:46:55.345213 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.345174 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df1de48b-6ecb-477b-8313-2d7070554708-tmp\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.345428 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.345228 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df1de48b-6ecb-477b-8313-2d7070554708-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.345428 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.345247 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df1de48b-6ecb-477b-8313-2d7070554708-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.345428 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.345389 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5xvr\" (UniqueName: \"kubernetes.io/projected/df1de48b-6ecb-477b-8313-2d7070554708-kube-api-access-b5xvr\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.345593 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.345428 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/df1de48b-6ecb-477b-8313-2d7070554708-snapshots\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.345593 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.345468 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df1de48b-6ecb-477b-8313-2d7070554708-serving-cert\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.446606 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.446571 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5xvr\" (UniqueName: \"kubernetes.io/projected/df1de48b-6ecb-477b-8313-2d7070554708-kube-api-access-b5xvr\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.446606 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.446610 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/df1de48b-6ecb-477b-8313-2d7070554708-snapshots\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.446727 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.446634 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df1de48b-6ecb-477b-8313-2d7070554708-serving-cert\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.446727 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.446681 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df1de48b-6ecb-477b-8313-2d7070554708-tmp\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.446727 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.446706 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df1de48b-6ecb-477b-8313-2d7070554708-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.446867 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.446725 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df1de48b-6ecb-477b-8313-2d7070554708-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.447235 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.447201 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/df1de48b-6ecb-477b-8313-2d7070554708-snapshots\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.447235 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.447216 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df1de48b-6ecb-477b-8313-2d7070554708-tmp\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.447405 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.447290 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df1de48b-6ecb-477b-8313-2d7070554708-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.447621 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.447602 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df1de48b-6ecb-477b-8313-2d7070554708-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.450605 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.450576 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df1de48b-6ecb-477b-8313-2d7070554708-serving-cert\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.455375 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.455336 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5xvr\" (UniqueName: \"kubernetes.io/projected/df1de48b-6ecb-477b-8313-2d7070554708-kube-api-access-b5xvr\") pod \"insights-operator-68d9dd94cf-bb72g\" (UID: \"df1de48b-6ecb-477b-8313-2d7070554708\") " pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.575944 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.575857 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" Jul 10 12:46:55.726284 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:55.726249 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-bb72g"] Jul 10 12:46:55.729784 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:46:55.729751 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1de48b_6ecb_477b_8313_2d7070554708.slice/crio-6b49dc09898b88d4d31377a663c86f294d36930d284f30c0f0bc054a377e30eb WatchSource:0}: Error finding container 6b49dc09898b88d4d31377a663c86f294d36930d284f30c0f0bc054a377e30eb: Status 404 returned error can't find the container with id 6b49dc09898b88d4d31377a663c86f294d36930d284f30c0f0bc054a377e30eb Jul 10 12:46:56.493565 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:56.493531 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" event={"ID":"df1de48b-6ecb-477b-8313-2d7070554708","Type":"ContainerStarted","Data":"6b49dc09898b88d4d31377a663c86f294d36930d284f30c0f0bc054a377e30eb"} Jul 10 12:46:56.956396 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:56.956291 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:46:56.956747 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:56.956446 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 12:46:56.956747 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:56.956509 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls podName:b42f5712-357f-483a-b744-c9d36cbb99ca nodeName:}" failed. No retries permitted until 2026-07-10 12:47:04.956492323 +0000 UTC m=+52.187602749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls") pod "dns-default-rqc9p" (UID: "b42f5712-357f-483a-b744-c9d36cbb99ca") : secret "dns-default-metrics-tls" not found Jul 10 12:46:58.499935 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:58.499851 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" event={"ID":"df1de48b-6ecb-477b-8313-2d7070554708","Type":"ContainerStarted","Data":"45701e55897707e93b5b997d49185ea114921760783afba75b8e6c8360d7a1f2"} Jul 10 12:46:59.596869 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.596817 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" podStartSLOduration=2.110858773 podStartE2EDuration="4.596797209s" totalImagesPullingTime="2.485938436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:58.519944781 +0000 UTC m=+45.751055209" watchObservedRunningTime="2026-07-10 12:46:59.596797209 +0000 UTC m=+46.827907650" Jul 10 12:46:59.597244 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.596944 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x2pqg"] Jul 10 12:46:59.612171 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.612137 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x2pqg"] Jul 10 12:46:59.612317 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.612251 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.614810 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.614786 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 12:46:59.614953 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.614786 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 12:46:59.614953 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.614822 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cc7d5\"" Jul 10 12:46:59.776458 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.776421 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/047aeb6b-0106-4f1a-a49b-3affb6e3401b-data-volume\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.776634 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.776470 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/047aeb6b-0106-4f1a-a49b-3affb6e3401b-crio-socket\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.776634 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.776531 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvc28\" (UniqueName: \"kubernetes.io/projected/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-api-access-xvc28\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.776634 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.776558 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.776737 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.776655 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.876982 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.876906 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/047aeb6b-0106-4f1a-a49b-3affb6e3401b-crio-socket\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.876982 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.876953 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvc28\" (UniqueName: \"kubernetes.io/projected/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-api-access-xvc28\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.877130 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.876987 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.877130 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.877040 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.877130 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.877083 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/047aeb6b-0106-4f1a-a49b-3affb6e3401b-data-volume\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.877219 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:59.877149 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 12:46:59.877219 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:59.877161 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 12:46:59.877219 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.877161 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/047aeb6b-0106-4f1a-a49b-3affb6e3401b-crio-socket\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.877305 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:59.877220 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm podName:047aeb6b-0106-4f1a-a49b-3affb6e3401b nodeName:}" failed. No retries permitted until 2026-07-10 12:47:00.377203549 +0000 UTC m=+47.608313990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2pqg" (UID: "047aeb6b-0106-4f1a-a49b-3affb6e3401b") : configmap "kube-rbac-proxy" not found Jul 10 12:46:59.877305 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:46:59.877237 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls podName:047aeb6b-0106-4f1a-a49b-3affb6e3401b nodeName:}" failed. No retries permitted until 2026-07-10 12:47:00.37723062 +0000 UTC m=+47.608341031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2pqg" (UID: "047aeb6b-0106-4f1a-a49b-3affb6e3401b") : secret "insights-runtime-extractor-tls" not found Jul 10 12:46:59.877474 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.877458 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/047aeb6b-0106-4f1a-a49b-3affb6e3401b-data-volume\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:46:59.886074 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:46:59.886043 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvc28\" (UniqueName: \"kubernetes.io/projected/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-api-access-xvc28\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:00.381672 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:00.381635 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:00.381856 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:00.381707 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:00.381856 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:00.381774 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 12:47:00.381856 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:00.381804 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 12:47:00.381856 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:00.381858 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm podName:047aeb6b-0106-4f1a-a49b-3affb6e3401b nodeName:}" failed. No retries permitted until 2026-07-10 12:47:01.381838539 +0000 UTC m=+48.612948964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2pqg" (UID: "047aeb6b-0106-4f1a-a49b-3affb6e3401b") : configmap "kube-rbac-proxy" not found Jul 10 12:47:00.382022 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:00.381876 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls podName:047aeb6b-0106-4f1a-a49b-3affb6e3401b nodeName:}" failed. No retries permitted until 2026-07-10 12:47:01.381867443 +0000 UTC m=+48.612977855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2pqg" (UID: "047aeb6b-0106-4f1a-a49b-3affb6e3401b") : secret "insights-runtime-extractor-tls" not found Jul 10 12:47:01.389164 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:01.389132 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:01.389581 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:01.389213 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:01.389581 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:01.389262 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 12:47:01.389581 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:01.389321 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 12:47:01.389581 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:01.389329 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm podName:047aeb6b-0106-4f1a-a49b-3affb6e3401b nodeName:}" failed. No retries permitted until 2026-07-10 12:47:03.389312934 +0000 UTC m=+50.620423345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2pqg" (UID: "047aeb6b-0106-4f1a-a49b-3affb6e3401b") : configmap "kube-rbac-proxy" not found Jul 10 12:47:01.389581 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:01.389392 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls podName:047aeb6b-0106-4f1a-a49b-3affb6e3401b nodeName:}" failed. No retries permitted until 2026-07-10 12:47:03.38937524 +0000 UTC m=+50.620485653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2pqg" (UID: "047aeb6b-0106-4f1a-a49b-3affb6e3401b") : secret "insights-runtime-extractor-tls" not found Jul 10 12:47:01.764835 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:01.764811 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v78dm_32444ef9-93e0-4ddc-9645-5d32a3548eee/dns-node-resolver/0.log" Jul 10 12:47:02.564508 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:02.564481 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xbzrz_25c28891-e02d-475f-a145-486db0b0e335/node-ca/0.log" Jul 10 12:47:03.364616 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:03.364572 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wg7m4_a4e5935e-a766-4c5e-8bb2-5b12c48ade14/serve-healthcheck-canary/0.log" Jul 10 12:47:03.404188 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:03.404149 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:03.404376 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:03.404215 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:03.404376 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:03.404323 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 12:47:03.404376 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:03.404326 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 12:47:03.404526 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:03.404399 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm podName:047aeb6b-0106-4f1a-a49b-3affb6e3401b nodeName:}" failed. No retries permitted until 2026-07-10 12:47:07.404385271 +0000 UTC m=+54.635495683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2pqg" (UID: "047aeb6b-0106-4f1a-a49b-3affb6e3401b") : configmap "kube-rbac-proxy" not found Jul 10 12:47:03.404526 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:03.404415 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls podName:047aeb6b-0106-4f1a-a49b-3affb6e3401b nodeName:}" failed. No retries permitted until 2026-07-10 12:47:07.404407431 +0000 UTC m=+54.635517841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2pqg" (UID: "047aeb6b-0106-4f1a-a49b-3affb6e3401b") : secret "insights-runtime-extractor-tls" not found Jul 10 12:47:05.014835 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.014785 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:47:05.015232 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:05.014931 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 12:47:05.015232 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:05.014994 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls podName:b42f5712-357f-483a-b744-c9d36cbb99ca nodeName:}" failed. No retries permitted until 2026-07-10 12:47:21.014979157 +0000 UTC m=+68.246089568 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls") pod "dns-default-rqc9p" (UID: "b42f5712-357f-483a-b744-c9d36cbb99ca") : secret "dns-default-metrics-tls" not found Jul 10 12:47:05.163737 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.163704 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p"] Jul 10 12:47:05.165290 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.165274 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" Jul 10 12:47:05.167636 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.167615 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 10 12:47:05.167904 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.167889 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 10 12:47:05.168832 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.168811 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 10 12:47:05.168950 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.168840 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6p4ds\"" Jul 10 12:47:05.168950 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.168852 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 10 12:47:05.170399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.170381 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v"] Jul 10 12:47:05.171930 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.171911 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" Jul 10 12:47:05.174946 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.174926 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 10 12:47:05.175251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.175234 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 10 12:47:05.175328 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.175269 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 10 12:47:05.175328 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.175289 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-d4ds7\"" Jul 10 12:47:05.175441 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.175270 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 10 12:47:05.177002 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.176983 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p"] Jul 10 12:47:05.183421 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.183396 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v"] Jul 10 12:47:05.261395 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.261363 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb"] Jul 10 12:47:05.263291 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.263269 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:05.267738 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.267662 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 12:47:05.267738 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.267679 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 12:47:05.267738 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.267685 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 12:47:05.268021 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.267912 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9jpzz\"" Jul 10 12:47:05.270216 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.270196 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-hplm6"] Jul 10 12:47:05.271882 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.271862 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb"] Jul 10 12:47:05.272014 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.271998 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.274510 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.274488 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 10 12:47:05.274602 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.274566 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 10 12:47:05.274674 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.274492 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 10 12:47:05.274813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.274791 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8xrvc\"" Jul 10 12:47:05.274939 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.274924 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 10 12:47:05.279049 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.279031 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 10 12:47:05.283172 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.283147 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-hplm6"] Jul 10 12:47:05.316865 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.316836 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxg9v\" (UID: \"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" Jul 10 12:47:05.317031 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.316878 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-54c8p\" (UID: \"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" Jul 10 12:47:05.317031 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.316908 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl7lv\" (UniqueName: \"kubernetes.io/projected/d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f-kube-api-access-jl7lv\") pod \"service-ca-operator-7695fc6c8c-54c8p\" (UID: \"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" Jul 10 12:47:05.317031 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.316959 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f-config\") pod \"service-ca-operator-7695fc6c8c-54c8p\" (UID: \"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" Jul 10 12:47:05.317031 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.316981 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxg9v\" (UID: \"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" Jul 10 12:47:05.317031 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.317014 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwlzn\" (UniqueName: \"kubernetes.io/projected/f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429-kube-api-access-jwlzn\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxg9v\" (UID: \"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" Jul 10 12:47:05.417563 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.417499 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h5hgb\" (UID: \"1718accb-74b9-486d-aaef-2b101af47866\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:05.417563 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.417563 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmp4l\" (UniqueName: \"kubernetes.io/projected/2e53c9a8-69c8-4347-a889-b27dd5e98cf5-kube-api-access-gmp4l\") pod \"console-operator-7866497494-hplm6\" (UID: \"2e53c9a8-69c8-4347-a889-b27dd5e98cf5\") " pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.417871 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.417613 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-54c8p\" (UID: \"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" Jul 10 12:47:05.417871 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.417645 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7lv\" (UniqueName: \"kubernetes.io/projected/d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f-kube-api-access-jl7lv\") pod \"service-ca-operator-7695fc6c8c-54c8p\" (UID: \"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" Jul 10 12:47:05.417871 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.417666 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e53c9a8-69c8-4347-a889-b27dd5e98cf5-config\") pod \"console-operator-7866497494-hplm6\" (UID: \"2e53c9a8-69c8-4347-a889-b27dd5e98cf5\") " pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.417871 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.417684 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e53c9a8-69c8-4347-a889-b27dd5e98cf5-trusted-ca\") pod \"console-operator-7866497494-hplm6\" (UID: \"2e53c9a8-69c8-4347-a889-b27dd5e98cf5\") " pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.417871 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.417770 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxg9v\" (UID: \"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" Jul 10 12:47:05.417871 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.417843 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z6hn\" (UniqueName: \"kubernetes.io/projected/1718accb-74b9-486d-aaef-2b101af47866-kube-api-access-6z6hn\") pod \"cluster-samples-operator-65db858894-h5hgb\" (UID: \"1718accb-74b9-486d-aaef-2b101af47866\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:05.418159 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.417877 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e53c9a8-69c8-4347-a889-b27dd5e98cf5-serving-cert\") pod \"console-operator-7866497494-hplm6\" (UID: \"2e53c9a8-69c8-4347-a889-b27dd5e98cf5\") " pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.418159 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.417907 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f-config\") pod \"service-ca-operator-7695fc6c8c-54c8p\" (UID: \"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" Jul 10 12:47:05.418159 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.417932 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxg9v\" (UID: \"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" Jul 10 12:47:05.418159 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.418022 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwlzn\" (UniqueName: \"kubernetes.io/projected/f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429-kube-api-access-jwlzn\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxg9v\" (UID: \"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" Jul 10 12:47:05.418446 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.418427 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxg9v\" (UID: \"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" Jul 10 12:47:05.418518 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.418501 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f-config\") pod \"service-ca-operator-7695fc6c8c-54c8p\" (UID: \"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" Jul 10 12:47:05.419781 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.419761 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-54c8p\" (UID: \"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" Jul 10 12:47:05.420019 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.420002 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxg9v\" (UID: \"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" Jul 10 12:47:05.426508 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.426477 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl7lv\" (UniqueName: \"kubernetes.io/projected/d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f-kube-api-access-jl7lv\") pod \"service-ca-operator-7695fc6c8c-54c8p\" (UID: \"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" Jul 10 12:47:05.426595 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.426545 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwlzn\" (UniqueName: \"kubernetes.io/projected/f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429-kube-api-access-jwlzn\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxg9v\" (UID: \"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" Jul 10 12:47:05.475286 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.475246 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" Jul 10 12:47:05.485254 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.485209 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" Jul 10 12:47:05.518791 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.518701 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z6hn\" (UniqueName: \"kubernetes.io/projected/1718accb-74b9-486d-aaef-2b101af47866-kube-api-access-6z6hn\") pod \"cluster-samples-operator-65db858894-h5hgb\" (UID: \"1718accb-74b9-486d-aaef-2b101af47866\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:05.518791 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.518747 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e53c9a8-69c8-4347-a889-b27dd5e98cf5-serving-cert\") pod \"console-operator-7866497494-hplm6\" (UID: \"2e53c9a8-69c8-4347-a889-b27dd5e98cf5\") " pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.518791 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.518786 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h5hgb\" (UID: \"1718accb-74b9-486d-aaef-2b101af47866\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:05.519075 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.518807 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmp4l\" (UniqueName: \"kubernetes.io/projected/2e53c9a8-69c8-4347-a889-b27dd5e98cf5-kube-api-access-gmp4l\") pod \"console-operator-7866497494-hplm6\" (UID: \"2e53c9a8-69c8-4347-a889-b27dd5e98cf5\") " pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.519075 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:05.518897 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 12:47:05.519075 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:05.518965 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls podName:1718accb-74b9-486d-aaef-2b101af47866 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:06.018946316 +0000 UTC m=+53.250056744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls") pod "cluster-samples-operator-65db858894-h5hgb" (UID: "1718accb-74b9-486d-aaef-2b101af47866") : secret "samples-operator-tls" not found Jul 10 12:47:05.519075 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.518991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e53c9a8-69c8-4347-a889-b27dd5e98cf5-config\") pod \"console-operator-7866497494-hplm6\" (UID: \"2e53c9a8-69c8-4347-a889-b27dd5e98cf5\") " pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.519075 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.519031 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e53c9a8-69c8-4347-a889-b27dd5e98cf5-trusted-ca\") pod \"console-operator-7866497494-hplm6\" (UID: \"2e53c9a8-69c8-4347-a889-b27dd5e98cf5\") " pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.519709 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.519685 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e53c9a8-69c8-4347-a889-b27dd5e98cf5-config\") pod \"console-operator-7866497494-hplm6\" (UID: \"2e53c9a8-69c8-4347-a889-b27dd5e98cf5\") " pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.519994 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.519970 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e53c9a8-69c8-4347-a889-b27dd5e98cf5-trusted-ca\") pod \"console-operator-7866497494-hplm6\" (UID: \"2e53c9a8-69c8-4347-a889-b27dd5e98cf5\") " pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.522787 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.522628 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e53c9a8-69c8-4347-a889-b27dd5e98cf5-serving-cert\") pod \"console-operator-7866497494-hplm6\" (UID: \"2e53c9a8-69c8-4347-a889-b27dd5e98cf5\") " pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.528808 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.528785 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z6hn\" (UniqueName: \"kubernetes.io/projected/1718accb-74b9-486d-aaef-2b101af47866-kube-api-access-6z6hn\") pod \"cluster-samples-operator-65db858894-h5hgb\" (UID: \"1718accb-74b9-486d-aaef-2b101af47866\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:05.528922 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.528785 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmp4l\" (UniqueName: \"kubernetes.io/projected/2e53c9a8-69c8-4347-a889-b27dd5e98cf5-kube-api-access-gmp4l\") pod \"console-operator-7866497494-hplm6\" (UID: \"2e53c9a8-69c8-4347-a889-b27dd5e98cf5\") " pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.583843 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.583497 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:05.633616 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.633583 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p"] Jul 10 12:47:05.639624 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.639541 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v"] Jul 10 12:47:05.645087 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:05.645046 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2de5d54_acaf_47ff_a8d2_c4cc7b5b1429.slice/crio-8ebcb0d5d7cb510fe6816fba4c377e5f030c976db97e925451f2282bb7ec9175 WatchSource:0}: Error finding container 8ebcb0d5d7cb510fe6816fba4c377e5f030c976db97e925451f2282bb7ec9175: Status 404 returned error can't find the container with id 8ebcb0d5d7cb510fe6816fba4c377e5f030c976db97e925451f2282bb7ec9175 Jul 10 12:47:05.717859 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:05.717825 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-hplm6"] Jul 10 12:47:05.720540 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:05.720513 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e53c9a8_69c8_4347_a889_b27dd5e98cf5.slice/crio-5e9612c972fbf65b9833f2d1a10202c2359715d71b16724c6300fcf0cb65821c WatchSource:0}: Error finding container 5e9612c972fbf65b9833f2d1a10202c2359715d71b16724c6300fcf0cb65821c: Status 404 returned error can't find the container with id 5e9612c972fbf65b9833f2d1a10202c2359715d71b16724c6300fcf0cb65821c Jul 10 12:47:06.022540 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:06.022503 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h5hgb\" (UID: \"1718accb-74b9-486d-aaef-2b101af47866\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:06.022899 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:06.022659 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 12:47:06.022899 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:06.022743 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls podName:1718accb-74b9-486d-aaef-2b101af47866 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:07.022721081 +0000 UTC m=+54.253831495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls") pod "cluster-samples-operator-65db858894-h5hgb" (UID: "1718accb-74b9-486d-aaef-2b101af47866") : secret "samples-operator-tls" not found Jul 10 12:47:06.521906 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:06.521867 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" event={"ID":"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429","Type":"ContainerStarted","Data":"8ebcb0d5d7cb510fe6816fba4c377e5f030c976db97e925451f2282bb7ec9175"} Jul 10 12:47:06.523204 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:06.523172 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" event={"ID":"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f","Type":"ContainerStarted","Data":"0618605157ad775d86ae76b73fb2c5f47a52c37e3676c3a77279c19467f5dc84"} Jul 10 12:47:06.524688 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:06.524625 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hplm6" event={"ID":"2e53c9a8-69c8-4347-a889-b27dd5e98cf5","Type":"ContainerStarted","Data":"5e9612c972fbf65b9833f2d1a10202c2359715d71b16724c6300fcf0cb65821c"} Jul 10 12:47:07.036798 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:07.036758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h5hgb\" (UID: \"1718accb-74b9-486d-aaef-2b101af47866\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:07.037263 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:07.036940 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 12:47:07.037263 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:07.037027 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls podName:1718accb-74b9-486d-aaef-2b101af47866 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:09.037004716 +0000 UTC m=+56.268115128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls") pod "cluster-samples-operator-65db858894-h5hgb" (UID: "1718accb-74b9-486d-aaef-2b101af47866") : secret "samples-operator-tls" not found Jul 10 12:47:07.441228 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:07.441137 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:07.441228 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:07.441200 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:07.441455 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:07.441314 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 12:47:07.441455 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:07.441340 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 12:47:07.441455 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:07.441409 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls podName:047aeb6b-0106-4f1a-a49b-3affb6e3401b nodeName:}" failed. No retries permitted until 2026-07-10 12:47:15.441389097 +0000 UTC m=+62.672499520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2pqg" (UID: "047aeb6b-0106-4f1a-a49b-3affb6e3401b") : secret "insights-runtime-extractor-tls" not found Jul 10 12:47:07.441455 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:07.441429 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm podName:047aeb6b-0106-4f1a-a49b-3affb6e3401b nodeName:}" failed. No retries permitted until 2026-07-10 12:47:15.441419583 +0000 UTC m=+62.672529999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2pqg" (UID: "047aeb6b-0106-4f1a-a49b-3affb6e3401b") : configmap "kube-rbac-proxy" not found Jul 10 12:47:08.532404 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:08.532300 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" event={"ID":"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429","Type":"ContainerStarted","Data":"a9ba0d9b8fc057bd2b7d2837b6113356c1d074e76b8277a16541962f20debd87"} Jul 10 12:47:08.534131 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:08.534103 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hplm6" event={"ID":"2e53c9a8-69c8-4347-a889-b27dd5e98cf5","Type":"ContainerStarted","Data":"45fbc64c5978355bf7f097deb16fb6781968b07122b1bf732f3ce780c888f6ad"} Jul 10 12:47:08.534389 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:08.534335 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:08.535872 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:08.535844 2557 patch_prober.go:28] interesting pod/console-operator-7866497494-hplm6 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.13:8443/readyz\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jul 10 12:47:08.535985 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:08.535896 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-hplm6" podUID="2e53c9a8-69c8-4347-a889-b27dd5e98cf5" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.13:8443/readyz\": dial tcp 10.134.0.13:8443: connect: connection refused" Jul 10 12:47:08.549668 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:08.549615 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" podStartSLOduration=0.95883739 podStartE2EDuration="3.549600885s" totalImagesPullingTime="2.590763495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:08.548073112 +0000 UTC m=+55.779183546" watchObservedRunningTime="2026-07-10 12:47:08.549600885 +0000 UTC m=+55.780711317" Jul 10 12:47:08.565611 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:08.565555 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-hplm6" podStartSLOduration=1.047616479 podStartE2EDuration="3.565533727s" totalImagesPullingTime="2.517917248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:08.564395672 +0000 UTC m=+55.795506118" watchObservedRunningTime="2026-07-10 12:47:08.565533727 +0000 UTC m=+55.796644142" Jul 10 12:47:09.055196 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:09.055159 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h5hgb\" (UID: \"1718accb-74b9-486d-aaef-2b101af47866\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:09.055428 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:09.055330 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 12:47:09.055428 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:09.055420 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls podName:1718accb-74b9-486d-aaef-2b101af47866 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:13.055401402 +0000 UTC m=+60.286511813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls") pod "cluster-samples-operator-65db858894-h5hgb" (UID: "1718accb-74b9-486d-aaef-2b101af47866") : secret "samples-operator-tls" not found Jul 10 12:47:09.538842 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:09.538804 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" event={"ID":"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f","Type":"ContainerStarted","Data":"8324a7601e1def5fd32cb021210eacd01d63f52e9d041c84a88c4f32944aaebd"} Jul 10 12:47:09.540437 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:09.540415 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/0.log" Jul 10 12:47:09.540574 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:09.540456 2557 generic.go:356] "Generic (PLEG): container finished" podID="2e53c9a8-69c8-4347-a889-b27dd5e98cf5" containerID="45fbc64c5978355bf7f097deb16fb6781968b07122b1bf732f3ce780c888f6ad" exitCode=255 Jul 10 12:47:09.540574 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:09.540514 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hplm6" event={"ID":"2e53c9a8-69c8-4347-a889-b27dd5e98cf5","Type":"ContainerDied","Data":"45fbc64c5978355bf7f097deb16fb6781968b07122b1bf732f3ce780c888f6ad"} Jul 10 12:47:09.540799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:09.540782 2557 scope.go:117] "RemoveContainer" containerID="45fbc64c5978355bf7f097deb16fb6781968b07122b1bf732f3ce780c888f6ad" Jul 10 12:47:09.557097 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:09.557044 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" podStartSLOduration=1.353250452 podStartE2EDuration="4.557029815s" totalImagesPullingTime="3.203779363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:09.556130012 +0000 UTC m=+56.787240445" watchObservedRunningTime="2026-07-10 12:47:09.557029815 +0000 UTC m=+56.788140247" Jul 10 12:47:10.548137 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:10.548110 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 12:47:10.548557 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:10.548525 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/0.log" Jul 10 12:47:10.548598 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:10.548557 2557 generic.go:356] "Generic (PLEG): container finished" podID="2e53c9a8-69c8-4347-a889-b27dd5e98cf5" containerID="f21b5f501d7a0bd875bc4dd20b194a048be4732b2b109159b7856440e19e3a82" exitCode=255 Jul 10 12:47:10.548645 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:10.548630 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hplm6" event={"ID":"2e53c9a8-69c8-4347-a889-b27dd5e98cf5","Type":"ContainerDied","Data":"f21b5f501d7a0bd875bc4dd20b194a048be4732b2b109159b7856440e19e3a82"} Jul 10 12:47:10.548708 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:10.548699 2557 scope.go:117] "RemoveContainer" containerID="45fbc64c5978355bf7f097deb16fb6781968b07122b1bf732f3ce780c888f6ad" Jul 10 12:47:10.548917 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:10.548897 2557 scope.go:117] "RemoveContainer" containerID="f21b5f501d7a0bd875bc4dd20b194a048be4732b2b109159b7856440e19e3a82" Jul 10 12:47:10.549159 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:10.549139 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-hplm6_openshift-console-operator(2e53c9a8-69c8-4347-a889-b27dd5e98cf5)\"" pod="openshift-console-operator/console-operator-7866497494-hplm6" podUID="2e53c9a8-69c8-4347-a889-b27dd5e98cf5" Jul 10 12:47:11.552469 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:11.552442 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 12:47:11.552846 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:11.552773 2557 scope.go:117] "RemoveContainer" containerID="f21b5f501d7a0bd875bc4dd20b194a048be4732b2b109159b7856440e19e3a82" Jul 10 12:47:11.552939 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:11.552918 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-hplm6_openshift-console-operator(2e53c9a8-69c8-4347-a889-b27dd5e98cf5)\"" pod="openshift-console-operator/console-operator-7866497494-hplm6" podUID="2e53c9a8-69c8-4347-a889-b27dd5e98cf5" Jul 10 12:47:13.090909 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:13.090869 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h5hgb\" (UID: \"1718accb-74b9-486d-aaef-2b101af47866\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:13.091286 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:13.091001 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 12:47:13.091286 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:13.091054 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls podName:1718accb-74b9-486d-aaef-2b101af47866 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:21.091040345 +0000 UTC m=+68.322150756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls") pod "cluster-samples-operator-65db858894-h5hgb" (UID: "1718accb-74b9-486d-aaef-2b101af47866") : secret "samples-operator-tls" not found Jul 10 12:47:14.459672 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:14.459640 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2sqc" Jul 10 12:47:15.507559 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:15.507519 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:15.507905 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:15.507569 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:15.507905 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:15.507672 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 12:47:15.507905 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:15.507753 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls podName:047aeb6b-0106-4f1a-a49b-3affb6e3401b nodeName:}" failed. No retries permitted until 2026-07-10 12:47:31.507735294 +0000 UTC m=+78.738845706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2pqg" (UID: "047aeb6b-0106-4f1a-a49b-3affb6e3401b") : secret "insights-runtime-extractor-tls" not found Jul 10 12:47:15.508039 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:15.508019 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/047aeb6b-0106-4f1a-a49b-3affb6e3401b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:15.584698 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:15.584665 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:15.585061 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:15.585047 2557 scope.go:117] "RemoveContainer" containerID="f21b5f501d7a0bd875bc4dd20b194a048be4732b2b109159b7856440e19e3a82" Jul 10 12:47:15.585237 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:15.585216 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-hplm6_openshift-console-operator(2e53c9a8-69c8-4347-a889-b27dd5e98cf5)\"" pod="openshift-console-operator/console-operator-7866497494-hplm6" podUID="2e53c9a8-69c8-4347-a889-b27dd5e98cf5" Jul 10 12:47:18.535194 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:18.535142 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:18.535603 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:18.535547 2557 scope.go:117] "RemoveContainer" containerID="f21b5f501d7a0bd875bc4dd20b194a048be4732b2b109159b7856440e19e3a82" Jul 10 12:47:18.535698 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:18.535678 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-hplm6_openshift-console-operator(2e53c9a8-69c8-4347-a889-b27dd5e98cf5)\"" pod="openshift-console-operator/console-operator-7866497494-hplm6" podUID="2e53c9a8-69c8-4347-a889-b27dd5e98cf5" Jul 10 12:47:18.935447 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:18.935319 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:47:18.937910 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:18.937888 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 12:47:18.948117 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:18.948085 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b18e6b0-54a0-4f26-a217-e58f61c6d45c-original-pull-secret\") pod \"global-pull-secret-syncer-thrnw\" (UID: \"2b18e6b0-54a0-4f26-a217-e58f61c6d45c\") " pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:47:19.036193 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.036152 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwj7z\" (UniqueName: \"kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z\") pod \"network-check-target-kg958\" (UID: \"4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e\") " pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:47:19.036401 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.036370 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:47:19.038765 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.038744 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 12:47:19.038855 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.038827 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 12:47:19.046953 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:19.046931 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 12:47:19.047030 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:47:19.047017 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs podName:c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b nodeName:}" failed. No retries permitted until 2026-07-10 12:48:23.04699544 +0000 UTC m=+130.278105868 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs") pod "network-metrics-daemon-rtskf" (UID: "c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b") : secret "metrics-daemon-secret" not found Jul 10 12:47:19.049370 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.049337 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 12:47:19.059303 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.059276 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwj7z\" (UniqueName: \"kubernetes.io/projected/4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e-kube-api-access-vwj7z\") pod \"network-check-target-kg958\" (UID: \"4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e\") " pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:47:19.073323 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.073299 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thrnw" Jul 10 12:47:19.194250 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.194173 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-thrnw"] Jul 10 12:47:19.197054 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:19.197019 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b18e6b0_54a0_4f26_a217_e58f61c6d45c.slice/crio-00e6846b325055b39ac05ca4650c581f9f78acdfed9c914e13abf2cbfefa74c8 WatchSource:0}: Error finding container 00e6846b325055b39ac05ca4650c581f9f78acdfed9c914e13abf2cbfefa74c8: Status 404 returned error can't find the container with id 00e6846b325055b39ac05ca4650c581f9f78acdfed9c914e13abf2cbfefa74c8 Jul 10 12:47:19.281180 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.281154 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-99bwq\"" Jul 10 12:47:19.289289 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.289273 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:47:19.408242 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.408213 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kg958"] Jul 10 12:47:19.411845 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:19.411822 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f405e0b_c6d2_49a9_a77c_dcccf4e5f59e.slice/crio-6c894ec815157a6e315a54ac23f7aad5cad28225a7229d8ff90bb3a4ad530826 WatchSource:0}: Error finding container 6c894ec815157a6e315a54ac23f7aad5cad28225a7229d8ff90bb3a4ad530826: Status 404 returned error can't find the container with id 6c894ec815157a6e315a54ac23f7aad5cad28225a7229d8ff90bb3a4ad530826 Jul 10 12:47:19.574122 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.574088 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-thrnw" event={"ID":"2b18e6b0-54a0-4f26-a217-e58f61c6d45c","Type":"ContainerStarted","Data":"00e6846b325055b39ac05ca4650c581f9f78acdfed9c914e13abf2cbfefa74c8"} Jul 10 12:47:19.575089 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:19.575070 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kg958" event={"ID":"4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e","Type":"ContainerStarted","Data":"6c894ec815157a6e315a54ac23f7aad5cad28225a7229d8ff90bb3a4ad530826"} Jul 10 12:47:21.053472 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:21.053434 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:47:21.056038 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:21.056010 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42f5712-357f-483a-b744-c9d36cbb99ca-metrics-tls\") pod \"dns-default-rqc9p\" (UID: \"b42f5712-357f-483a-b744-c9d36cbb99ca\") " pod="openshift-dns/dns-default-rqc9p" Jul 10 12:47:21.154359 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:21.154305 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h5hgb\" (UID: \"1718accb-74b9-486d-aaef-2b101af47866\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:21.156756 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:21.156720 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1718accb-74b9-486d-aaef-2b101af47866-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h5hgb\" (UID: \"1718accb-74b9-486d-aaef-2b101af47866\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:21.178532 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:21.178505 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9jpzz\"" Jul 10 12:47:21.186671 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:21.186649 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" Jul 10 12:47:21.249600 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:21.249497 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qfssw\"" Jul 10 12:47:21.258739 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:21.258440 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rqc9p" Jul 10 12:47:21.341296 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:21.341208 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb"] Jul 10 12:47:21.418907 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:21.418880 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rqc9p"] Jul 10 12:47:21.422285 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:21.422252 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42f5712_357f_483a_b744_c9d36cbb99ca.slice/crio-888e19164f4981d09e6a9fe00540c33bba825af85bb2f93a0a55bc5e1a1406ad WatchSource:0}: Error finding container 888e19164f4981d09e6a9fe00540c33bba825af85bb2f93a0a55bc5e1a1406ad: Status 404 returned error can't find the container with id 888e19164f4981d09e6a9fe00540c33bba825af85bb2f93a0a55bc5e1a1406ad Jul 10 12:47:21.582739 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:21.582656 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rqc9p" event={"ID":"b42f5712-357f-483a-b744-c9d36cbb99ca","Type":"ContainerStarted","Data":"888e19164f4981d09e6a9fe00540c33bba825af85bb2f93a0a55bc5e1a1406ad"} Jul 10 12:47:21.583862 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:21.583826 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" event={"ID":"1718accb-74b9-486d-aaef-2b101af47866","Type":"ContainerStarted","Data":"41b2aff1a03c994398e666ac339620c8fe56e65afef2a2bc9b15f8aa666d5c50"} Jul 10 12:47:26.605165 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:26.605106 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" event={"ID":"1718accb-74b9-486d-aaef-2b101af47866","Type":"ContainerStarted","Data":"469ce501ffe1f3ff63ebfea6093d1776d480b761ca577c5829e1ed6410d230f5"} Jul 10 12:47:26.605650 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:26.605223 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" event={"ID":"1718accb-74b9-486d-aaef-2b101af47866","Type":"ContainerStarted","Data":"d206111535618852f28f2590f037ef7e8690c5ad3ae9fbe3a825e50d408f41ac"} Jul 10 12:47:26.606461 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:26.606438 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-thrnw" event={"ID":"2b18e6b0-54a0-4f26-a217-e58f61c6d45c","Type":"ContainerStarted","Data":"57eb0d822139440ceac2673a3a51852cc4838f3d2ba994e6ea5970f01068af67"} Jul 10 12:47:26.607804 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:26.607786 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kg958" event={"ID":"4f405e0b-c6d2-49a9-a77c-dcccf4e5f59e","Type":"ContainerStarted","Data":"9642d573f811f6e555edaa264c8a9fc982bee7f519f2fb04333ef5c988d0f198"} Jul 10 12:47:26.607900 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:26.607825 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:47:26.609387 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:26.609368 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rqc9p" event={"ID":"b42f5712-357f-483a-b744-c9d36cbb99ca","Type":"ContainerStarted","Data":"f1dad9e954195768d610988c735773654c32a6dcd2134892b85e849966c2b17e"} Jul 10 12:47:26.609466 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:26.609402 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rqc9p" event={"ID":"b42f5712-357f-483a-b744-c9d36cbb99ca","Type":"ContainerStarted","Data":"1471e3eb5978c3f7c943d48a7bfa831e431387b6d7dc9bc39f09ba272fe556d1"} Jul 10 12:47:26.609530 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:26.609513 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rqc9p" Jul 10 12:47:26.622394 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:26.622329 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h5hgb" podStartSLOduration=16.990306386 podStartE2EDuration="21.622314692s" totalImagesPullingTime="4.632008306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:26.620654379 +0000 UTC m=+73.851764811" watchObservedRunningTime="2026-07-10 12:47:26.622314692 +0000 UTC m=+73.853425122" Jul 10 12:47:26.635143 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:26.635095 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kg958" podStartSLOduration=67.015707231 podStartE2EDuration="1m13.635080102s" totalImagesPullingTime="6.619372871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:26.634195931 +0000 UTC m=+73.865306365" watchObservedRunningTime="2026-07-10 12:47:26.635080102 +0000 UTC m=+73.866190535" Jul 10 12:47:26.651425 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:26.651372 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rqc9p" podStartSLOduration=33.040400581 podStartE2EDuration="37.651341415s" totalImagesPullingTime="4.610940834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:26.65057072 +0000 UTC m=+73.881681165" watchObservedRunningTime="2026-07-10 12:47:26.651341415 +0000 UTC m=+73.882451848" Jul 10 12:47:26.665339 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:26.665288 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-thrnw" podStartSLOduration=66.809262201 podStartE2EDuration="1m13.665271905s" totalImagesPullingTime="6.856009704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:26.664465814 +0000 UTC m=+73.895576272" watchObservedRunningTime="2026-07-10 12:47:26.665271905 +0000 UTC m=+73.896382341" Jul 10 12:47:30.261880 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:30.261848 2557 scope.go:117] "RemoveContainer" containerID="f21b5f501d7a0bd875bc4dd20b194a048be4732b2b109159b7856440e19e3a82" Jul 10 12:47:30.625918 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:30.625838 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 12:47:30.626057 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:30.625926 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hplm6" event={"ID":"2e53c9a8-69c8-4347-a889-b27dd5e98cf5","Type":"ContainerStarted","Data":"ea4ca744db3153abcb2639bc492c6e32c360d565f5e978a0194b1c3e0be0dddc"} Jul 10 12:47:30.627097 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:30.627070 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:31.249444 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:31.249414 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-hplm6" Jul 10 12:47:31.540338 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:31.540233 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:31.542603 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:31.542578 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/047aeb6b-0106-4f1a-a49b-3affb6e3401b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2pqg\" (UID: \"047aeb6b-0106-4f1a-a49b-3affb6e3401b\") " pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:31.725335 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:31.725306 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cc7d5\"" Jul 10 12:47:31.733606 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:31.733588 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x2pqg" Jul 10 12:47:31.857876 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:31.857844 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x2pqg"] Jul 10 12:47:31.862430 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:31.862405 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047aeb6b_0106_4f1a_a49b_3affb6e3401b.slice/crio-bafab6c3bf8cde6300d04a2fd08fd8f82c4b0f6f1fb2b9f7d8061e371b2a30ca WatchSource:0}: Error finding container bafab6c3bf8cde6300d04a2fd08fd8f82c4b0f6f1fb2b9f7d8061e371b2a30ca: Status 404 returned error can't find the container with id bafab6c3bf8cde6300d04a2fd08fd8f82c4b0f6f1fb2b9f7d8061e371b2a30ca Jul 10 12:47:32.636937 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.636893 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2pqg" event={"ID":"047aeb6b-0106-4f1a-a49b-3affb6e3401b","Type":"ContainerStarted","Data":"bafab6c3bf8cde6300d04a2fd08fd8f82c4b0f6f1fb2b9f7d8061e371b2a30ca"} Jul 10 12:47:32.944155 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.944070 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v"] Jul 10 12:47:32.947286 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.947259 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7"] Jul 10 12:47:32.947432 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.947408 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v" Jul 10 12:47:32.950334 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.950265 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:32.950334 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.950330 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-h4cxr\"" Jul 10 12:47:32.950943 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.950670 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 10 12:47:32.951559 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.951539 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 10 12:47:32.951672 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.951540 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 10 12:47:32.951672 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.951542 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 10 12:47:32.954711 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.954692 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 10 12:47:32.963776 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.963749 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v"] Jul 10 12:47:32.968303 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:32.968237 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7"] Jul 10 12:47:33.053190 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.053128 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3e3930d-ca2d-4b69-b176-02f8ff2f8b52-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c675c5b76-wk62v\" (UID: \"f3e3930d-ca2d-4b69-b176-02f8ff2f8b52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v" Jul 10 12:47:33.053190 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.053181 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx92s\" (UniqueName: \"kubernetes.io/projected/dc81a232-fa29-46d2-b07a-6c2fe06b12af-kube-api-access-hx92s\") pod \"klusterlet-addon-workmgr-55946599df-95dw7\" (UID: \"dc81a232-fa29-46d2-b07a-6c2fe06b12af\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:33.053480 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.053272 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvfv7\" (UniqueName: \"kubernetes.io/projected/f3e3930d-ca2d-4b69-b176-02f8ff2f8b52-kube-api-access-mvfv7\") pod \"managed-serviceaccount-addon-agent-c675c5b76-wk62v\" (UID: \"f3e3930d-ca2d-4b69-b176-02f8ff2f8b52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v" Jul 10 12:47:33.053480 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.053316 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dc81a232-fa29-46d2-b07a-6c2fe06b12af-klusterlet-config\") pod \"klusterlet-addon-workmgr-55946599df-95dw7\" (UID: \"dc81a232-fa29-46d2-b07a-6c2fe06b12af\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:33.053480 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.053473 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc81a232-fa29-46d2-b07a-6c2fe06b12af-tmp\") pod \"klusterlet-addon-workmgr-55946599df-95dw7\" (UID: \"dc81a232-fa29-46d2-b07a-6c2fe06b12af\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:33.059375 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.059332 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fc9888469-9tfxz"] Jul 10 12:47:33.062435 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.062409 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.067109 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.067080 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 12:47:33.067261 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.067136 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 12:47:33.067683 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.067662 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 12:47:33.077542 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.077521 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 12:47:33.080926 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.080904 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ch6zw\"" Jul 10 12:47:33.095541 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.095505 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fc9888469-9tfxz"] Jul 10 12:47:33.154840 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.154804 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93a85552-a589-4203-9194-9fd39bde8bdc-ca-trust-extracted\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.155012 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.154873 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93a85552-a589-4203-9194-9fd39bde8bdc-trusted-ca\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.155082 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.155020 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc81a232-fa29-46d2-b07a-6c2fe06b12af-tmp\") pod \"klusterlet-addon-workmgr-55946599df-95dw7\" (UID: \"dc81a232-fa29-46d2-b07a-6c2fe06b12af\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:33.155082 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.155064 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93a85552-a589-4203-9194-9fd39bde8bdc-registry-certificates\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.155177 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.155095 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6blvp\" (UniqueName: \"kubernetes.io/projected/93a85552-a589-4203-9194-9fd39bde8bdc-kube-api-access-6blvp\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.155227 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.155179 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93a85552-a589-4203-9194-9fd39bde8bdc-registry-tls\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.155280 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.155222 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3e3930d-ca2d-4b69-b176-02f8ff2f8b52-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c675c5b76-wk62v\" (UID: \"f3e3930d-ca2d-4b69-b176-02f8ff2f8b52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v" Jul 10 12:47:33.155280 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.155245 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx92s\" (UniqueName: \"kubernetes.io/projected/dc81a232-fa29-46d2-b07a-6c2fe06b12af-kube-api-access-hx92s\") pod \"klusterlet-addon-workmgr-55946599df-95dw7\" (UID: \"dc81a232-fa29-46d2-b07a-6c2fe06b12af\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:33.155280 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.155269 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvfv7\" (UniqueName: \"kubernetes.io/projected/f3e3930d-ca2d-4b69-b176-02f8ff2f8b52-kube-api-access-mvfv7\") pod \"managed-serviceaccount-addon-agent-c675c5b76-wk62v\" (UID: \"f3e3930d-ca2d-4b69-b176-02f8ff2f8b52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v" Jul 10 12:47:33.155449 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.155338 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93a85552-a589-4203-9194-9fd39bde8bdc-installation-pull-secrets\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.155449 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.155429 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93a85552-a589-4203-9194-9fd39bde8bdc-bound-sa-token\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.155548 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.155457 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93a85552-a589-4203-9194-9fd39bde8bdc-image-registry-private-configuration\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.155548 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.155463 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc81a232-fa29-46d2-b07a-6c2fe06b12af-tmp\") pod \"klusterlet-addon-workmgr-55946599df-95dw7\" (UID: \"dc81a232-fa29-46d2-b07a-6c2fe06b12af\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:33.155548 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.155489 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dc81a232-fa29-46d2-b07a-6c2fe06b12af-klusterlet-config\") pod \"klusterlet-addon-workmgr-55946599df-95dw7\" (UID: \"dc81a232-fa29-46d2-b07a-6c2fe06b12af\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:33.158310 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.158284 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3e3930d-ca2d-4b69-b176-02f8ff2f8b52-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c675c5b76-wk62v\" (UID: \"f3e3930d-ca2d-4b69-b176-02f8ff2f8b52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v" Jul 10 12:47:33.158665 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.158646 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dc81a232-fa29-46d2-b07a-6c2fe06b12af-klusterlet-config\") pod \"klusterlet-addon-workmgr-55946599df-95dw7\" (UID: \"dc81a232-fa29-46d2-b07a-6c2fe06b12af\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:33.172894 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.172862 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx92s\" (UniqueName: \"kubernetes.io/projected/dc81a232-fa29-46d2-b07a-6c2fe06b12af-kube-api-access-hx92s\") pod \"klusterlet-addon-workmgr-55946599df-95dw7\" (UID: \"dc81a232-fa29-46d2-b07a-6c2fe06b12af\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:33.173242 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.173201 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvfv7\" (UniqueName: \"kubernetes.io/projected/f3e3930d-ca2d-4b69-b176-02f8ff2f8b52-kube-api-access-mvfv7\") pod \"managed-serviceaccount-addon-agent-c675c5b76-wk62v\" (UID: \"f3e3930d-ca2d-4b69-b176-02f8ff2f8b52\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v" Jul 10 12:47:33.256140 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.256102 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93a85552-a589-4203-9194-9fd39bde8bdc-trusted-ca\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.256308 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.256181 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93a85552-a589-4203-9194-9fd39bde8bdc-registry-certificates\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.256308 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.256204 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6blvp\" (UniqueName: \"kubernetes.io/projected/93a85552-a589-4203-9194-9fd39bde8bdc-kube-api-access-6blvp\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.256441 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.256378 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93a85552-a589-4203-9194-9fd39bde8bdc-registry-tls\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.256491 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.256450 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93a85552-a589-4203-9194-9fd39bde8bdc-installation-pull-secrets\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.256491 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.256481 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93a85552-a589-4203-9194-9fd39bde8bdc-bound-sa-token\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.256581 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.256507 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93a85552-a589-4203-9194-9fd39bde8bdc-image-registry-private-configuration\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.256581 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.256544 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93a85552-a589-4203-9194-9fd39bde8bdc-ca-trust-extracted\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.256996 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.256900 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93a85552-a589-4203-9194-9fd39bde8bdc-ca-trust-extracted\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.257213 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.257163 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93a85552-a589-4203-9194-9fd39bde8bdc-registry-certificates\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.257213 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.257204 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93a85552-a589-4203-9194-9fd39bde8bdc-trusted-ca\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.259380 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.259339 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93a85552-a589-4203-9194-9fd39bde8bdc-registry-tls\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.259567 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.259549 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93a85552-a589-4203-9194-9fd39bde8bdc-image-registry-private-configuration\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.259567 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.259559 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93a85552-a589-4203-9194-9fd39bde8bdc-installation-pull-secrets\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.265663 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.265620 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93a85552-a589-4203-9194-9fd39bde8bdc-bound-sa-token\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.266262 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.266242 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6blvp\" (UniqueName: \"kubernetes.io/projected/93a85552-a589-4203-9194-9fd39bde8bdc-kube-api-access-6blvp\") pod \"image-registry-6fc9888469-9tfxz\" (UID: \"93a85552-a589-4203-9194-9fd39bde8bdc\") " pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.269271 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.269228 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v" Jul 10 12:47:33.276675 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.276654 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:33.373927 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.373828 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:33.429934 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.429814 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7"] Jul 10 12:47:33.457881 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.457818 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v"] Jul 10 12:47:33.525115 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:33.525030 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fc9888469-9tfxz"] Jul 10 12:47:34.739418 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:34.739271 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3e3930d_ca2d_4b69_b176_02f8ff2f8b52.slice/crio-e29ee27c0c3ac7a590aa73e04e9c2df7d8563f880e62fdef87b11a7929487b15 WatchSource:0}: Error finding container e29ee27c0c3ac7a590aa73e04e9c2df7d8563f880e62fdef87b11a7929487b15: Status 404 returned error can't find the container with id e29ee27c0c3ac7a590aa73e04e9c2df7d8563f880e62fdef87b11a7929487b15 Jul 10 12:47:34.739786 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:34.739716 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc81a232_fa29_46d2_b07a_6c2fe06b12af.slice/crio-12f73f90e2da017a88840c87d6cc9cb88bb879794c3146da1ae960f94d3ef6b9 WatchSource:0}: Error finding container 12f73f90e2da017a88840c87d6cc9cb88bb879794c3146da1ae960f94d3ef6b9: Status 404 returned error can't find the container with id 12f73f90e2da017a88840c87d6cc9cb88bb879794c3146da1ae960f94d3ef6b9 Jul 10 12:47:34.740742 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:34.740710 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a85552_a589_4203_9194_9fd39bde8bdc.slice/crio-988348b845ac5e5759879049a2c00d1fe2f5fc9240809af14f72468906cd9129 WatchSource:0}: Error finding container 988348b845ac5e5759879049a2c00d1fe2f5fc9240809af14f72468906cd9129: Status 404 returned error can't find the container with id 988348b845ac5e5759879049a2c00d1fe2f5fc9240809af14f72468906cd9129 Jul 10 12:47:35.650732 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:35.650701 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v" event={"ID":"f3e3930d-ca2d-4b69-b176-02f8ff2f8b52","Type":"ContainerStarted","Data":"e29ee27c0c3ac7a590aa73e04e9c2df7d8563f880e62fdef87b11a7929487b15"} Jul 10 12:47:35.652011 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:35.651981 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" event={"ID":"93a85552-a589-4203-9194-9fd39bde8bdc","Type":"ContainerStarted","Data":"988348b845ac5e5759879049a2c00d1fe2f5fc9240809af14f72468906cd9129"} Jul 10 12:47:35.653014 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:35.652991 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" event={"ID":"dc81a232-fa29-46d2-b07a-6c2fe06b12af","Type":"ContainerStarted","Data":"12f73f90e2da017a88840c87d6cc9cb88bb879794c3146da1ae960f94d3ef6b9"} Jul 10 12:47:36.615843 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:36.615816 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rqc9p" Jul 10 12:47:36.662551 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:36.662507 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" event={"ID":"93a85552-a589-4203-9194-9fd39bde8bdc","Type":"ContainerStarted","Data":"46e4d3ca798a0033e76ce230d7ddba0207a394b4d30b924650c140e765faa0d4"} Jul 10 12:47:36.663368 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:36.663332 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:36.668386 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:36.668337 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2pqg" event={"ID":"047aeb6b-0106-4f1a-a49b-3affb6e3401b","Type":"ContainerStarted","Data":"3b88245870a9f35546fb9af8ea1fa8d0ee4f682e11f9f3284db99cb59dcc2f6a"} Jul 10 12:47:36.668502 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:36.668418 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2pqg" event={"ID":"047aeb6b-0106-4f1a-a49b-3affb6e3401b","Type":"ContainerStarted","Data":"d8f7be951f07671138958a157b9e861c689541a9e2c16b2233ccae5ce798465a"} Jul 10 12:47:36.682495 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:36.682438 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" podStartSLOduration=3.682415646 podStartE2EDuration="3.682415646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:36.681258397 +0000 UTC m=+83.912368833" watchObservedRunningTime="2026-07-10 12:47:36.682415646 +0000 UTC m=+83.913526073" Jul 10 12:47:40.686932 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:40.686893 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2pqg" event={"ID":"047aeb6b-0106-4f1a-a49b-3affb6e3401b","Type":"ContainerStarted","Data":"e147d2880fbe99e434fb1c7f49bc27ff2b1487e508aea6089d8c1f23013799bc"} Jul 10 12:47:40.688395 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:40.688370 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v" event={"ID":"f3e3930d-ca2d-4b69-b176-02f8ff2f8b52","Type":"ContainerStarted","Data":"4102ba4f61d5325fd4cec3bde2bfbab1e70c1e4ee2ba1623300aae511d15ef5a"} Jul 10 12:47:40.696277 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:40.696198 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" event={"ID":"dc81a232-fa29-46d2-b07a-6c2fe06b12af","Type":"ContainerStarted","Data":"6bb5b7fc63e1a6141f082bf9c7fda879c85e6aa90c4f5a7fcb350b9c2fb8cf9d"} Jul 10 12:47:40.696446 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:40.696283 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:40.698027 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:40.698003 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" Jul 10 12:47:40.706007 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:40.705961 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x2pqg" podStartSLOduration=33.251214871 podStartE2EDuration="41.705942516s" totalImagesPullingTime="8.454727645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:40.70516695 +0000 UTC m=+87.936277371" watchObservedRunningTime="2026-07-10 12:47:40.705942516 +0000 UTC m=+87.937052951" Jul 10 12:47:40.722571 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:40.722523 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-55946599df-95dw7" podStartSLOduration=2.985229075 podStartE2EDuration="8.722506544s" totalImagesPullingTime="5.737277469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:40.721972308 +0000 UTC m=+87.953082743" watchObservedRunningTime="2026-07-10 12:47:40.722506544 +0000 UTC m=+87.953616955" Jul 10 12:47:40.744370 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:40.738173 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c675c5b76-wk62v" podStartSLOduration=3.035495002 podStartE2EDuration="8.738151637s" totalImagesPullingTime="5.702656635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:40.736635457 +0000 UTC m=+87.967745890" watchObservedRunningTime="2026-07-10 12:47:40.738151637 +0000 UTC m=+87.969262071" Jul 10 12:47:44.594158 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.594123 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m4rln"] Jul 10 12:47:44.597094 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.597072 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.599775 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.599747 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 12:47:44.599775 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.599767 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 12:47:44.599943 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.599771 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 12:47:44.600047 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.600033 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 12:47:44.601052 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.601036 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hw9ng\"" Jul 10 12:47:44.601150 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.601039 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 12:47:44.601150 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.601041 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 12:47:44.654464 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.654434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-root\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.654464 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.654469 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-metrics-client-ca\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.654655 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.654490 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwf8p\" (UniqueName: \"kubernetes.io/projected/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-kube-api-access-wwf8p\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.654655 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.654517 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-accelerators-collector-config\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.654655 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.654611 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-textfile\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.654655 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.654651 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.654802 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.654673 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-sys\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.654802 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.654693 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-tls\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.654802 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.654713 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-wtmp\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.755962 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.755918 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.755962 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.755965 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-sys\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756209 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756068 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-tls\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756209 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756092 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-wtmp\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756209 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756114 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-sys\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756209 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756192 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-root\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756453 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756221 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-metrics-client-ca\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756453 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756251 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwf8p\" (UniqueName: \"kubernetes.io/projected/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-kube-api-access-wwf8p\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756453 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756254 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-wtmp\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756453 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-accelerators-collector-config\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756453 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756311 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-root\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756453 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756335 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-textfile\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756729 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756716 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-textfile\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756875 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756856 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-metrics-client-ca\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.756957 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.756934 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-accelerators-collector-config\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.758495 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.758471 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.758495 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.758479 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-node-exporter-tls\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.764230 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.764211 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwf8p\" (UniqueName: \"kubernetes.io/projected/d0a41df0-8efc-4b29-af89-77e5ba1e2ce4-kube-api-access-wwf8p\") pod \"node-exporter-m4rln\" (UID: \"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4\") " pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.906267 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:44.906180 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m4rln" Jul 10 12:47:44.915702 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:44.915676 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a41df0_8efc_4b29_af89_77e5ba1e2ce4.slice/crio-0d9cec7eb94f047496db21c2acbeb1012f25366cb474cfb99678460f15c14d6a WatchSource:0}: Error finding container 0d9cec7eb94f047496db21c2acbeb1012f25366cb474cfb99678460f15c14d6a: Status 404 returned error can't find the container with id 0d9cec7eb94f047496db21c2acbeb1012f25366cb474cfb99678460f15c14d6a Jul 10 12:47:45.714806 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.714769 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4rln" event={"ID":"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4","Type":"ContainerStarted","Data":"0d9cec7eb94f047496db21c2acbeb1012f25366cb474cfb99678460f15c14d6a"} Jul 10 12:47:45.963742 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.963713 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cc76976bb-7m4gm"] Jul 10 12:47:45.965539 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.965490 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:45.968233 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.968213 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 12:47:45.968309 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.968213 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 12:47:45.968381 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.968216 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 12:47:45.968381 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.968224 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 12:47:45.968600 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.968584 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 12:47:45.968642 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.968603 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 12:47:45.968759 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.968745 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zm5ns\"" Jul 10 12:47:45.968845 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.968827 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 12:47:45.972239 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.972224 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 12:47:45.977826 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:45.977805 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc76976bb-7m4gm"] Jul 10 12:47:46.067730 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.067698 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-trusted-ca-bundle\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.067730 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.067733 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-config\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.067930 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.067754 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9zs2\" (UniqueName: \"kubernetes.io/projected/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-kube-api-access-l9zs2\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.067930 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.067789 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-service-ca\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.067930 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.067838 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-serving-cert\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.067930 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.067895 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-oauth-config\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.067930 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.067929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-oauth-serving-cert\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.169052 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.169012 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-service-ca\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.169052 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.169050 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-serving-cert\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.169273 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.169097 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-oauth-config\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.169273 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.169127 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-oauth-serving-cert\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.169273 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.169206 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-trusted-ca-bundle\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.169273 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.169233 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-config\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.169273 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.169259 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9zs2\" (UniqueName: \"kubernetes.io/projected/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-kube-api-access-l9zs2\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.169861 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.169836 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-service-ca\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.169983 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.169919 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-oauth-serving-cert\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.169983 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.169946 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-config\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.170078 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.170052 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-trusted-ca-bundle\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.171626 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.171606 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-oauth-config\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.171833 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.171815 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-serving-cert\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.178914 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.178893 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9zs2\" (UniqueName: \"kubernetes.io/projected/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-kube-api-access-l9zs2\") pod \"console-6cc76976bb-7m4gm\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.321675 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.321590 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:46.450775 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.450746 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc76976bb-7m4gm"] Jul 10 12:47:46.453885 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:46.453860 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b752e6_6363_4ee6_bbfb_5fd25e26c2c2.slice/crio-16fd362fb87555f23e4edf8d10eaddfdc5c52762ef2d44bf15468df215080550 WatchSource:0}: Error finding container 16fd362fb87555f23e4edf8d10eaddfdc5c52762ef2d44bf15468df215080550: Status 404 returned error can't find the container with id 16fd362fb87555f23e4edf8d10eaddfdc5c52762ef2d44bf15468df215080550 Jul 10 12:47:46.719505 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.719474 2557 generic.go:356] "Generic (PLEG): container finished" podID="d0a41df0-8efc-4b29-af89-77e5ba1e2ce4" containerID="fc04787220540457ea8e505f97c01a7f86a0ee6ee61c56066ed72c212d33fc3a" exitCode=0 Jul 10 12:47:46.719915 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.719559 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4rln" event={"ID":"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4","Type":"ContainerDied","Data":"fc04787220540457ea8e505f97c01a7f86a0ee6ee61c56066ed72c212d33fc3a"} Jul 10 12:47:46.720770 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:46.720742 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc76976bb-7m4gm" event={"ID":"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2","Type":"ContainerStarted","Data":"16fd362fb87555f23e4edf8d10eaddfdc5c52762ef2d44bf15468df215080550"} Jul 10 12:47:47.727227 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:47.727186 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4rln" event={"ID":"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4","Type":"ContainerStarted","Data":"ec7dfbc6c48ac1aa9d8f3e97160e1f249e887bafcd054d52b4206ea286b74c89"} Jul 10 12:47:47.727787 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:47.727251 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4rln" event={"ID":"d0a41df0-8efc-4b29-af89-77e5ba1e2ce4","Type":"ContainerStarted","Data":"54d468ceb5844b4b139f9131477fca644834c687e88ca4e87b3c8fb7c7558dfc"} Jul 10 12:47:47.752305 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:47.752246 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m4rln" podStartSLOduration=2.788427026 podStartE2EDuration="3.752225213s" totalImagesPullingTime="899.499287ms" totalInitContainerRuntime="64.2989ms" isStatefulPod=true podCreationTimestamp="2026-07-10 12:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:47.751630208 +0000 UTC m=+94.982740642" watchObservedRunningTime="2026-07-10 12:47:47.752225213 +0000 UTC m=+94.983335648" Jul 10 12:47:49.362334 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.362308 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc"] Jul 10 12:47:49.365504 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.365441 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" Jul 10 12:47:49.368184 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.368164 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 10 12:47:49.368285 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.368182 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pt5hl\"" Jul 10 12:47:49.377435 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.377412 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc"] Jul 10 12:47:49.498947 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.498913 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/260b30c7-1e8d-476e-a2ff-d03d82cacd2d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-kb6tc\" (UID: \"260b30c7-1e8d-476e-a2ff-d03d82cacd2d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" Jul 10 12:47:49.499099 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.498954 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz26f\" (UniqueName: \"kubernetes.io/projected/260b30c7-1e8d-476e-a2ff-d03d82cacd2d-kube-api-access-cz26f\") pod \"monitoring-plugin-5f68df7f58-kb6tc\" (UID: \"260b30c7-1e8d-476e-a2ff-d03d82cacd2d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" Jul 10 12:47:49.600152 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.600116 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/260b30c7-1e8d-476e-a2ff-d03d82cacd2d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-kb6tc\" (UID: \"260b30c7-1e8d-476e-a2ff-d03d82cacd2d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" Jul 10 12:47:49.600330 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.600169 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz26f\" (UniqueName: \"kubernetes.io/projected/260b30c7-1e8d-476e-a2ff-d03d82cacd2d-kube-api-access-cz26f\") pod \"monitoring-plugin-5f68df7f58-kb6tc\" (UID: \"260b30c7-1e8d-476e-a2ff-d03d82cacd2d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" Jul 10 12:47:49.602675 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.602655 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/260b30c7-1e8d-476e-a2ff-d03d82cacd2d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-kb6tc\" (UID: \"260b30c7-1e8d-476e-a2ff-d03d82cacd2d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" Jul 10 12:47:49.608056 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.608032 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz26f\" (UniqueName: \"kubernetes.io/projected/260b30c7-1e8d-476e-a2ff-d03d82cacd2d-kube-api-access-cz26f\") pod \"monitoring-plugin-5f68df7f58-kb6tc\" (UID: \"260b30c7-1e8d-476e-a2ff-d03d82cacd2d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" Jul 10 12:47:49.675090 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.675003 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" Jul 10 12:47:49.736793 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.736717 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc76976bb-7m4gm" event={"ID":"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2","Type":"ContainerStarted","Data":"b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca"} Jul 10 12:47:49.804469 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.804413 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cc76976bb-7m4gm" podStartSLOduration=1.897983885 podStartE2EDuration="4.804393268s" totalImagesPullingTime="2.906409383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:49.757031725 +0000 UTC m=+96.988142161" watchObservedRunningTime="2026-07-10 12:47:49.804393268 +0000 UTC m=+97.035503700" Jul 10 12:47:49.804998 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:49.804984 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc"] Jul 10 12:47:49.807462 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:49.807430 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260b30c7_1e8d_476e_a2ff_d03d82cacd2d.slice/crio-94bd936b3ce13ecce1faad2484f7fcc2cb0f5e13fbbce645d3143e3bb6e03715 WatchSource:0}: Error finding container 94bd936b3ce13ecce1faad2484f7fcc2cb0f5e13fbbce645d3143e3bb6e03715: Status 404 returned error can't find the container with id 94bd936b3ce13ecce1faad2484f7fcc2cb0f5e13fbbce645d3143e3bb6e03715 Jul 10 12:47:50.742085 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.742035 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" event={"ID":"260b30c7-1e8d-476e-a2ff-d03d82cacd2d","Type":"ContainerStarted","Data":"94bd936b3ce13ecce1faad2484f7fcc2cb0f5e13fbbce645d3143e3bb6e03715"} Jul 10 12:47:50.804453 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.804422 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 12:47:50.808234 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.808211 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.812005 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.811982 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 12:47:50.812126 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.812058 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 12:47:50.812126 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.812088 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 12:47:50.812383 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.812364 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 12:47:50.812383 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.812375 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 12:47:50.813112 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.813074 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 12:47:50.813112 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.813088 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 12:47:50.813271 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.813132 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 12:47:50.813271 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.813090 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 12:47:50.813271 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.813074 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 12:47:50.813443 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.813137 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 12:47:50.815469 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.813923 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 12:47:50.815469 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.813975 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 12:47:50.815469 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.814012 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-epeit672rgaku\"" Jul 10 12:47:50.815469 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.814978 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p5rln\"" Jul 10 12:47:50.821448 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.821249 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 12:47:50.824318 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.824289 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 12:47:50.826845 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.826808 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 12:47:50.911248 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.911200 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.911423 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.911258 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-config\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.911423 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.911303 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bd32953-c90f-41b4-95d4-2c3cf759457c-config-out\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.911423 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.911369 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52l2g\" (UniqueName: \"kubernetes.io/projected/5bd32953-c90f-41b4-95d4-2c3cf759457c-kube-api-access-52l2g\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.911632 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.911595 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.911718 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.911639 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912157 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.911812 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912157 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.911871 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bd32953-c90f-41b4-95d4-2c3cf759457c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912157 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.911900 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912157 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.911925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912157 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.911992 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912157 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.912023 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-web-config\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912157 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.912049 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912157 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.912095 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912157 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.912127 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912584 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.912171 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912584 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.912191 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912584 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.912226 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912584 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.912252 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:50.912584 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:50.912278 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013031 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.012951 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013031 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.012994 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013031 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013017 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-config\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013295 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013047 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bd32953-c90f-41b4-95d4-2c3cf759457c-config-out\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013295 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013064 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52l2g\" (UniqueName: \"kubernetes.io/projected/5bd32953-c90f-41b4-95d4-2c3cf759457c-kube-api-access-52l2g\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013295 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013100 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013295 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013295 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013153 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013295 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013189 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bd32953-c90f-41b4-95d4-2c3cf759457c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013295 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013214 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013295 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013241 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013295 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013278 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013295 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013300 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-web-config\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013917 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013323 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013917 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013375 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013917 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013429 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.013917 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.013792 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.014138 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.014114 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.014197 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.014121 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.014253 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.014234 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.015024 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.014716 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.016033 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.016005 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bd32953-c90f-41b4-95d4-2c3cf759457c-config-out\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.016129 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.016067 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.016129 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.016117 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.016246 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.016142 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.016246 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.016168 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.016246 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.016193 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.016767 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.016738 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.016865 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.016837 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.016964 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.016941 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-web-config\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.017030 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.016957 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.017030 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.016945 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bd32953-c90f-41b4-95d4-2c3cf759457c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.017454 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.017405 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.018458 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.018432 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-config\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.018641 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.018618 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.019397 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.019376 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.019464 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.019395 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.019464 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.019423 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.019464 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.019423 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.021488 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.021471 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52l2g\" (UniqueName: \"kubernetes.io/projected/5bd32953-c90f-41b4-95d4-2c3cf759457c-kube-api-access-52l2g\") pod \"prometheus-k8s-0\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.122481 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.122450 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:47:51.260529 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.260496 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 12:47:51.264438 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:47:51.264380 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd32953_c90f_41b4_95d4_2c3cf759457c.slice/crio-322dce121ddad773a7c902d0047ddfdc63d66c6a92622f082e16406c0dc16d1c WatchSource:0}: Error finding container 322dce121ddad773a7c902d0047ddfdc63d66c6a92622f082e16406c0dc16d1c: Status 404 returned error can't find the container with id 322dce121ddad773a7c902d0047ddfdc63d66c6a92622f082e16406c0dc16d1c Jul 10 12:47:51.747123 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.747084 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" event={"ID":"260b30c7-1e8d-476e-a2ff-d03d82cacd2d","Type":"ContainerStarted","Data":"185e94fb66a26eb83ad529103ea6bc0cbf551c4fa3d6451f3751786b54e22d0a"} Jul 10 12:47:51.747606 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.747256 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" Jul 10 12:47:51.748397 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.748378 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerStarted","Data":"322dce121ddad773a7c902d0047ddfdc63d66c6a92622f082e16406c0dc16d1c"} Jul 10 12:47:51.752637 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.752612 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" Jul 10 12:47:51.764530 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:51.764490 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-kb6tc" podStartSLOduration=1.505957341 podStartE2EDuration="2.764474517s" totalImagesPullingTime="1.258517176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:51.76315905 +0000 UTC m=+98.994269484" watchObservedRunningTime="2026-07-10 12:47:51.764474517 +0000 UTC m=+98.995584953" Jul 10 12:47:52.753065 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:52.753029 2557 generic.go:356] "Generic (PLEG): container finished" podID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerID="96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917" exitCode=0 Jul 10 12:47:52.753511 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:52.753066 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerDied","Data":"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917"} Jul 10 12:47:53.547474 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:53.547443 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc76976bb-7m4gm"] Jul 10 12:47:56.321903 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:56.321881 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:47:56.770231 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:56.770191 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerStarted","Data":"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df"} Jul 10 12:47:56.770414 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:56.770271 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerStarted","Data":"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04"} Jul 10 12:47:57.616478 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:57.616449 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kg958" Jul 10 12:47:58.683398 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:58.683368 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fc9888469-9tfxz" Jul 10 12:47:58.780367 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:58.780323 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerStarted","Data":"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3"} Jul 10 12:47:58.780522 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:58.780430 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerStarted","Data":"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e"} Jul 10 12:47:58.780522 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:58.780461 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerStarted","Data":"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde"} Jul 10 12:47:58.780522 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:58.780484 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerStarted","Data":"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7"} Jul 10 12:47:58.809283 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:47:58.809234 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.235412244 podStartE2EDuration="8.809217463s" totalImagesPullingTime="6.554307111s" totalInitContainerRuntime="19.498108ms" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:58.808204027 +0000 UTC m=+106.039314498" watchObservedRunningTime="2026-07-10 12:47:58.809217463 +0000 UTC m=+106.040327895" Jul 10 12:48:01.122908 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:01.122870 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:48:09.822197 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:09.822163 2557 generic.go:356] "Generic (PLEG): container finished" podID="df1de48b-6ecb-477b-8313-2d7070554708" containerID="45701e55897707e93b5b997d49185ea114921760783afba75b8e6c8360d7a1f2" exitCode=0 Jul 10 12:48:09.822610 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:09.822237 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" event={"ID":"df1de48b-6ecb-477b-8313-2d7070554708","Type":"ContainerDied","Data":"45701e55897707e93b5b997d49185ea114921760783afba75b8e6c8360d7a1f2"} Jul 10 12:48:09.822610 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:09.822598 2557 scope.go:117] "RemoveContainer" containerID="45701e55897707e93b5b997d49185ea114921760783afba75b8e6c8360d7a1f2" Jul 10 12:48:10.547476 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:10.547450 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wg7m4_a4e5935e-a766-4c5e-8bb2-5b12c48ade14/serve-healthcheck-canary/0.log" Jul 10 12:48:10.830273 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:10.830193 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-bb72g" event={"ID":"df1de48b-6ecb-477b-8313-2d7070554708","Type":"ContainerStarted","Data":"e91e643ff6dc1287b168152f7e66fdfa9bfcbb0637bea9e26ffc1edf37e0a79e"} Jul 10 12:48:18.573398 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.573303 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cc76976bb-7m4gm" podUID="33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" containerName="console" containerID="cri-o://b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca" gracePeriod=15 Jul 10 12:48:18.814944 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.814922 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:48:18.858981 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.858905 2557 generic.go:356] "Generic (PLEG): container finished" podID="33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" containerID="b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca" exitCode=0 Jul 10 12:48:18.858981 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.858952 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc76976bb-7m4gm" Jul 10 12:48:18.859156 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.858976 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc76976bb-7m4gm" event={"ID":"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2","Type":"ContainerDied","Data":"b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca"} Jul 10 12:48:18.859156 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.859023 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc76976bb-7m4gm" event={"ID":"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2","Type":"ContainerDied","Data":"16fd362fb87555f23e4edf8d10eaddfdc5c52762ef2d44bf15468df215080550"} Jul 10 12:48:18.859156 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.859043 2557 scope.go:117] "RemoveContainer" containerID="b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca" Jul 10 12:48:18.867561 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.867537 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-config\") pod \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " Jul 10 12:48:18.867662 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.867577 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9zs2\" (UniqueName: \"kubernetes.io/projected/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-kube-api-access-l9zs2\") pod \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " Jul 10 12:48:18.867662 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.867611 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-trusted-ca-bundle\") pod \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " Jul 10 12:48:18.867775 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.867680 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-oauth-config\") pod \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " Jul 10 12:48:18.867775 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.867735 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-service-ca\") pod \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " Jul 10 12:48:18.867775 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.867757 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-serving-cert\") pod \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " Jul 10 12:48:18.867917 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.867796 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-oauth-serving-cert\") pod \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\" (UID: \"33b752e6-6363-4ee6-bbfb-5fd25e26c2c2\") " Jul 10 12:48:18.868032 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.868008 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-config" (OuterVolumeSpecName: "console-config") pod "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" (UID: "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:48:18.868112 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.868047 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" (UID: "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:48:18.868368 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.868325 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" (UID: "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:48:18.868482 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.868364 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-service-ca" (OuterVolumeSpecName: "service-ca") pod "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" (UID: "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:48:18.868710 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.868694 2557 scope.go:117] "RemoveContainer" containerID="b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca" Jul 10 12:48:18.869026 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:48:18.869006 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca\": container with ID starting with b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca not found: ID does not exist" containerID="b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca" Jul 10 12:48:18.869080 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.869033 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca"} err="failed to get container status \"b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca\": rpc error: code = NotFound desc = could not find container \"b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca\": container with ID starting with b6408b5b27beb067e4ec11a4b8a63ad106330f2601f32f1e66e2098e599a92ca not found: ID does not exist" Jul 10 12:48:18.870229 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.870210 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" (UID: "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:48:18.870368 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.870338 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-kube-api-access-l9zs2" (OuterVolumeSpecName: "kube-api-access-l9zs2") pod "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" (UID: "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2"). InnerVolumeSpecName "kube-api-access-l9zs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 12:48:18.870516 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.870502 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" (UID: "33b752e6-6363-4ee6-bbfb-5fd25e26c2c2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:48:18.968668 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.968631 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:48:18.968668 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.968663 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-serving-cert\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:48:18.968668 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.968673 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-oauth-serving-cert\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:48:18.968889 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.968681 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-config\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:48:18.968889 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.968690 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9zs2\" (UniqueName: \"kubernetes.io/projected/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-kube-api-access-l9zs2\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:48:18.968889 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.968698 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-trusted-ca-bundle\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:48:18.968889 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:18.968706 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2-console-oauth-config\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:48:19.180204 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:19.180172 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc76976bb-7m4gm"] Jul 10 12:48:19.183813 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:19.183787 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cc76976bb-7m4gm"] Jul 10 12:48:19.265544 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:19.265516 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" path="/var/lib/kubelet/pods/33b752e6-6363-4ee6-bbfb-5fd25e26c2c2/volumes" Jul 10 12:48:23.107132 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:23.107089 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:48:23.110328 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:23.110292 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b-metrics-certs\") pod \"network-metrics-daemon-rtskf\" (UID: \"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b\") " pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:48:23.174915 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:23.174887 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pmvx9\"" Jul 10 12:48:23.182796 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:23.182762 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtskf" Jul 10 12:48:23.350753 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:23.350701 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rtskf"] Jul 10 12:48:23.354545 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:48:23.354514 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c1154a_eabf_4e6e_8e0a_9e5fb098f04b.slice/crio-fea52499b3894be7e24825eea5cf8e3533e36e3b444452cc4dafdd353ff67410 WatchSource:0}: Error finding container fea52499b3894be7e24825eea5cf8e3533e36e3b444452cc4dafdd353ff67410: Status 404 returned error can't find the container with id fea52499b3894be7e24825eea5cf8e3533e36e3b444452cc4dafdd353ff67410 Jul 10 12:48:23.883202 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:23.883170 2557 generic.go:356] "Generic (PLEG): container finished" podID="f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429" containerID="a9ba0d9b8fc057bd2b7d2837b6113356c1d074e76b8277a16541962f20debd87" exitCode=0 Jul 10 12:48:23.883407 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:23.883260 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" event={"ID":"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429","Type":"ContainerDied","Data":"a9ba0d9b8fc057bd2b7d2837b6113356c1d074e76b8277a16541962f20debd87"} Jul 10 12:48:23.883654 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:23.883635 2557 scope.go:117] "RemoveContainer" containerID="a9ba0d9b8fc057bd2b7d2837b6113356c1d074e76b8277a16541962f20debd87" Jul 10 12:48:23.884755 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:23.884726 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rtskf" event={"ID":"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b","Type":"ContainerStarted","Data":"fea52499b3894be7e24825eea5cf8e3533e36e3b444452cc4dafdd353ff67410"} Jul 10 12:48:24.890637 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:24.890596 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rtskf" event={"ID":"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b","Type":"ContainerStarted","Data":"b88b5b75cd35515942504a0df97784e86253b35491c7b03a57fb0628d977cc63"} Jul 10 12:48:24.891092 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:24.890661 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rtskf" event={"ID":"c2c1154a-eabf-4e6e-8e0a-9e5fb098f04b","Type":"ContainerStarted","Data":"d41edd81541e49794c8cbfba44bfcbbc895fd330404d4f9570d80c5c521e0c11"} Jul 10 12:48:24.892380 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:24.892340 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxg9v" event={"ID":"f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429","Type":"ContainerStarted","Data":"ab63fe757b39e851ca85782d20bc7c6337c9388fa8f93fd44dbe21576bb6f7ba"} Jul 10 12:48:24.908273 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:24.908229 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rtskf" podStartSLOduration=130.963460825 podStartE2EDuration="2m11.908214451s" totalImagesPullingTime="944.753626ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:48:24.906447078 +0000 UTC m=+132.137557511" watchObservedRunningTime="2026-07-10 12:48:24.908214451 +0000 UTC m=+132.139324883" Jul 10 12:48:44.965461 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:44.965429 2557 generic.go:356] "Generic (PLEG): container finished" podID="d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f" containerID="8324a7601e1def5fd32cb021210eacd01d63f52e9d041c84a88c4f32944aaebd" exitCode=0 Jul 10 12:48:44.965829 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:44.965509 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" event={"ID":"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f","Type":"ContainerDied","Data":"8324a7601e1def5fd32cb021210eacd01d63f52e9d041c84a88c4f32944aaebd"} Jul 10 12:48:44.965829 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:44.965812 2557 scope.go:117] "RemoveContainer" containerID="8324a7601e1def5fd32cb021210eacd01d63f52e9d041c84a88c4f32944aaebd" Jul 10 12:48:45.970410 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:45.970378 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-54c8p" event={"ID":"d8be39b1-f6bf-47ee-b0a8-0bc3729aa67f","Type":"ContainerStarted","Data":"577d981e3a999c11acef1145ff460a36ed29e7c451ea353d8e5e8bbc23545b2d"} Jul 10 12:48:51.123499 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:51.123467 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:48:51.142488 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:51.142458 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:48:52.008177 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:48:52.008148 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:09.222932 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.222851 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 12:49:09.223440 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.223153 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="prometheus" containerID="cri-o://a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04" gracePeriod=600 Jul 10 12:49:09.223440 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.223153 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="kube-rbac-proxy" containerID="cri-o://52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e" gracePeriod=600 Jul 10 12:49:09.223440 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.223220 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="config-reloader" containerID="cri-o://930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df" gracePeriod=600 Jul 10 12:49:09.223440 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.223222 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3" gracePeriod=600 Jul 10 12:49:09.223440 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.223247 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="kube-rbac-proxy-web" containerID="cri-o://aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde" gracePeriod=600 Jul 10 12:49:09.223440 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.223222 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="thanos-sidecar" containerID="cri-o://66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7" gracePeriod=600 Jul 10 12:49:09.460279 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.460253 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:09.606765 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.606661 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.606765 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.606716 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-kubelet-serving-ca-bundle\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.606765 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.606739 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52l2g\" (UniqueName: \"kubernetes.io/projected/5bd32953-c90f-41b4-95d4-2c3cf759457c-kube-api-access-52l2g\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.606765 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.606760 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-metrics-client-ca\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607103 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.606874 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-tls\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607103 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.606922 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bd32953-c90f-41b4-95d4-2c3cf759457c-tls-assets\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607103 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.606961 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-serving-certs-ca-bundle\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607103 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.606996 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-0\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607103 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607025 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-grpc-tls\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607103 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607057 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-metrics-client-certs\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607103 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607082 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-db\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607120 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-1\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607140 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:49:09.607470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607157 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607181 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:49:09.607470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607208 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-kube-rbac-proxy\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607247 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-web-config\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607279 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-2\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607314 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bd32953-c90f-41b4-95d4-2c3cf759457c-config-out\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607381 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-thanos-prometheus-http-client-file\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607416 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-config\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607442 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-trusted-ca-bundle\") pod \"5bd32953-c90f-41b4-95d4-2c3cf759457c\" (UID: \"5bd32953-c90f-41b4-95d4-2c3cf759457c\") " Jul 10 12:49:09.607974 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607551 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:49:09.607974 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607713 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.607974 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607841 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-metrics-client-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.607974 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607858 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.607974 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.607945 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:49:09.608314 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.608294 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:49:09.608581 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.608548 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 12:49:09.608670 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.608620 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:49:09.609651 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.609619 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:49:09.609755 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.609689 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bd32953-c90f-41b4-95d4-2c3cf759457c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 12:49:09.609755 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.609701 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bd32953-c90f-41b4-95d4-2c3cf759457c-kube-api-access-52l2g" (OuterVolumeSpecName: "kube-api-access-52l2g") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "kube-api-access-52l2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 12:49:09.610108 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.610082 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:49:09.610931 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.610896 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bd32953-c90f-41b4-95d4-2c3cf759457c-config-out" (OuterVolumeSpecName: "config-out") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 12:49:09.611142 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.611109 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:49:09.611399 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.611335 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:49:09.611503 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.611424 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:49:09.611739 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.611713 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:49:09.611933 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.611910 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:49:09.612251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.612231 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:49:09.612734 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.612716 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-config" (OuterVolumeSpecName: "config") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:49:09.620966 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.620940 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-web-config" (OuterVolumeSpecName: "web-config") pod "5bd32953-c90f-41b4-95d4-2c3cf759457c" (UID: "5bd32953-c90f-41b4-95d4-2c3cf759457c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:49:09.708546 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708496 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bd32953-c90f-41b4-95d4-2c3cf759457c-tls-assets\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708546 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708540 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708546 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708553 2557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-grpc-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708546 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708562 2557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-metrics-client-certs\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708572 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-db\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708581 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708590 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708600 2557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-kube-rbac-proxy\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708608 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-web-config\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708615 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708625 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bd32953-c90f-41b4-95d4-2c3cf759457c-config-out\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708634 2557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708642 2557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-config\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708650 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bd32953-c90f-41b4-95d4-2c3cf759457c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708658 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708668 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52l2g\" (UniqueName: \"kubernetes.io/projected/5bd32953-c90f-41b4-95d4-2c3cf759457c-kube-api-access-52l2g\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:09.708799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:09.708679 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bd32953-c90f-41b4-95d4-2c3cf759457c-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:49:10.058242 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058209 2557 generic.go:356] "Generic (PLEG): container finished" podID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerID="65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3" exitCode=0 Jul 10 12:49:10.058242 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058233 2557 generic.go:356] "Generic (PLEG): container finished" podID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerID="52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e" exitCode=0 Jul 10 12:49:10.058242 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058239 2557 generic.go:356] "Generic (PLEG): container finished" podID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerID="aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde" exitCode=0 Jul 10 12:49:10.058242 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058245 2557 generic.go:356] "Generic (PLEG): container finished" podID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerID="66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7" exitCode=0 Jul 10 12:49:10.058242 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058250 2557 generic.go:356] "Generic (PLEG): container finished" podID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerID="930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df" exitCode=0 Jul 10 12:49:10.058242 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058255 2557 generic.go:356] "Generic (PLEG): container finished" podID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerID="a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04" exitCode=0 Jul 10 12:49:10.058670 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058273 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerDied","Data":"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3"} Jul 10 12:49:10.058670 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058286 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.058670 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058329 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerDied","Data":"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e"} Jul 10 12:49:10.058670 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058382 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerDied","Data":"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde"} Jul 10 12:49:10.058670 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058410 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerDied","Data":"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7"} Jul 10 12:49:10.058670 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058415 2557 scope.go:117] "RemoveContainer" containerID="65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3" Jul 10 12:49:10.058670 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058433 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerDied","Data":"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df"} Jul 10 12:49:10.058670 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058458 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerDied","Data":"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04"} Jul 10 12:49:10.058670 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.058480 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bd32953-c90f-41b4-95d4-2c3cf759457c","Type":"ContainerDied","Data":"322dce121ddad773a7c902d0047ddfdc63d66c6a92622f082e16406c0dc16d1c"} Jul 10 12:49:10.068354 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.068327 2557 scope.go:117] "RemoveContainer" containerID="52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e" Jul 10 12:49:10.075840 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.075823 2557 scope.go:117] "RemoveContainer" containerID="aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde" Jul 10 12:49:10.082728 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.082711 2557 scope.go:117] "RemoveContainer" containerID="66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7" Jul 10 12:49:10.085052 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.085028 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 12:49:10.088486 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.088463 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 12:49:10.090906 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.090891 2557 scope.go:117] "RemoveContainer" containerID="930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df" Jul 10 12:49:10.097735 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.097710 2557 scope.go:117] "RemoveContainer" containerID="a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04" Jul 10 12:49:10.105139 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.105122 2557 scope.go:117] "RemoveContainer" containerID="96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917" Jul 10 12:49:10.112063 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.112042 2557 scope.go:117] "RemoveContainer" containerID="65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3" Jul 10 12:49:10.112324 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:49:10.112310 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": container with ID starting with 65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3 not found: ID does not exist" containerID="65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3" Jul 10 12:49:10.112388 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.112333 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3"} err="failed to get container status \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": rpc error: code = NotFound desc = could not find container \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": container with ID starting with 65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3 not found: ID does not exist" Jul 10 12:49:10.112388 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.112371 2557 scope.go:117] "RemoveContainer" containerID="52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e" Jul 10 12:49:10.112603 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:49:10.112588 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": container with ID starting with 52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e not found: ID does not exist" containerID="52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e" Jul 10 12:49:10.112643 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.112608 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e"} err="failed to get container status \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": rpc error: code = NotFound desc = could not find container \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": container with ID starting with 52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e not found: ID does not exist" Jul 10 12:49:10.112643 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.112624 2557 scope.go:117] "RemoveContainer" containerID="aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde" Jul 10 12:49:10.112840 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:49:10.112822 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": container with ID starting with aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde not found: ID does not exist" containerID="aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde" Jul 10 12:49:10.112885 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.112849 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde"} err="failed to get container status \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": rpc error: code = NotFound desc = could not find container \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": container with ID starting with aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde not found: ID does not exist" Jul 10 12:49:10.112885 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.112866 2557 scope.go:117] "RemoveContainer" containerID="66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7" Jul 10 12:49:10.113116 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:49:10.113098 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": container with ID starting with 66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7 not found: ID does not exist" containerID="66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7" Jul 10 12:49:10.113183 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.113122 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7"} err="failed to get container status \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": rpc error: code = NotFound desc = could not find container \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": container with ID starting with 66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7 not found: ID does not exist" Jul 10 12:49:10.113183 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.113143 2557 scope.go:117] "RemoveContainer" containerID="930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df" Jul 10 12:49:10.113418 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:49:10.113399 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": container with ID starting with 930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df not found: ID does not exist" containerID="930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df" Jul 10 12:49:10.113484 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.113424 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df"} err="failed to get container status \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": rpc error: code = NotFound desc = could not find container \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": container with ID starting with 930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df not found: ID does not exist" Jul 10 12:49:10.113484 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.113437 2557 scope.go:117] "RemoveContainer" containerID="a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04" Jul 10 12:49:10.113805 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:49:10.113791 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": container with ID starting with a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04 not found: ID does not exist" containerID="a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04" Jul 10 12:49:10.113847 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.113809 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04"} err="failed to get container status \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": rpc error: code = NotFound desc = could not find container \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": container with ID starting with a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04 not found: ID does not exist" Jul 10 12:49:10.113847 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.113820 2557 scope.go:117] "RemoveContainer" containerID="96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917" Jul 10 12:49:10.114027 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:49:10.114007 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": container with ID starting with 96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917 not found: ID does not exist" containerID="96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917" Jul 10 12:49:10.114066 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.114031 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917"} err="failed to get container status \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": rpc error: code = NotFound desc = could not find container \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": container with ID starting with 96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917 not found: ID does not exist" Jul 10 12:49:10.114066 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.114043 2557 scope.go:117] "RemoveContainer" containerID="65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3" Jul 10 12:49:10.114245 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.114228 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3"} err="failed to get container status \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": rpc error: code = NotFound desc = could not find container \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": container with ID starting with 65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3 not found: ID does not exist" Jul 10 12:49:10.114289 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.114254 2557 scope.go:117] "RemoveContainer" containerID="52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e" Jul 10 12:49:10.114463 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.114447 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e"} err="failed to get container status \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": rpc error: code = NotFound desc = could not find container \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": container with ID starting with 52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e not found: ID does not exist" Jul 10 12:49:10.114506 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.114464 2557 scope.go:117] "RemoveContainer" containerID="aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde" Jul 10 12:49:10.114654 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.114637 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde"} err="failed to get container status \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": rpc error: code = NotFound desc = could not find container \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": container with ID starting with aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde not found: ID does not exist" Jul 10 12:49:10.114692 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.114655 2557 scope.go:117] "RemoveContainer" containerID="66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7" Jul 10 12:49:10.114884 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.114869 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7"} err="failed to get container status \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": rpc error: code = NotFound desc = could not find container \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": container with ID starting with 66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7 not found: ID does not exist" Jul 10 12:49:10.114925 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.114885 2557 scope.go:117] "RemoveContainer" containerID="930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df" Jul 10 12:49:10.115066 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.115049 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df"} err="failed to get container status \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": rpc error: code = NotFound desc = could not find container \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": container with ID starting with 930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df not found: ID does not exist" Jul 10 12:49:10.115112 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.115068 2557 scope.go:117] "RemoveContainer" containerID="a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04" Jul 10 12:49:10.115291 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.115275 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04"} err="failed to get container status \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": rpc error: code = NotFound desc = could not find container \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": container with ID starting with a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04 not found: ID does not exist" Jul 10 12:49:10.115291 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.115289 2557 scope.go:117] "RemoveContainer" containerID="96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917" Jul 10 12:49:10.115474 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.115457 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917"} err="failed to get container status \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": rpc error: code = NotFound desc = could not find container \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": container with ID starting with 96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917 not found: ID does not exist" Jul 10 12:49:10.115516 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.115476 2557 scope.go:117] "RemoveContainer" containerID="65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3" Jul 10 12:49:10.115711 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.115688 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3"} err="failed to get container status \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": rpc error: code = NotFound desc = could not find container \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": container with ID starting with 65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3 not found: ID does not exist" Jul 10 12:49:10.115766 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.115711 2557 scope.go:117] "RemoveContainer" containerID="52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e" Jul 10 12:49:10.115947 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.115917 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e"} err="failed to get container status \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": rpc error: code = NotFound desc = could not find container \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": container with ID starting with 52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e not found: ID does not exist" Jul 10 12:49:10.115947 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.115938 2557 scope.go:117] "RemoveContainer" containerID="aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde" Jul 10 12:49:10.116190 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.116174 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde"} err="failed to get container status \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": rpc error: code = NotFound desc = could not find container \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": container with ID starting with aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde not found: ID does not exist" Jul 10 12:49:10.116261 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.116192 2557 scope.go:117] "RemoveContainer" containerID="66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7" Jul 10 12:49:10.116465 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.116447 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7"} err="failed to get container status \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": rpc error: code = NotFound desc = could not find container \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": container with ID starting with 66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7 not found: ID does not exist" Jul 10 12:49:10.116535 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.116466 2557 scope.go:117] "RemoveContainer" containerID="930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df" Jul 10 12:49:10.116680 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.116663 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df"} err="failed to get container status \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": rpc error: code = NotFound desc = could not find container \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": container with ID starting with 930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df not found: ID does not exist" Jul 10 12:49:10.116728 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.116681 2557 scope.go:117] "RemoveContainer" containerID="a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04" Jul 10 12:49:10.116861 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.116839 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04"} err="failed to get container status \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": rpc error: code = NotFound desc = could not find container \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": container with ID starting with a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04 not found: ID does not exist" Jul 10 12:49:10.116928 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.116864 2557 scope.go:117] "RemoveContainer" containerID="96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917" Jul 10 12:49:10.117094 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.117078 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917"} err="failed to get container status \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": rpc error: code = NotFound desc = could not find container \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": container with ID starting with 96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917 not found: ID does not exist" Jul 10 12:49:10.117135 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.117095 2557 scope.go:117] "RemoveContainer" containerID="65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3" Jul 10 12:49:10.117306 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.117285 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3"} err="failed to get container status \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": rpc error: code = NotFound desc = could not find container \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": container with ID starting with 65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3 not found: ID does not exist" Jul 10 12:49:10.117306 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.117305 2557 scope.go:117] "RemoveContainer" containerID="52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e" Jul 10 12:49:10.117525 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.117509 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e"} err="failed to get container status \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": rpc error: code = NotFound desc = could not find container \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": container with ID starting with 52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e not found: ID does not exist" Jul 10 12:49:10.117569 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.117525 2557 scope.go:117] "RemoveContainer" containerID="aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde" Jul 10 12:49:10.117711 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.117696 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde"} err="failed to get container status \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": rpc error: code = NotFound desc = could not find container \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": container with ID starting with aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde not found: ID does not exist" Jul 10 12:49:10.117750 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.117711 2557 scope.go:117] "RemoveContainer" containerID="66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7" Jul 10 12:49:10.117890 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.117875 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7"} err="failed to get container status \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": rpc error: code = NotFound desc = could not find container \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": container with ID starting with 66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7 not found: ID does not exist" Jul 10 12:49:10.117890 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.117889 2557 scope.go:117] "RemoveContainer" containerID="930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df" Jul 10 12:49:10.118049 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.118033 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df"} err="failed to get container status \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": rpc error: code = NotFound desc = could not find container \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": container with ID starting with 930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df not found: ID does not exist" Jul 10 12:49:10.118089 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.118049 2557 scope.go:117] "RemoveContainer" containerID="a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04" Jul 10 12:49:10.118221 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.118203 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04"} err="failed to get container status \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": rpc error: code = NotFound desc = could not find container \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": container with ID starting with a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04 not found: ID does not exist" Jul 10 12:49:10.118261 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.118222 2557 scope.go:117] "RemoveContainer" containerID="96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917" Jul 10 12:49:10.118434 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.118412 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917"} err="failed to get container status \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": rpc error: code = NotFound desc = could not find container \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": container with ID starting with 96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917 not found: ID does not exist" Jul 10 12:49:10.118512 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.118435 2557 scope.go:117] "RemoveContainer" containerID="65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3" Jul 10 12:49:10.118925 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.118903 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3"} err="failed to get container status \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": rpc error: code = NotFound desc = could not find container \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": container with ID starting with 65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3 not found: ID does not exist" Jul 10 12:49:10.118925 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.118923 2557 scope.go:117] "RemoveContainer" containerID="52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e" Jul 10 12:49:10.119211 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.119188 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e"} err="failed to get container status \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": rpc error: code = NotFound desc = could not find container \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": container with ID starting with 52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e not found: ID does not exist" Jul 10 12:49:10.119211 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.119211 2557 scope.go:117] "RemoveContainer" containerID="aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde" Jul 10 12:49:10.119490 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.119465 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde"} err="failed to get container status \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": rpc error: code = NotFound desc = could not find container \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": container with ID starting with aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde not found: ID does not exist" Jul 10 12:49:10.119563 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.119492 2557 scope.go:117] "RemoveContainer" containerID="66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7" Jul 10 12:49:10.119752 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.119721 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7"} err="failed to get container status \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": rpc error: code = NotFound desc = could not find container \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": container with ID starting with 66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7 not found: ID does not exist" Jul 10 12:49:10.119752 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.119745 2557 scope.go:117] "RemoveContainer" containerID="930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df" Jul 10 12:49:10.119959 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.119938 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df"} err="failed to get container status \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": rpc error: code = NotFound desc = could not find container \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": container with ID starting with 930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df not found: ID does not exist" Jul 10 12:49:10.119959 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.119959 2557 scope.go:117] "RemoveContainer" containerID="a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04" Jul 10 12:49:10.120139 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.120121 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04"} err="failed to get container status \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": rpc error: code = NotFound desc = could not find container \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": container with ID starting with a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04 not found: ID does not exist" Jul 10 12:49:10.120191 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.120140 2557 scope.go:117] "RemoveContainer" containerID="96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917" Jul 10 12:49:10.120396 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.120378 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917"} err="failed to get container status \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": rpc error: code = NotFound desc = could not find container \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": container with ID starting with 96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917 not found: ID does not exist" Jul 10 12:49:10.120461 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.120398 2557 scope.go:117] "RemoveContainer" containerID="65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3" Jul 10 12:49:10.120640 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.120616 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3"} err="failed to get container status \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": rpc error: code = NotFound desc = could not find container \"65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3\": container with ID starting with 65a124d325cc17bd239963da273a1e458e8b454acec89f3dca4ba81af03cb2c3 not found: ID does not exist" Jul 10 12:49:10.120640 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.120635 2557 scope.go:117] "RemoveContainer" containerID="52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e" Jul 10 12:49:10.120779 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.120758 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 12:49:10.120882 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.120857 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e"} err="failed to get container status \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": rpc error: code = NotFound desc = could not find container \"52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e\": container with ID starting with 52dc548680c7bfbba3a83548b004d46e22af60456974b8833d025598cbf9425e not found: ID does not exist" Jul 10 12:49:10.120925 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.120882 2557 scope.go:117] "RemoveContainer" containerID="aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde" Jul 10 12:49:10.121045 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121031 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="thanos-sidecar" Jul 10 12:49:10.121081 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121049 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="thanos-sidecar" Jul 10 12:49:10.121081 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121058 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="prometheus" Jul 10 12:49:10.121081 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121064 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="prometheus" Jul 10 12:49:10.121081 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121073 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="kube-rbac-proxy-thanos" Jul 10 12:49:10.121081 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121078 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="kube-rbac-proxy-thanos" Jul 10 12:49:10.121251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121085 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="kube-rbac-proxy-web" Jul 10 12:49:10.121251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121083 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde"} err="failed to get container status \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": rpc error: code = NotFound desc = could not find container \"aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde\": container with ID starting with aa51a18ff6be438def5661d65fb91976c01129cdf6c6e9764d9113e5ce7e8fde not found: ID does not exist" Jul 10 12:49:10.121251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121103 2557 scope.go:117] "RemoveContainer" containerID="66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7" Jul 10 12:49:10.121251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121090 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="kube-rbac-proxy-web" Jul 10 12:49:10.121251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121146 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="config-reloader" Jul 10 12:49:10.121251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121154 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="config-reloader" Jul 10 12:49:10.121251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121170 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="init-config-reloader" Jul 10 12:49:10.121251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121186 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="init-config-reloader" Jul 10 12:49:10.121251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121196 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" containerName="console" Jul 10 12:49:10.121251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121204 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" containerName="console" Jul 10 12:49:10.121251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121216 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="kube-rbac-proxy" Jul 10 12:49:10.121251 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121225 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="kube-rbac-proxy" Jul 10 12:49:10.121644 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121300 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="prometheus" Jul 10 12:49:10.121644 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121311 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="thanos-sidecar" Jul 10 12:49:10.121644 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121316 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="kube-rbac-proxy" Jul 10 12:49:10.121644 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121325 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b752e6-6363-4ee6-bbfb-5fd25e26c2c2" containerName="console" Jul 10 12:49:10.121644 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121333 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="kube-rbac-proxy-web" Jul 10 12:49:10.121644 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121326 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7"} err="failed to get container status \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": rpc error: code = NotFound desc = could not find container \"66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7\": container with ID starting with 66fbf389a02e8e63e87336cbc10160b6e3fb7cb33d221b8d1bb9b685e97d8ec7 not found: ID does not exist" Jul 10 12:49:10.121644 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121343 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="config-reloader" Jul 10 12:49:10.121644 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121378 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" containerName="kube-rbac-proxy-thanos" Jul 10 12:49:10.121644 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.121362 2557 scope.go:117] "RemoveContainer" containerID="930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df" Jul 10 12:49:10.126891 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.126852 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df"} err="failed to get container status \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": rpc error: code = NotFound desc = could not find container \"930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df\": container with ID starting with 930abbb471bc38b44a508ad97a7a41dae7c89d5a862313976b5526c84ffba8df not found: ID does not exist" Jul 10 12:49:10.126891 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.126884 2557 scope.go:117] "RemoveContainer" containerID="a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04" Jul 10 12:49:10.127151 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.127128 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04"} err="failed to get container status \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": rpc error: code = NotFound desc = could not find container \"a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04\": container with ID starting with a46b71921979cff2aae2f07b6157b7207aa0c1e333948e2d6d606bc11e774d04 not found: ID does not exist" Jul 10 12:49:10.127209 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.127154 2557 scope.go:117] "RemoveContainer" containerID="96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917" Jul 10 12:49:10.127418 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.127394 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917"} err="failed to get container status \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": rpc error: code = NotFound desc = could not find container \"96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917\": container with ID starting with 96e49b1ba21f136802a90dc747203b6571ffbccb5883100c4f94ea7adece9917 not found: ID does not exist" Jul 10 12:49:10.129042 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.129025 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.131823 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.131803 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 12:49:10.131990 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.131965 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-epeit672rgaku\"" Jul 10 12:49:10.132101 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132028 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 12:49:10.132101 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132041 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 12:49:10.132101 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132083 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 12:49:10.132101 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132097 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 12:49:10.132306 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132101 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p5rln\"" Jul 10 12:49:10.132306 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132175 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 12:49:10.132306 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132213 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 12:49:10.132476 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132382 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 12:49:10.132476 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132397 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 12:49:10.132579 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132491 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 12:49:10.132579 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132509 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 12:49:10.132579 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132535 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 12:49:10.132709 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.132697 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 12:49:10.135166 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.135147 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 12:49:10.137466 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.137448 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 12:49:10.143770 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.143736 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 12:49:10.211964 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.211930 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.211964 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.211966 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212177 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.211988 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212177 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212018 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212177 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212077 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212177 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212112 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212177 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212136 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212177 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212157 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212177 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212173 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212439 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212205 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-config\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212439 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212223 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fb07461-492a-493e-9dea-d1ec7c40b158-config-out\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212439 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212239 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr8gr\" (UniqueName: \"kubernetes.io/projected/9fb07461-492a-493e-9dea-d1ec7c40b158-kube-api-access-fr8gr\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212439 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212261 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-web-config\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212439 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212291 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fb07461-492a-493e-9dea-d1ec7c40b158-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212439 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212306 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212599 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212443 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212599 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212468 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212599 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212484 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212599 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212508 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.212599 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.212539 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313144 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313046 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313144 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313097 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313144 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313124 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313154 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313174 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313206 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-config\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313228 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fb07461-492a-493e-9dea-d1ec7c40b158-config-out\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313252 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr8gr\" (UniqueName: \"kubernetes.io/projected/9fb07461-492a-493e-9dea-d1ec7c40b158-kube-api-access-fr8gr\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313279 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-web-config\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313310 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fb07461-492a-493e-9dea-d1ec7c40b158-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313333 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313399 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313431 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313455 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313627 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313714 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.313747 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313741 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.314445 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313782 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.314445 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313808 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.314445 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313835 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.314445 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.313877 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.314445 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.314343 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.314781 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.314756 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.315383 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.315314 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.316937 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.316881 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.317165 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.317118 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.317165 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.317151 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.318440 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.317526 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-web-config\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.318440 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.317861 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fb07461-492a-493e-9dea-d1ec7c40b158-config-out\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.318440 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.317954 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.318440 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.318011 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.318440 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.318314 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.318440 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.318397 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.319086 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.318959 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-config\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.319086 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.319046 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.319086 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.319053 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9fb07461-492a-493e-9dea-d1ec7c40b158-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.319662 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.319641 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.319894 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.319875 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fb07461-492a-493e-9dea-d1ec7c40b158-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.319990 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.319971 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9fb07461-492a-493e-9dea-d1ec7c40b158-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.321228 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.321210 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr8gr\" (UniqueName: \"kubernetes.io/projected/9fb07461-492a-493e-9dea-d1ec7c40b158-kube-api-access-fr8gr\") pod \"prometheus-k8s-0\" (UID: \"9fb07461-492a-493e-9dea-d1ec7c40b158\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.439304 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.439262 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:49:10.581882 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:10.581801 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 12:49:10.585017 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:49:10.584991 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb07461_492a_493e_9dea_d1ec7c40b158.slice/crio-750dc09c8c078e894f34b2c14781dc151e27b94a991724c2dbaa81d76b1a3ba1 WatchSource:0}: Error finding container 750dc09c8c078e894f34b2c14781dc151e27b94a991724c2dbaa81d76b1a3ba1: Status 404 returned error can't find the container with id 750dc09c8c078e894f34b2c14781dc151e27b94a991724c2dbaa81d76b1a3ba1 Jul 10 12:49:11.064301 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:11.064265 2557 generic.go:356] "Generic (PLEG): container finished" podID="9fb07461-492a-493e-9dea-d1ec7c40b158" containerID="3f0ac30a274c1979b4947e2efe417d2c424b343b3060a6cd069130ae4bca5e4e" exitCode=0 Jul 10 12:49:11.064528 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:11.064380 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fb07461-492a-493e-9dea-d1ec7c40b158","Type":"ContainerDied","Data":"3f0ac30a274c1979b4947e2efe417d2c424b343b3060a6cd069130ae4bca5e4e"} Jul 10 12:49:11.064528 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:11.064451 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fb07461-492a-493e-9dea-d1ec7c40b158","Type":"ContainerStarted","Data":"750dc09c8c078e894f34b2c14781dc151e27b94a991724c2dbaa81d76b1a3ba1"} Jul 10 12:49:11.268622 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:11.268592 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bd32953-c90f-41b4-95d4-2c3cf759457c" path="/var/lib/kubelet/pods/5bd32953-c90f-41b4-95d4-2c3cf759457c/volumes" Jul 10 12:49:12.072714 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:12.072683 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fb07461-492a-493e-9dea-d1ec7c40b158","Type":"ContainerStarted","Data":"09e3920f1c1a38ccd7e80e6783b4b03bf9d3058ba97de877c747ba7943ef6654"} Jul 10 12:49:12.073137 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:12.072771 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fb07461-492a-493e-9dea-d1ec7c40b158","Type":"ContainerStarted","Data":"7e9c25c05487db18504b7ae1fd2da01c798cebe4f3fa83dae41fc359ffeb07dc"} Jul 10 12:49:12.073137 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:12.072800 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fb07461-492a-493e-9dea-d1ec7c40b158","Type":"ContainerStarted","Data":"e5f9b8d2b1d56d386a269ab57beda2e074df9d91929f51e5248af690b56507aa"} Jul 10 12:49:12.073137 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:12.072836 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fb07461-492a-493e-9dea-d1ec7c40b158","Type":"ContainerStarted","Data":"bcf9c4ccb2b5704dd99e7d8b8abd3dffac4211d56589600a78098e0c38904a4b"} Jul 10 12:49:12.073137 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:12.072864 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fb07461-492a-493e-9dea-d1ec7c40b158","Type":"ContainerStarted","Data":"edbeb912fafa3684697bf520e322e9a51995ce7e8db32cd12e9fc1a2cc4ac19c"} Jul 10 12:49:12.073137 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:12.072887 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9fb07461-492a-493e-9dea-d1ec7c40b158","Type":"ContainerStarted","Data":"c5d4ccb368d96fbde0c371876786541128fb011b8fc3dcde80ec87058a6bf040"} Jul 10 12:49:12.103241 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:12.103176 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.083679545 podStartE2EDuration="2.103154506s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.474961ms" isStatefulPod=false podCreationTimestamp="2026-07-10 12:49:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:49:12.101505439 +0000 UTC m=+179.332615872" watchObservedRunningTime="2026-07-10 12:49:12.103154506 +0000 UTC m=+179.334264940" Jul 10 12:49:15.439871 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:49:15.439822 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:50:10.440150 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:50:10.440117 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:50:10.455211 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:50:10.455184 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:50:11.305961 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:50:11.305928 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 12:51:13.126863 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:13.126837 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 12:51:13.132564 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:13.132541 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 12:51:13.140863 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:13.140836 2557 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 12:51:17.735816 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.735787 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz"] Jul 10 12:51:17.738916 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.738901 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.741586 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.741562 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 12:51:17.741682 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.741562 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 12:51:17.742100 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.742085 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 12:51:17.742206 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.742190 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6rhzd\"" Jul 10 12:51:17.742426 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.742411 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 12:51:17.760274 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.760245 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz"] Jul 10 12:51:17.797700 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.797665 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5853625-f188-46be-86e1-98fb966e3e6c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.797700 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.797698 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f5853625-f188-46be-86e1-98fb966e3e6c-manifests\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.797937 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.797715 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5853625-f188-46be-86e1-98fb966e3e6c-tmp\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.797937 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.797751 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8rtw\" (UniqueName: \"kubernetes.io/projected/f5853625-f188-46be-86e1-98fb966e3e6c-kube-api-access-q8rtw\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.797937 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.797853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f5853625-f188-46be-86e1-98fb966e3e6c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.898661 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.898621 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5853625-f188-46be-86e1-98fb966e3e6c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.898661 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.898660 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f5853625-f188-46be-86e1-98fb966e3e6c-manifests\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.898909 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.898676 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5853625-f188-46be-86e1-98fb966e3e6c-tmp\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.898909 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.898811 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8rtw\" (UniqueName: \"kubernetes.io/projected/f5853625-f188-46be-86e1-98fb966e3e6c-kube-api-access-q8rtw\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.898909 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.898885 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f5853625-f188-46be-86e1-98fb966e3e6c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.899064 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.899005 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f5853625-f188-46be-86e1-98fb966e3e6c-manifests\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.900943 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.900913 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5853625-f188-46be-86e1-98fb966e3e6c-tmp\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.901148 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.901130 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5853625-f188-46be-86e1-98fb966e3e6c-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.901296 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.901275 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f5853625-f188-46be-86e1-98fb966e3e6c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:17.907455 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:17.907423 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8rtw\" (UniqueName: \"kubernetes.io/projected/f5853625-f188-46be-86e1-98fb966e3e6c-kube-api-access-q8rtw\") pod \"opendatahub-operator-controller-manager-7f6798dbc-x6jfz\" (UID: \"f5853625-f188-46be-86e1-98fb966e3e6c\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:18.048709 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:18.048611 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:18.189832 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:18.189809 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz"] Jul 10 12:51:18.191536 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:51:18.191508 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5853625_f188_46be_86e1_98fb966e3e6c.slice/crio-f72ea16eb9fc332698018ae0151b8c9cb2cdda988c8b8261cfc95944d8b14895 WatchSource:0}: Error finding container f72ea16eb9fc332698018ae0151b8c9cb2cdda988c8b8261cfc95944d8b14895: Status 404 returned error can't find the container with id f72ea16eb9fc332698018ae0151b8c9cb2cdda988c8b8261cfc95944d8b14895 Jul 10 12:51:18.193561 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:18.193544 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 12:51:18.533966 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:18.533934 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" event={"ID":"f5853625-f188-46be-86e1-98fb966e3e6c","Type":"ContainerStarted","Data":"f72ea16eb9fc332698018ae0151b8c9cb2cdda988c8b8261cfc95944d8b14895"} Jul 10 12:51:21.549749 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:21.549719 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" event={"ID":"f5853625-f188-46be-86e1-98fb966e3e6c","Type":"ContainerStarted","Data":"61229e4998004e69adfbda53edd7ed8bce1894df0c673b6b6887bf0e005c71d0"} Jul 10 12:51:22.554795 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:22.554693 2557 generic.go:356] "Generic (PLEG): container finished" podID="f5853625-f188-46be-86e1-98fb966e3e6c" containerID="61229e4998004e69adfbda53edd7ed8bce1894df0c673b6b6887bf0e005c71d0" exitCode=0 Jul 10 12:51:22.554795 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:22.554738 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" event={"ID":"f5853625-f188-46be-86e1-98fb966e3e6c","Type":"ContainerDied","Data":"61229e4998004e69adfbda53edd7ed8bce1894df0c673b6b6887bf0e005c71d0"} Jul 10 12:51:23.562519 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:23.562483 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" event={"ID":"f5853625-f188-46be-86e1-98fb966e3e6c","Type":"ContainerStarted","Data":"25220837601e502bac465335f5b5b7881418c72dc4202018d17ac592b750e0b6"} Jul 10 12:51:23.562940 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:23.562565 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:23.584693 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:23.584645 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" podStartSLOduration=2.173764855 podStartE2EDuration="6.584628523s" totalImagesPullingTime="3.337680457s" totalInitContainerRuntime="1.073183211s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:51:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:51:23.583644806 +0000 UTC m=+310.814755240" watchObservedRunningTime="2026-07-10 12:51:23.584628523 +0000 UTC m=+310.815739029" Jul 10 12:51:34.569226 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:34.569198 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-x6jfz" Jul 10 12:51:37.006717 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.006685 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz"] Jul 10 12:51:37.009822 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.009804 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.024945 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.024915 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 12:51:37.024945 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.024934 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tqml8\"" Jul 10 12:51:37.025119 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.024964 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 12:51:37.025119 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.024981 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 12:51:37.025119 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.024916 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 12:51:37.025119 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.024916 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 12:51:37.053896 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.053859 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz"] Jul 10 12:51:37.173695 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.173660 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/044bb745-dc16-4550-8eb1-cc3df77ad3c0-metrics-cert\") pod \"lws-controller-manager-86f6864fb7-wg4bz\" (UID: \"044bb745-dc16-4550-8eb1-cc3df77ad3c0\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.173847 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.173701 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/044bb745-dc16-4550-8eb1-cc3df77ad3c0-cert\") pod \"lws-controller-manager-86f6864fb7-wg4bz\" (UID: \"044bb745-dc16-4550-8eb1-cc3df77ad3c0\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.173847 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.173736 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/044bb745-dc16-4550-8eb1-cc3df77ad3c0-manager-config\") pod \"lws-controller-manager-86f6864fb7-wg4bz\" (UID: \"044bb745-dc16-4550-8eb1-cc3df77ad3c0\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.173847 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.173780 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk2gj\" (UniqueName: \"kubernetes.io/projected/044bb745-dc16-4550-8eb1-cc3df77ad3c0-kube-api-access-jk2gj\") pod \"lws-controller-manager-86f6864fb7-wg4bz\" (UID: \"044bb745-dc16-4550-8eb1-cc3df77ad3c0\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.274232 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.274159 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/044bb745-dc16-4550-8eb1-cc3df77ad3c0-metrics-cert\") pod \"lws-controller-manager-86f6864fb7-wg4bz\" (UID: \"044bb745-dc16-4550-8eb1-cc3df77ad3c0\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.274232 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.274195 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/044bb745-dc16-4550-8eb1-cc3df77ad3c0-cert\") pod \"lws-controller-manager-86f6864fb7-wg4bz\" (UID: \"044bb745-dc16-4550-8eb1-cc3df77ad3c0\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.274232 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.274221 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/044bb745-dc16-4550-8eb1-cc3df77ad3c0-manager-config\") pod \"lws-controller-manager-86f6864fb7-wg4bz\" (UID: \"044bb745-dc16-4550-8eb1-cc3df77ad3c0\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.274569 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.274360 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk2gj\" (UniqueName: \"kubernetes.io/projected/044bb745-dc16-4550-8eb1-cc3df77ad3c0-kube-api-access-jk2gj\") pod \"lws-controller-manager-86f6864fb7-wg4bz\" (UID: \"044bb745-dc16-4550-8eb1-cc3df77ad3c0\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.274847 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.274827 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/044bb745-dc16-4550-8eb1-cc3df77ad3c0-manager-config\") pod \"lws-controller-manager-86f6864fb7-wg4bz\" (UID: \"044bb745-dc16-4550-8eb1-cc3df77ad3c0\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.276665 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.276642 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/044bb745-dc16-4550-8eb1-cc3df77ad3c0-metrics-cert\") pod \"lws-controller-manager-86f6864fb7-wg4bz\" (UID: \"044bb745-dc16-4550-8eb1-cc3df77ad3c0\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.276750 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.276676 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/044bb745-dc16-4550-8eb1-cc3df77ad3c0-cert\") pod \"lws-controller-manager-86f6864fb7-wg4bz\" (UID: \"044bb745-dc16-4550-8eb1-cc3df77ad3c0\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.283938 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.283915 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk2gj\" (UniqueName: \"kubernetes.io/projected/044bb745-dc16-4550-8eb1-cc3df77ad3c0-kube-api-access-jk2gj\") pod \"lws-controller-manager-86f6864fb7-wg4bz\" (UID: \"044bb745-dc16-4550-8eb1-cc3df77ad3c0\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.321471 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.321433 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:37.474826 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.474789 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz"] Jul 10 12:51:37.478405 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:51:37.478378 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044bb745_dc16_4550_8eb1_cc3df77ad3c0.slice/crio-7225cec85c42ad1923d5d6b628b7f24d9f9d944d73502acd8d079dfb76436ceb WatchSource:0}: Error finding container 7225cec85c42ad1923d5d6b628b7f24d9f9d944d73502acd8d079dfb76436ceb: Status 404 returned error can't find the container with id 7225cec85c42ad1923d5d6b628b7f24d9f9d944d73502acd8d079dfb76436ceb Jul 10 12:51:37.620840 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:37.620746 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" event={"ID":"044bb745-dc16-4550-8eb1-cc3df77ad3c0","Type":"ContainerStarted","Data":"7225cec85c42ad1923d5d6b628b7f24d9f9d944d73502acd8d079dfb76436ceb"} Jul 10 12:51:40.636854 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:40.636821 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" event={"ID":"044bb745-dc16-4550-8eb1-cc3df77ad3c0","Type":"ContainerStarted","Data":"040e855d7f703e3bef329bc8cd6fa9e98875ba3e4faf102f38e021cb2ac3f60e"} Jul 10 12:51:40.637277 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:40.636943 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:51:40.654790 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:40.654738 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" podStartSLOduration=2.491849555 podStartE2EDuration="4.654720774s" totalImagesPullingTime="2.162871219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:51:40.653212206 +0000 UTC m=+327.884322637" watchObservedRunningTime="2026-07-10 12:51:40.654720774 +0000 UTC m=+327.885831207" Jul 10 12:51:45.111537 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.111505 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77"] Jul 10 12:51:45.114600 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.114583 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.117578 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.117556 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 12:51:45.117756 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.117576 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 12:51:45.117756 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.117589 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 12:51:45.117955 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.117940 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 12:51:45.118161 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.118141 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 12:51:45.118303 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.118290 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jrrdz\"" Jul 10 12:51:45.118712 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.118696 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 12:51:45.127656 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.127636 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77"] Jul 10 12:51:45.243796 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.243756 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhbr9\" (UniqueName: \"kubernetes.io/projected/2429c60c-2720-4623-bb7c-2cf3b3e31f83-kube-api-access-dhbr9\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.243993 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.243801 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2429c60c-2720-4623-bb7c-2cf3b3e31f83-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.243993 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.243866 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2429c60c-2720-4623-bb7c-2cf3b3e31f83-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.243993 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.243955 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2429c60c-2720-4623-bb7c-2cf3b3e31f83-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.244139 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.244010 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2429c60c-2720-4623-bb7c-2cf3b3e31f83-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.244139 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.244041 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2429c60c-2720-4623-bb7c-2cf3b3e31f83-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.244139 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.244079 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2429c60c-2720-4623-bb7c-2cf3b3e31f83-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.345539 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.345505 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhbr9\" (UniqueName: \"kubernetes.io/projected/2429c60c-2720-4623-bb7c-2cf3b3e31f83-kube-api-access-dhbr9\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.345712 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.345554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2429c60c-2720-4623-bb7c-2cf3b3e31f83-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.345712 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.345587 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2429c60c-2720-4623-bb7c-2cf3b3e31f83-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.345712 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.345623 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2429c60c-2720-4623-bb7c-2cf3b3e31f83-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.345712 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.345656 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2429c60c-2720-4623-bb7c-2cf3b3e31f83-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.345712 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.345680 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2429c60c-2720-4623-bb7c-2cf3b3e31f83-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.345712 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.345703 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2429c60c-2720-4623-bb7c-2cf3b3e31f83-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.346423 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.346395 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2429c60c-2720-4623-bb7c-2cf3b3e31f83-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.347993 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.347964 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2429c60c-2720-4623-bb7c-2cf3b3e31f83-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.348126 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.348050 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2429c60c-2720-4623-bb7c-2cf3b3e31f83-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.348266 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.348250 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2429c60c-2720-4623-bb7c-2cf3b3e31f83-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.348428 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.348412 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2429c60c-2720-4623-bb7c-2cf3b3e31f83-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.358703 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.358681 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhbr9\" (UniqueName: \"kubernetes.io/projected/2429c60c-2720-4623-bb7c-2cf3b3e31f83-kube-api-access-dhbr9\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.365875 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.365810 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2429c60c-2720-4623-bb7c-2cf3b3e31f83-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tmj77\" (UID: \"2429c60c-2720-4623-bb7c-2cf3b3e31f83\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.423876 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.423836 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:45.557965 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.557926 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77"] Jul 10 12:51:45.560118 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:51:45.560096 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2429c60c_2720_4623_bb7c_2cf3b3e31f83.slice/crio-ac9a675f19630eae09b840d03405b9002db3a15bd8506c4134248ab8aa7d1e77 WatchSource:0}: Error finding container ac9a675f19630eae09b840d03405b9002db3a15bd8506c4134248ab8aa7d1e77: Status 404 returned error can't find the container with id ac9a675f19630eae09b840d03405b9002db3a15bd8506c4134248ab8aa7d1e77 Jul 10 12:51:45.659411 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:45.659310 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" event={"ID":"2429c60c-2720-4623-bb7c-2cf3b3e31f83","Type":"ContainerStarted","Data":"ac9a675f19630eae09b840d03405b9002db3a15bd8506c4134248ab8aa7d1e77"} Jul 10 12:51:47.877939 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:47.877901 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 12:51:47.878211 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:47.877967 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 12:51:48.676010 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:48.675971 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" event={"ID":"2429c60c-2720-4623-bb7c-2cf3b3e31f83","Type":"ContainerStarted","Data":"9be1856c23b37a67f65d05789fd79b038a55f68ecd2c81b0063c6dfb8bfae905"} Jul 10 12:51:48.676222 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:48.676159 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:48.678152 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:48.678130 2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-tmj77 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 12:51:48.678270 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:48.678175 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" podUID="2429c60c-2720-4623-bb7c-2cf3b3e31f83" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 12:51:48.704533 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:48.704481 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" podStartSLOduration=1.38886603 podStartE2EDuration="3.704462506s" totalImagesPullingTime="2.315596476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:51:48.70249536 +0000 UTC m=+335.933605793" watchObservedRunningTime="2026-07-10 12:51:48.704462506 +0000 UTC m=+335.935572941" Jul 10 12:51:49.681381 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:49.681337 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tmj77" Jul 10 12:51:51.644045 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:51:51.644017 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-wg4bz" Jul 10 12:54:07.117904 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.117871 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-259dl"] Jul 10 12:54:07.121090 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.121073 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" Jul 10 12:54:07.123997 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.123977 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 12:54:07.123997 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.123993 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 10 12:54:07.124178 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.124013 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 12:54:07.124991 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.124974 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6qgc9\"" Jul 10 12:54:07.132114 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.132082 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-259dl"] Jul 10 12:54:07.214411 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.214379 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-259dl"] Jul 10 12:54:07.266637 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.266606 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7027aeb3-889e-4cad-9dfc-64455b80dc10-config-file\") pod \"limitador-limitador-64c94fd64f-259dl\" (UID: \"7027aeb3-889e-4cad-9dfc-64455b80dc10\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" Jul 10 12:54:07.266800 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.266669 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dhbj\" (UniqueName: \"kubernetes.io/projected/7027aeb3-889e-4cad-9dfc-64455b80dc10-kube-api-access-6dhbj\") pod \"limitador-limitador-64c94fd64f-259dl\" (UID: \"7027aeb3-889e-4cad-9dfc-64455b80dc10\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" Jul 10 12:54:07.367984 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.367895 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dhbj\" (UniqueName: \"kubernetes.io/projected/7027aeb3-889e-4cad-9dfc-64455b80dc10-kube-api-access-6dhbj\") pod \"limitador-limitador-64c94fd64f-259dl\" (UID: \"7027aeb3-889e-4cad-9dfc-64455b80dc10\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" Jul 10 12:54:07.367984 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.367974 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7027aeb3-889e-4cad-9dfc-64455b80dc10-config-file\") pod \"limitador-limitador-64c94fd64f-259dl\" (UID: \"7027aeb3-889e-4cad-9dfc-64455b80dc10\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" Jul 10 12:54:07.368661 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.368640 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7027aeb3-889e-4cad-9dfc-64455b80dc10-config-file\") pod \"limitador-limitador-64c94fd64f-259dl\" (UID: \"7027aeb3-889e-4cad-9dfc-64455b80dc10\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" Jul 10 12:54:07.377508 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.377482 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dhbj\" (UniqueName: \"kubernetes.io/projected/7027aeb3-889e-4cad-9dfc-64455b80dc10-kube-api-access-6dhbj\") pod \"limitador-limitador-64c94fd64f-259dl\" (UID: \"7027aeb3-889e-4cad-9dfc-64455b80dc10\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" Jul 10 12:54:07.431429 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.431395 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" Jul 10 12:54:07.560029 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:07.560005 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-259dl"] Jul 10 12:54:07.562815 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:54:07.562787 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7027aeb3_889e_4cad_9dfc_64455b80dc10.slice/crio-bc5b6fe9117d75807e5df6617d8288f90994a0910bd70b00e781e0fcca27c8f2 WatchSource:0}: Error finding container bc5b6fe9117d75807e5df6617d8288f90994a0910bd70b00e781e0fcca27c8f2: Status 404 returned error can't find the container with id bc5b6fe9117d75807e5df6617d8288f90994a0910bd70b00e781e0fcca27c8f2 Jul 10 12:54:08.266799 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:08.266767 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" event={"ID":"7027aeb3-889e-4cad-9dfc-64455b80dc10","Type":"ContainerStarted","Data":"bc5b6fe9117d75807e5df6617d8288f90994a0910bd70b00e781e0fcca27c8f2"} Jul 10 12:54:11.281221 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:11.281184 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" event={"ID":"7027aeb3-889e-4cad-9dfc-64455b80dc10","Type":"ContainerStarted","Data":"c13cb3bac2c6330b0bf75623db5a9c1c8adf982b169de4a83f210e870caf1856"} Jul 10 12:54:11.281621 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:11.281254 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" Jul 10 12:54:11.299196 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:11.299149 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" podStartSLOduration=1.391944393 podStartE2EDuration="4.299133007s" totalImagesPullingTime="2.907188614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:54:11.297032827 +0000 UTC m=+478.528143271" watchObservedRunningTime="2026-07-10 12:54:11.299133007 +0000 UTC m=+478.530243439" Jul 10 12:54:22.286133 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:22.286103 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" Jul 10 12:54:24.839331 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:24.839293 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-259dl"] Jul 10 12:54:24.839751 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:24.839539 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" podUID="7027aeb3-889e-4cad-9dfc-64455b80dc10" containerName="limitador" containerID="cri-o://c13cb3bac2c6330b0bf75623db5a9c1c8adf982b169de4a83f210e870caf1856" gracePeriod=30 Jul 10 12:54:25.339343 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:25.339315 2557 generic.go:356] "Generic (PLEG): container finished" podID="7027aeb3-889e-4cad-9dfc-64455b80dc10" containerID="c13cb3bac2c6330b0bf75623db5a9c1c8adf982b169de4a83f210e870caf1856" exitCode=0 Jul 10 12:54:25.339523 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:25.339390 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" event={"ID":"7027aeb3-889e-4cad-9dfc-64455b80dc10","Type":"ContainerDied","Data":"c13cb3bac2c6330b0bf75623db5a9c1c8adf982b169de4a83f210e870caf1856"} Jul 10 12:54:25.378217 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:25.378189 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" Jul 10 12:54:25.405056 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:25.404991 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7027aeb3-889e-4cad-9dfc-64455b80dc10-config-file\") pod \"7027aeb3-889e-4cad-9dfc-64455b80dc10\" (UID: \"7027aeb3-889e-4cad-9dfc-64455b80dc10\") " Jul 10 12:54:25.405056 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:25.405029 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dhbj\" (UniqueName: \"kubernetes.io/projected/7027aeb3-889e-4cad-9dfc-64455b80dc10-kube-api-access-6dhbj\") pod \"7027aeb3-889e-4cad-9dfc-64455b80dc10\" (UID: \"7027aeb3-889e-4cad-9dfc-64455b80dc10\") " Jul 10 12:54:25.405475 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:25.405444 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7027aeb3-889e-4cad-9dfc-64455b80dc10-config-file" (OuterVolumeSpecName: "config-file") pod "7027aeb3-889e-4cad-9dfc-64455b80dc10" (UID: "7027aeb3-889e-4cad-9dfc-64455b80dc10"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:54:25.407230 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:25.407204 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7027aeb3-889e-4cad-9dfc-64455b80dc10-kube-api-access-6dhbj" (OuterVolumeSpecName: "kube-api-access-6dhbj") pod "7027aeb3-889e-4cad-9dfc-64455b80dc10" (UID: "7027aeb3-889e-4cad-9dfc-64455b80dc10"). InnerVolumeSpecName "kube-api-access-6dhbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 12:54:25.506492 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:25.506441 2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7027aeb3-889e-4cad-9dfc-64455b80dc10-config-file\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:54:25.506492 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:25.506479 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dhbj\" (UniqueName: \"kubernetes.io/projected/7027aeb3-889e-4cad-9dfc-64455b80dc10-kube-api-access-6dhbj\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:54:26.345252 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:26.345221 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" Jul 10 12:54:26.345252 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:26.345249 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-259dl" event={"ID":"7027aeb3-889e-4cad-9dfc-64455b80dc10","Type":"ContainerDied","Data":"bc5b6fe9117d75807e5df6617d8288f90994a0910bd70b00e781e0fcca27c8f2"} Jul 10 12:54:26.345798 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:26.345307 2557 scope.go:117] "RemoveContainer" containerID="c13cb3bac2c6330b0bf75623db5a9c1c8adf982b169de4a83f210e870caf1856" Jul 10 12:54:26.366485 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:26.366451 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-259dl"] Jul 10 12:54:26.371107 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:26.371087 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-259dl"] Jul 10 12:54:27.266833 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:27.266799 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7027aeb3-889e-4cad-9dfc-64455b80dc10" path="/var/lib/kubelet/pods/7027aeb3-889e-4cad-9dfc-64455b80dc10/volumes" Jul 10 12:54:28.598318 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.598287 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n"] Jul 10 12:54:28.598720 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.598649 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7027aeb3-889e-4cad-9dfc-64455b80dc10" containerName="limitador" Jul 10 12:54:28.598720 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.598665 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7027aeb3-889e-4cad-9dfc-64455b80dc10" containerName="limitador" Jul 10 12:54:28.598808 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.598734 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7027aeb3-889e-4cad-9dfc-64455b80dc10" containerName="limitador" Jul 10 12:54:28.607097 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.607070 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" Jul 10 12:54:28.610137 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.610110 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 10 12:54:28.610297 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.610153 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-tzgdp\"" Jul 10 12:54:28.610297 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.610236 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 10 12:54:28.610436 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.610389 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 10 12:54:28.610759 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.610734 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n"] Jul 10 12:54:28.633339 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.633305 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wcc4\" (UniqueName: \"kubernetes.io/projected/f6b35d7f-49a5-43d7-abc7-84ba1967c81c-kube-api-access-9wcc4\") pod \"postgres-69fb4594cf-t2r9n\" (UID: \"f6b35d7f-49a5-43d7-abc7-84ba1967c81c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" Jul 10 12:54:28.633492 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.633373 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f6b35d7f-49a5-43d7-abc7-84ba1967c81c-data\") pod \"postgres-69fb4594cf-t2r9n\" (UID: \"f6b35d7f-49a5-43d7-abc7-84ba1967c81c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" Jul 10 12:54:28.734221 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.734181 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wcc4\" (UniqueName: \"kubernetes.io/projected/f6b35d7f-49a5-43d7-abc7-84ba1967c81c-kube-api-access-9wcc4\") pod \"postgres-69fb4594cf-t2r9n\" (UID: \"f6b35d7f-49a5-43d7-abc7-84ba1967c81c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" Jul 10 12:54:28.734221 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.734225 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f6b35d7f-49a5-43d7-abc7-84ba1967c81c-data\") pod \"postgres-69fb4594cf-t2r9n\" (UID: \"f6b35d7f-49a5-43d7-abc7-84ba1967c81c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" Jul 10 12:54:28.734619 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.734604 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f6b35d7f-49a5-43d7-abc7-84ba1967c81c-data\") pod \"postgres-69fb4594cf-t2r9n\" (UID: \"f6b35d7f-49a5-43d7-abc7-84ba1967c81c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" Jul 10 12:54:28.743570 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.743545 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wcc4\" (UniqueName: \"kubernetes.io/projected/f6b35d7f-49a5-43d7-abc7-84ba1967c81c-kube-api-access-9wcc4\") pod \"postgres-69fb4594cf-t2r9n\" (UID: \"f6b35d7f-49a5-43d7-abc7-84ba1967c81c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" Jul 10 12:54:28.918545 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:28.918442 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" Jul 10 12:54:29.051450 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:29.051312 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n"] Jul 10 12:54:29.054261 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:54:29.054235 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b35d7f_49a5_43d7_abc7_84ba1967c81c.slice/crio-869b865952a5e7075e470e5d2216840d846686c7e8b7ba42be5ae4c8b2a5dd2b WatchSource:0}: Error finding container 869b865952a5e7075e470e5d2216840d846686c7e8b7ba42be5ae4c8b2a5dd2b: Status 404 returned error can't find the container with id 869b865952a5e7075e470e5d2216840d846686c7e8b7ba42be5ae4c8b2a5dd2b Jul 10 12:54:29.358968 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:29.358930 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" event={"ID":"f6b35d7f-49a5-43d7-abc7-84ba1967c81c","Type":"ContainerStarted","Data":"869b865952a5e7075e470e5d2216840d846686c7e8b7ba42be5ae4c8b2a5dd2b"} Jul 10 12:54:34.386847 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:34.386814 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" event={"ID":"f6b35d7f-49a5-43d7-abc7-84ba1967c81c","Type":"ContainerStarted","Data":"d6b90c369032432eaadf1dff07b438a9623a10ca8631b9a719c21449af0204b1"} Jul 10 12:54:34.387249 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:34.386932 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" Jul 10 12:54:34.403566 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:34.403514 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" podStartSLOduration=1.830225187 podStartE2EDuration="6.403498895s" totalImagesPullingTime="4.573273708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:54:34.401772589 +0000 UTC m=+501.632883022" watchObservedRunningTime="2026-07-10 12:54:34.403498895 +0000 UTC m=+501.634609328" Jul 10 12:54:40.421306 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:40.421279 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t2r9n" Jul 10 12:54:46.530897 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.530860 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7ff5bb79b8-22lfg"] Jul 10 12:54:46.534520 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.534497 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:46.537699 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.537670 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 10 12:54:46.537821 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.537674 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 10 12:54:46.538832 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.538812 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6zh2w\"" Jul 10 12:54:46.546047 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.546026 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ff5bb79b8-22lfg"] Jul 10 12:54:46.601501 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.601465 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/427b560d-d24d-4402-9f13-26b9b41df8aa-service-ca\") pod \"maas-controller-7ff5bb79b8-22lfg\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:46.601685 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.601569 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/427b560d-d24d-4402-9f13-26b9b41df8aa-webhook-cert\") pod \"maas-controller-7ff5bb79b8-22lfg\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:46.601685 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.601602 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xgrb\" (UniqueName: \"kubernetes.io/projected/427b560d-d24d-4402-9f13-26b9b41df8aa-kube-api-access-8xgrb\") pod \"maas-controller-7ff5bb79b8-22lfg\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:46.702243 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.702210 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/427b560d-d24d-4402-9f13-26b9b41df8aa-service-ca\") pod \"maas-controller-7ff5bb79b8-22lfg\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:46.702462 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.702261 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/427b560d-d24d-4402-9f13-26b9b41df8aa-webhook-cert\") pod \"maas-controller-7ff5bb79b8-22lfg\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:46.702462 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.702281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xgrb\" (UniqueName: \"kubernetes.io/projected/427b560d-d24d-4402-9f13-26b9b41df8aa-kube-api-access-8xgrb\") pod \"maas-controller-7ff5bb79b8-22lfg\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:46.702462 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:54:46.702392 2557 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 10 12:54:46.702462 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:54:46.702452 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/427b560d-d24d-4402-9f13-26b9b41df8aa-webhook-cert podName:427b560d-d24d-4402-9f13-26b9b41df8aa nodeName:}" failed. No retries permitted until 2026-07-10 12:54:47.202435963 +0000 UTC m=+514.433546374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/427b560d-d24d-4402-9f13-26b9b41df8aa-webhook-cert") pod "maas-controller-7ff5bb79b8-22lfg" (UID: "427b560d-d24d-4402-9f13-26b9b41df8aa") : secret "maas-controller-webhook-cert" not found Jul 10 12:54:46.702954 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.702931 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/427b560d-d24d-4402-9f13-26b9b41df8aa-service-ca\") pod \"maas-controller-7ff5bb79b8-22lfg\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:46.723962 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.723938 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xgrb\" (UniqueName: \"kubernetes.io/projected/427b560d-d24d-4402-9f13-26b9b41df8aa-kube-api-access-8xgrb\") pod \"maas-controller-7ff5bb79b8-22lfg\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:46.769273 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.769240 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c8c758d8f-ggv74"] Jul 10 12:54:46.772599 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.772576 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:54:46.799150 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.799064 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c8c758d8f-ggv74"] Jul 10 12:54:46.904372 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.904306 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7de4e7e-856b-4747-b929-f2da6b0ea257-webhook-cert\") pod \"maas-controller-5c8c758d8f-ggv74\" (UID: \"c7de4e7e-856b-4747-b929-f2da6b0ea257\") " pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:54:46.904372 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.904343 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7de4e7e-856b-4747-b929-f2da6b0ea257-service-ca\") pod \"maas-controller-5c8c758d8f-ggv74\" (UID: \"c7de4e7e-856b-4747-b929-f2da6b0ea257\") " pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:54:46.904581 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:46.904395 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xghlz\" (UniqueName: \"kubernetes.io/projected/c7de4e7e-856b-4747-b929-f2da6b0ea257-kube-api-access-xghlz\") pod \"maas-controller-5c8c758d8f-ggv74\" (UID: \"c7de4e7e-856b-4747-b929-f2da6b0ea257\") " pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:54:47.005470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.005436 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7de4e7e-856b-4747-b929-f2da6b0ea257-webhook-cert\") pod \"maas-controller-5c8c758d8f-ggv74\" (UID: \"c7de4e7e-856b-4747-b929-f2da6b0ea257\") " pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:54:47.005470 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.005471 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7de4e7e-856b-4747-b929-f2da6b0ea257-service-ca\") pod \"maas-controller-5c8c758d8f-ggv74\" (UID: \"c7de4e7e-856b-4747-b929-f2da6b0ea257\") " pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:54:47.005728 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.005495 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xghlz\" (UniqueName: \"kubernetes.io/projected/c7de4e7e-856b-4747-b929-f2da6b0ea257-kube-api-access-xghlz\") pod \"maas-controller-5c8c758d8f-ggv74\" (UID: \"c7de4e7e-856b-4747-b929-f2da6b0ea257\") " pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:54:47.006178 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.006154 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7de4e7e-856b-4747-b929-f2da6b0ea257-service-ca\") pod \"maas-controller-5c8c758d8f-ggv74\" (UID: \"c7de4e7e-856b-4747-b929-f2da6b0ea257\") " pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:54:47.007890 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.007857 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7de4e7e-856b-4747-b929-f2da6b0ea257-webhook-cert\") pod \"maas-controller-5c8c758d8f-ggv74\" (UID: \"c7de4e7e-856b-4747-b929-f2da6b0ea257\") " pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:54:47.015737 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.015712 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xghlz\" (UniqueName: \"kubernetes.io/projected/c7de4e7e-856b-4747-b929-f2da6b0ea257-kube-api-access-xghlz\") pod \"maas-controller-5c8c758d8f-ggv74\" (UID: \"c7de4e7e-856b-4747-b929-f2da6b0ea257\") " pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:54:47.083968 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.083866 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:54:47.207588 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.207555 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/427b560d-d24d-4402-9f13-26b9b41df8aa-webhook-cert\") pod \"maas-controller-7ff5bb79b8-22lfg\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:47.209854 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.209834 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/427b560d-d24d-4402-9f13-26b9b41df8aa-webhook-cert\") pod \"maas-controller-7ff5bb79b8-22lfg\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:47.217107 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.217074 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c8c758d8f-ggv74"] Jul 10 12:54:47.219273 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:54:47.219250 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7de4e7e_856b_4747_b929_f2da6b0ea257.slice/crio-e4de6febb6de6c4bf8d3daa790aa6f92b104e3b3a3d69ba9c419cb6aab69f6cd WatchSource:0}: Error finding container e4de6febb6de6c4bf8d3daa790aa6f92b104e3b3a3d69ba9c419cb6aab69f6cd: Status 404 returned error can't find the container with id e4de6febb6de6c4bf8d3daa790aa6f92b104e3b3a3d69ba9c419cb6aab69f6cd Jul 10 12:54:47.442166 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.442076 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8c758d8f-ggv74" event={"ID":"c7de4e7e-856b-4747-b929-f2da6b0ea257","Type":"ContainerStarted","Data":"e4de6febb6de6c4bf8d3daa790aa6f92b104e3b3a3d69ba9c419cb6aab69f6cd"} Jul 10 12:54:47.444238 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.444218 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:47.574952 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:47.574926 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ff5bb79b8-22lfg"] Jul 10 12:54:47.576806 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:54:47.576783 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427b560d_d24d_4402_9f13_26b9b41df8aa.slice/crio-a43e47b9325828b831b3052a2d4d5e41f8addf3f94082cc469ba972890970e75 WatchSource:0}: Error finding container a43e47b9325828b831b3052a2d4d5e41f8addf3f94082cc469ba972890970e75: Status 404 returned error can't find the container with id a43e47b9325828b831b3052a2d4d5e41f8addf3f94082cc469ba972890970e75 Jul 10 12:54:48.449702 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:48.449627 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" event={"ID":"427b560d-d24d-4402-9f13-26b9b41df8aa","Type":"ContainerStarted","Data":"a43e47b9325828b831b3052a2d4d5e41f8addf3f94082cc469ba972890970e75"} Jul 10 12:54:50.458963 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:50.458930 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" event={"ID":"427b560d-d24d-4402-9f13-26b9b41df8aa","Type":"ContainerStarted","Data":"265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686"} Jul 10 12:54:50.459477 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:50.459014 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:54:50.460419 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:50.460398 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8c758d8f-ggv74" event={"ID":"c7de4e7e-856b-4747-b929-f2da6b0ea257","Type":"ContainerStarted","Data":"5dfd98893d42a788d96b6d862ccf774b24ddccb4ceab16a4584daffa574bbe5a"} Jul 10 12:54:50.460509 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:50.460458 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:54:50.483661 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:50.483614 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" podStartSLOduration=2.084925104 podStartE2EDuration="4.483602598s" totalImagesPullingTime="2.398677494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:54:50.482203019 +0000 UTC m=+517.713313464" watchObservedRunningTime="2026-07-10 12:54:50.483602598 +0000 UTC m=+517.714713031" Jul 10 12:54:50.500759 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:54:50.500703 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c8c758d8f-ggv74" podStartSLOduration=1.754853233 podStartE2EDuration="4.500689772s" totalImagesPullingTime="2.745836539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:54:50.499395054 +0000 UTC m=+517.730505514" watchObservedRunningTime="2026-07-10 12:54:50.500689772 +0000 UTC m=+517.731800205" Jul 10 12:55:01.470488 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:01.470453 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:55:01.470935 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:01.470550 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:55:01.534377 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:01.534326 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7ff5bb79b8-22lfg"] Jul 10 12:55:01.534619 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:01.534594 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" podUID="427b560d-d24d-4402-9f13-26b9b41df8aa" containerName="manager" containerID="cri-o://265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686" gracePeriod=30 Jul 10 12:55:01.776734 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:01.776708 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:55:01.940434 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:01.940383 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/427b560d-d24d-4402-9f13-26b9b41df8aa-service-ca\") pod \"427b560d-d24d-4402-9f13-26b9b41df8aa\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " Jul 10 12:55:01.940614 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:01.940465 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/427b560d-d24d-4402-9f13-26b9b41df8aa-webhook-cert\") pod \"427b560d-d24d-4402-9f13-26b9b41df8aa\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " Jul 10 12:55:01.940614 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:01.940537 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xgrb\" (UniqueName: \"kubernetes.io/projected/427b560d-d24d-4402-9f13-26b9b41df8aa-kube-api-access-8xgrb\") pod \"427b560d-d24d-4402-9f13-26b9b41df8aa\" (UID: \"427b560d-d24d-4402-9f13-26b9b41df8aa\") " Jul 10 12:55:01.940824 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:01.940798 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/427b560d-d24d-4402-9f13-26b9b41df8aa-service-ca" (OuterVolumeSpecName: "service-ca") pod "427b560d-d24d-4402-9f13-26b9b41df8aa" (UID: "427b560d-d24d-4402-9f13-26b9b41df8aa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:55:01.942757 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:01.942735 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/427b560d-d24d-4402-9f13-26b9b41df8aa-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "427b560d-d24d-4402-9f13-26b9b41df8aa" (UID: "427b560d-d24d-4402-9f13-26b9b41df8aa"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:55:01.942866 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:01.942848 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/427b560d-d24d-4402-9f13-26b9b41df8aa-kube-api-access-8xgrb" (OuterVolumeSpecName: "kube-api-access-8xgrb") pod "427b560d-d24d-4402-9f13-26b9b41df8aa" (UID: "427b560d-d24d-4402-9f13-26b9b41df8aa"). InnerVolumeSpecName "kube-api-access-8xgrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 12:55:02.041583 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:02.041476 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xgrb\" (UniqueName: \"kubernetes.io/projected/427b560d-d24d-4402-9f13-26b9b41df8aa-kube-api-access-8xgrb\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:55:02.041583 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:02.041522 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/427b560d-d24d-4402-9f13-26b9b41df8aa-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:55:02.041583 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:02.041534 2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/427b560d-d24d-4402-9f13-26b9b41df8aa-webhook-cert\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:55:02.523231 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:02.523192 2557 generic.go:356] "Generic (PLEG): container finished" podID="427b560d-d24d-4402-9f13-26b9b41df8aa" containerID="265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686" exitCode=0 Jul 10 12:55:02.523679 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:02.523244 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" Jul 10 12:55:02.523679 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:02.523285 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" event={"ID":"427b560d-d24d-4402-9f13-26b9b41df8aa","Type":"ContainerDied","Data":"265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686"} Jul 10 12:55:02.523679 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:02.523341 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ff5bb79b8-22lfg" event={"ID":"427b560d-d24d-4402-9f13-26b9b41df8aa","Type":"ContainerDied","Data":"a43e47b9325828b831b3052a2d4d5e41f8addf3f94082cc469ba972890970e75"} Jul 10 12:55:02.523679 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:02.523375 2557 scope.go:117] "RemoveContainer" containerID="265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686" Jul 10 12:55:02.532790 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:02.532773 2557 scope.go:117] "RemoveContainer" containerID="265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686" Jul 10 12:55:02.533048 ip-10-0-135-152 kubenswrapper[2557]: E0710 12:55:02.533030 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686\": container with ID starting with 265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686 not found: ID does not exist" containerID="265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686" Jul 10 12:55:02.533085 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:02.533056 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686"} err="failed to get container status \"265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686\": rpc error: code = NotFound desc = could not find container \"265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686\": container with ID starting with 265b27ca41f95afaccf32fd3c2addf1a30e6d1aaf25913324afc7313e7a9f686 not found: ID does not exist" Jul 10 12:55:02.544753 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:02.544728 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7ff5bb79b8-22lfg"] Jul 10 12:55:02.547966 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:02.547946 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7ff5bb79b8-22lfg"] Jul 10 12:55:03.266294 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:03.266263 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="427b560d-d24d-4402-9f13-26b9b41df8aa" path="/var/lib/kubelet/pods/427b560d-d24d-4402-9f13-26b9b41df8aa/volumes" Jul 10 12:55:22.155640 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.155603 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx"] Jul 10 12:55:22.156062 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.155915 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="427b560d-d24d-4402-9f13-26b9b41df8aa" containerName="manager" Jul 10 12:55:22.156062 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.155925 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="427b560d-d24d-4402-9f13-26b9b41df8aa" containerName="manager" Jul 10 12:55:22.156062 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.155977 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="427b560d-d24d-4402-9f13-26b9b41df8aa" containerName="manager" Jul 10 12:55:22.162298 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.162279 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:22.164704 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.164681 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 10 12:55:22.164818 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.164766 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n5dl8\"" Jul 10 12:55:22.169899 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.169638 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx"] Jul 10 12:55:22.211957 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.211925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be00e063-5c9f-412b-ab7b-1b4f18ebfb44-openshift-service-ca\") pod \"maas-api-56d488c5b7-rpzpx\" (UID: \"be00e063-5c9f-412b-ab7b-1b4f18ebfb44\") " pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:22.212110 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.211977 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be00e063-5c9f-412b-ab7b-1b4f18ebfb44-maas-api-tls\") pod \"maas-api-56d488c5b7-rpzpx\" (UID: \"be00e063-5c9f-412b-ab7b-1b4f18ebfb44\") " pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:22.212110 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.212004 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jnqp\" (UniqueName: \"kubernetes.io/projected/be00e063-5c9f-412b-ab7b-1b4f18ebfb44-kube-api-access-7jnqp\") pod \"maas-api-56d488c5b7-rpzpx\" (UID: \"be00e063-5c9f-412b-ab7b-1b4f18ebfb44\") " pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:22.313421 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.313385 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be00e063-5c9f-412b-ab7b-1b4f18ebfb44-maas-api-tls\") pod \"maas-api-56d488c5b7-rpzpx\" (UID: \"be00e063-5c9f-412b-ab7b-1b4f18ebfb44\") " pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:22.313582 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.313432 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jnqp\" (UniqueName: \"kubernetes.io/projected/be00e063-5c9f-412b-ab7b-1b4f18ebfb44-kube-api-access-7jnqp\") pod \"maas-api-56d488c5b7-rpzpx\" (UID: \"be00e063-5c9f-412b-ab7b-1b4f18ebfb44\") " pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:22.313582 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.313503 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be00e063-5c9f-412b-ab7b-1b4f18ebfb44-openshift-service-ca\") pod \"maas-api-56d488c5b7-rpzpx\" (UID: \"be00e063-5c9f-412b-ab7b-1b4f18ebfb44\") " pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:22.314202 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.314176 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be00e063-5c9f-412b-ab7b-1b4f18ebfb44-openshift-service-ca\") pod \"maas-api-56d488c5b7-rpzpx\" (UID: \"be00e063-5c9f-412b-ab7b-1b4f18ebfb44\") " pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:22.315810 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.315790 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be00e063-5c9f-412b-ab7b-1b4f18ebfb44-maas-api-tls\") pod \"maas-api-56d488c5b7-rpzpx\" (UID: \"be00e063-5c9f-412b-ab7b-1b4f18ebfb44\") " pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:22.322384 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.322342 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jnqp\" (UniqueName: \"kubernetes.io/projected/be00e063-5c9f-412b-ab7b-1b4f18ebfb44-kube-api-access-7jnqp\") pod \"maas-api-56d488c5b7-rpzpx\" (UID: \"be00e063-5c9f-412b-ab7b-1b4f18ebfb44\") " pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:22.473246 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.473209 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:22.616309 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.616240 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx"] Jul 10 12:55:22.619206 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:55:22.619180 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe00e063_5c9f_412b_ab7b_1b4f18ebfb44.slice/crio-89a45c973be436efc3c7ec9c1060f27775038763accf7c7ae61e1911c8b58791 WatchSource:0}: Error finding container 89a45c973be436efc3c7ec9c1060f27775038763accf7c7ae61e1911c8b58791: Status 404 returned error can't find the container with id 89a45c973be436efc3c7ec9c1060f27775038763accf7c7ae61e1911c8b58791 Jul 10 12:55:22.684627 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.684600 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-ph8v2"] Jul 10 12:55:22.694314 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.694289 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" Jul 10 12:55:22.697977 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.697651 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 10 12:55:22.697977 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.697728 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wkjqj\"" Jul 10 12:55:22.699487 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.699463 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-ph8v2"] Jul 10 12:55:22.819072 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.818981 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec452fd-92c5-4d36-82cc-74b633da9dec-plugins-config-volume\") pod \"payload-processing-58f86c7798-ph8v2\" (UID: \"9ec452fd-92c5-4d36-82cc-74b633da9dec\") " pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" Jul 10 12:55:22.819072 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.819035 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pj9n\" (UniqueName: \"kubernetes.io/projected/9ec452fd-92c5-4d36-82cc-74b633da9dec-kube-api-access-5pj9n\") pod \"payload-processing-58f86c7798-ph8v2\" (UID: \"9ec452fd-92c5-4d36-82cc-74b633da9dec\") " pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" Jul 10 12:55:22.920005 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.919969 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pj9n\" (UniqueName: \"kubernetes.io/projected/9ec452fd-92c5-4d36-82cc-74b633da9dec-kube-api-access-5pj9n\") pod \"payload-processing-58f86c7798-ph8v2\" (UID: \"9ec452fd-92c5-4d36-82cc-74b633da9dec\") " pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" Jul 10 12:55:22.920184 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.920109 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec452fd-92c5-4d36-82cc-74b633da9dec-plugins-config-volume\") pod \"payload-processing-58f86c7798-ph8v2\" (UID: \"9ec452fd-92c5-4d36-82cc-74b633da9dec\") " pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" Jul 10 12:55:22.920833 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.920813 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec452fd-92c5-4d36-82cc-74b633da9dec-plugins-config-volume\") pod \"payload-processing-58f86c7798-ph8v2\" (UID: \"9ec452fd-92c5-4d36-82cc-74b633da9dec\") " pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" Jul 10 12:55:22.928278 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:22.928251 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pj9n\" (UniqueName: \"kubernetes.io/projected/9ec452fd-92c5-4d36-82cc-74b633da9dec-kube-api-access-5pj9n\") pod \"payload-processing-58f86c7798-ph8v2\" (UID: \"9ec452fd-92c5-4d36-82cc-74b633da9dec\") " pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" Jul 10 12:55:23.006464 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:23.006424 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" Jul 10 12:55:23.134993 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:23.134969 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-ph8v2"] Jul 10 12:55:23.137694 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:55:23.137668 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec452fd_92c5_4d36_82cc_74b633da9dec.slice/crio-9e52097bd380a5851b82908178e8ad04d279f60ab86b76e5cdaad301e89d763d WatchSource:0}: Error finding container 9e52097bd380a5851b82908178e8ad04d279f60ab86b76e5cdaad301e89d763d: Status 404 returned error can't find the container with id 9e52097bd380a5851b82908178e8ad04d279f60ab86b76e5cdaad301e89d763d Jul 10 12:55:23.616707 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:23.616630 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" event={"ID":"9ec452fd-92c5-4d36-82cc-74b633da9dec","Type":"ContainerStarted","Data":"9e52097bd380a5851b82908178e8ad04d279f60ab86b76e5cdaad301e89d763d"} Jul 10 12:55:23.618006 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:23.617980 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" event={"ID":"be00e063-5c9f-412b-ab7b-1b4f18ebfb44","Type":"ContainerStarted","Data":"89a45c973be436efc3c7ec9c1060f27775038763accf7c7ae61e1911c8b58791"} Jul 10 12:55:25.629310 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:25.629254 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" event={"ID":"9ec452fd-92c5-4d36-82cc-74b633da9dec","Type":"ContainerStarted","Data":"16e319aba8aa7248eb5351b2b477ea7c59af0396fdda738258222d08eaeb67b1"} Jul 10 12:55:25.629787 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:25.629469 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" Jul 10 12:55:25.630956 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:25.630935 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" event={"ID":"be00e063-5c9f-412b-ab7b-1b4f18ebfb44","Type":"ContainerStarted","Data":"2b26f067708954f16ee38f7b7bfcec349c561de0ebb4dcba6c5eac633caf72af"} Jul 10 12:55:25.631082 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:25.631068 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:25.647042 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:25.646995 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" podStartSLOduration=2.122083993 podStartE2EDuration="3.646980294s" totalImagesPullingTime="1.524896301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:55:25.64553032 +0000 UTC m=+552.876640747" watchObservedRunningTime="2026-07-10 12:55:25.646980294 +0000 UTC m=+552.878090727" Jul 10 12:55:25.664000 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:25.663954 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" podStartSLOduration=1.622158374 podStartE2EDuration="3.663937731s" totalImagesPullingTime="2.041779357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:55:25.663216596 +0000 UTC m=+552.894327030" watchObservedRunningTime="2026-07-10 12:55:25.663937731 +0000 UTC m=+552.895048163" Jul 10 12:55:31.640939 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:31.640911 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-56d488c5b7-rpzpx" Jul 10 12:55:36.638277 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:36.638249 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-ph8v2" Jul 10 12:55:55.276145 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.276111 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s"] Jul 10 12:55:55.279582 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.279565 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.283304 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.283280 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mkb4s\"" Jul 10 12:55:55.283304 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.283292 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 10 12:55:55.283572 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.283285 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 12:55:55.283572 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.283280 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 12:55:55.287991 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.287969 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s"] Jul 10 12:55:55.309708 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.309684 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmdnh\" (UniqueName: \"kubernetes.io/projected/8bc3c846-cde6-4dec-9f5f-a1314d35f937-kube-api-access-mmdnh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.309841 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.309723 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc3c846-cde6-4dec-9f5f-a1314d35f937-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.309841 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.309758 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc3c846-cde6-4dec-9f5f-a1314d35f937-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.309841 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.309819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc3c846-cde6-4dec-9f5f-a1314d35f937-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.309993 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.309970 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3c846-cde6-4dec-9f5f-a1314d35f937-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.310092 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.310077 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc3c846-cde6-4dec-9f5f-a1314d35f937-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.410559 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.410523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc3c846-cde6-4dec-9f5f-a1314d35f937-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.410718 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.410573 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc3c846-cde6-4dec-9f5f-a1314d35f937-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.410718 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.410609 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc3c846-cde6-4dec-9f5f-a1314d35f937-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.410718 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.410649 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3c846-cde6-4dec-9f5f-a1314d35f937-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.410718 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.410710 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc3c846-cde6-4dec-9f5f-a1314d35f937-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.410914 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.410781 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmdnh\" (UniqueName: \"kubernetes.io/projected/8bc3c846-cde6-4dec-9f5f-a1314d35f937-kube-api-access-mmdnh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.410996 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.410974 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc3c846-cde6-4dec-9f5f-a1314d35f937-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.411107 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.411086 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc3c846-cde6-4dec-9f5f-a1314d35f937-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.411317 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.411297 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc3c846-cde6-4dec-9f5f-a1314d35f937-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.412844 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.412825 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc3c846-cde6-4dec-9f5f-a1314d35f937-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.412971 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.412954 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc3c846-cde6-4dec-9f5f-a1314d35f937-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.419211 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.419184 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmdnh\" (UniqueName: \"kubernetes.io/projected/8bc3c846-cde6-4dec-9f5f-a1314d35f937-kube-api-access-mmdnh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k4v4s\" (UID: \"8bc3c846-cde6-4dec-9f5f-a1314d35f937\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.589809 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.589728 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:55:55.718744 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.718715 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s"] Jul 10 12:55:55.721047 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:55:55.721022 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc3c846_cde6_4dec_9f5f_a1314d35f937.slice/crio-e60ec65ce96d42addc943e3a3d6cd6b0f08d136d283aab4b92a0336abe26188a WatchSource:0}: Error finding container e60ec65ce96d42addc943e3a3d6cd6b0f08d136d283aab4b92a0336abe26188a: Status 404 returned error can't find the container with id e60ec65ce96d42addc943e3a3d6cd6b0f08d136d283aab4b92a0336abe26188a Jul 10 12:55:55.762289 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:55.762250 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" event={"ID":"8bc3c846-cde6-4dec-9f5f-a1314d35f937","Type":"ContainerStarted","Data":"e60ec65ce96d42addc943e3a3d6cd6b0f08d136d283aab4b92a0336abe26188a"} Jul 10 12:55:57.772805 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:57.772770 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" event={"ID":"8bc3c846-cde6-4dec-9f5f-a1314d35f937","Type":"ContainerStarted","Data":"b785d379490cf8c301d7b28c1c1d1ffdbbfdd503642998de7a938a27083f3fa1"} Jul 10 12:55:57.790267 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:55:57.790213 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" podStartSLOduration=1.765584423 podStartE2EDuration="2.790196942s" totalImagesPullingTime="1.024612519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:55:57.789142574 +0000 UTC m=+585.020253007" watchObservedRunningTime="2026-07-10 12:55:57.790196942 +0000 UTC m=+585.021307374" Jul 10 12:56:05.590655 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:05.590620 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:56:05.591114 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:05.590680 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:56:05.603264 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:05.603236 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:56:05.818291 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:05.818262 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k4v4s" Jul 10 12:56:08.982796 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:08.982762 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv"] Jul 10 12:56:08.986425 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:08.986399 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:08.989163 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:08.989143 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 10 12:56:08.996639 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:08.996617 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv"] Jul 10 12:56:09.029276 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.029237 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/501abf8d-1a2e-4b83-b6ce-aa69c2686852-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.029482 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.029285 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq6fs\" (UniqueName: \"kubernetes.io/projected/501abf8d-1a2e-4b83-b6ce-aa69c2686852-kube-api-access-nq6fs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.029482 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.029390 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501abf8d-1a2e-4b83-b6ce-aa69c2686852-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.029482 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.029426 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/501abf8d-1a2e-4b83-b6ce-aa69c2686852-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.029482 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.029447 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/501abf8d-1a2e-4b83-b6ce-aa69c2686852-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.029618 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.029500 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/501abf8d-1a2e-4b83-b6ce-aa69c2686852-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.130238 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.130203 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq6fs\" (UniqueName: \"kubernetes.io/projected/501abf8d-1a2e-4b83-b6ce-aa69c2686852-kube-api-access-nq6fs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.130472 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.130266 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501abf8d-1a2e-4b83-b6ce-aa69c2686852-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.130472 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.130293 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/501abf8d-1a2e-4b83-b6ce-aa69c2686852-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.130472 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.130316 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/501abf8d-1a2e-4b83-b6ce-aa69c2686852-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.130472 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.130331 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/501abf8d-1a2e-4b83-b6ce-aa69c2686852-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.130472 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.130401 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/501abf8d-1a2e-4b83-b6ce-aa69c2686852-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.130854 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.130826 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/501abf8d-1a2e-4b83-b6ce-aa69c2686852-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.130994 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.130904 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/501abf8d-1a2e-4b83-b6ce-aa69c2686852-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.130994 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.130928 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/501abf8d-1a2e-4b83-b6ce-aa69c2686852-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.132661 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.132640 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/501abf8d-1a2e-4b83-b6ce-aa69c2686852-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.132833 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.132817 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501abf8d-1a2e-4b83-b6ce-aa69c2686852-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.139443 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.139421 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq6fs\" (UniqueName: \"kubernetes.io/projected/501abf8d-1a2e-4b83-b6ce-aa69c2686852-kube-api-access-nq6fs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4fvtv\" (UID: \"501abf8d-1a2e-4b83-b6ce-aa69c2686852\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.297615 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.297520 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:09.433539 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.433515 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv"] Jul 10 12:56:09.435811 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:56:09.435776 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501abf8d_1a2e_4b83_b6ce_aa69c2686852.slice/crio-5a85784a7dec6b6c968be98129273b512ae651d2d3bcb69a5172088e21cf59c4 WatchSource:0}: Error finding container 5a85784a7dec6b6c968be98129273b512ae651d2d3bcb69a5172088e21cf59c4: Status 404 returned error can't find the container with id 5a85784a7dec6b6c968be98129273b512ae651d2d3bcb69a5172088e21cf59c4 Jul 10 12:56:09.826678 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.826629 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" event={"ID":"501abf8d-1a2e-4b83-b6ce-aa69c2686852","Type":"ContainerStarted","Data":"55c917b18740b22e9bfaeff1336e84754a8c677bbea5f0e291667197b06fbb03"} Jul 10 12:56:09.826678 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.826680 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" event={"ID":"501abf8d-1a2e-4b83-b6ce-aa69c2686852","Type":"ContainerStarted","Data":"5a85784a7dec6b6c968be98129273b512ae651d2d3bcb69a5172088e21cf59c4"} Jul 10 12:56:09.847915 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:09.847801 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" podStartSLOduration=1.588656633 podStartE2EDuration="1.847779166s" totalImagesPullingTime="259.122533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:56:09.846127029 +0000 UTC m=+597.077237474" watchObservedRunningTime="2026-07-10 12:56:09.847779166 +0000 UTC m=+597.078889601" Jul 10 12:56:13.164811 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:13.164776 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 12:56:13.165261 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:13.164948 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 12:56:19.298190 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:19.298158 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:19.300575 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:19.298210 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:19.311170 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:19.311148 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:19.881444 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:19.881417 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4fvtv" Jul 10 12:56:37.987330 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:37.987243 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb"] Jul 10 12:56:37.990631 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:37.990608 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:37.993177 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:37.993156 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 10 12:56:37.997341 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:37.997028 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njqtp\" (UniqueName: \"kubernetes.io/projected/abac79c2-d95a-4186-ae7f-b10bb03be344-kube-api-access-njqtp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:37.997341 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:37.997062 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abac79c2-d95a-4186-ae7f-b10bb03be344-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:37.997341 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:37.997085 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abac79c2-d95a-4186-ae7f-b10bb03be344-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:37.997341 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:37.997122 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abac79c2-d95a-4186-ae7f-b10bb03be344-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:37.997341 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:37.997254 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abac79c2-d95a-4186-ae7f-b10bb03be344-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:37.997569 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:37.997375 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abac79c2-d95a-4186-ae7f-b10bb03be344-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.002880 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.002854 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb"] Jul 10 12:56:38.098243 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.098207 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abac79c2-d95a-4186-ae7f-b10bb03be344-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.098501 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.098285 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abac79c2-d95a-4186-ae7f-b10bb03be344-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.098501 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.098309 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njqtp\" (UniqueName: \"kubernetes.io/projected/abac79c2-d95a-4186-ae7f-b10bb03be344-kube-api-access-njqtp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.098501 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.098326 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abac79c2-d95a-4186-ae7f-b10bb03be344-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.098501 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.098416 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abac79c2-d95a-4186-ae7f-b10bb03be344-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.098501 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.098441 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abac79c2-d95a-4186-ae7f-b10bb03be344-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.098839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.098736 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abac79c2-d95a-4186-ae7f-b10bb03be344-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.098839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.098754 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abac79c2-d95a-4186-ae7f-b10bb03be344-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.098839 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.098796 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abac79c2-d95a-4186-ae7f-b10bb03be344-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.100741 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.100722 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abac79c2-d95a-4186-ae7f-b10bb03be344-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.100896 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.100880 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abac79c2-d95a-4186-ae7f-b10bb03be344-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.106259 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.106242 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njqtp\" (UniqueName: \"kubernetes.io/projected/abac79c2-d95a-4186-ae7f-b10bb03be344-kube-api-access-njqtp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mtvtb\" (UID: \"abac79c2-d95a-4186-ae7f-b10bb03be344\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.300270 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.300186 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:38.435791 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.435764 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb"] Jul 10 12:56:38.437754 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:56:38.437727 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabac79c2_d95a_4186_ae7f_b10bb03be344.slice/crio-3aaf45811b86ff22f716698ea65bf0c31c0a15785090bbdfeeecf9f609d5facb WatchSource:0}: Error finding container 3aaf45811b86ff22f716698ea65bf0c31c0a15785090bbdfeeecf9f609d5facb: Status 404 returned error can't find the container with id 3aaf45811b86ff22f716698ea65bf0c31c0a15785090bbdfeeecf9f609d5facb Jul 10 12:56:38.439184 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.439167 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 12:56:38.954489 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.954383 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" event={"ID":"abac79c2-d95a-4186-ae7f-b10bb03be344","Type":"ContainerStarted","Data":"fb460aa58001a6ba944be5be571dcc4939ecedff1177a558ecf16da9cefe62b2"} Jul 10 12:56:38.954489 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.954465 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" event={"ID":"abac79c2-d95a-4186-ae7f-b10bb03be344","Type":"ContainerStarted","Data":"3aaf45811b86ff22f716698ea65bf0c31c0a15785090bbdfeeecf9f609d5facb"} Jul 10 12:56:38.973160 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:38.973111 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" podStartSLOduration=1.787285566 podStartE2EDuration="1.973097263s" totalImagesPullingTime="185.811697ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:56:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:56:38.970587113 +0000 UTC m=+626.201697569" watchObservedRunningTime="2026-07-10 12:56:38.973097263 +0000 UTC m=+626.204207731" Jul 10 12:56:48.300745 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:48.300715 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:48.301174 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:48.300995 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:48.313277 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:48.313254 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:56:49.007422 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:56:49.007392 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mtvtb" Jul 10 12:59:14.465141 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.465107 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c8c758d8f-ggv74"] Jul 10 12:59:14.465749 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.465373 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c8c758d8f-ggv74" podUID="c7de4e7e-856b-4747-b929-f2da6b0ea257" containerName="manager" containerID="cri-o://5dfd98893d42a788d96b6d862ccf774b24ddccb4ceab16a4584daffa574bbe5a" gracePeriod=30 Jul 10 12:59:14.638663 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.638603 2557 generic.go:356] "Generic (PLEG): container finished" podID="c7de4e7e-856b-4747-b929-f2da6b0ea257" containerID="5dfd98893d42a788d96b6d862ccf774b24ddccb4ceab16a4584daffa574bbe5a" exitCode=0 Jul 10 12:59:14.638796 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.638660 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8c758d8f-ggv74" event={"ID":"c7de4e7e-856b-4747-b929-f2da6b0ea257","Type":"ContainerDied","Data":"5dfd98893d42a788d96b6d862ccf774b24ddccb4ceab16a4584daffa574bbe5a"} Jul 10 12:59:14.715833 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.715754 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:59:14.836807 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.836773 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xghlz\" (UniqueName: \"kubernetes.io/projected/c7de4e7e-856b-4747-b929-f2da6b0ea257-kube-api-access-xghlz\") pod \"c7de4e7e-856b-4747-b929-f2da6b0ea257\" (UID: \"c7de4e7e-856b-4747-b929-f2da6b0ea257\") " Jul 10 12:59:14.836996 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.836879 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7de4e7e-856b-4747-b929-f2da6b0ea257-webhook-cert\") pod \"c7de4e7e-856b-4747-b929-f2da6b0ea257\" (UID: \"c7de4e7e-856b-4747-b929-f2da6b0ea257\") " Jul 10 12:59:14.837060 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.837036 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7de4e7e-856b-4747-b929-f2da6b0ea257-service-ca\") pod \"c7de4e7e-856b-4747-b929-f2da6b0ea257\" (UID: \"c7de4e7e-856b-4747-b929-f2da6b0ea257\") " Jul 10 12:59:14.837460 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.837431 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7de4e7e-856b-4747-b929-f2da6b0ea257-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7de4e7e-856b-4747-b929-f2da6b0ea257" (UID: "c7de4e7e-856b-4747-b929-f2da6b0ea257"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 12:59:14.838968 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.838946 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7de4e7e-856b-4747-b929-f2da6b0ea257-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c7de4e7e-856b-4747-b929-f2da6b0ea257" (UID: "c7de4e7e-856b-4747-b929-f2da6b0ea257"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 12:59:14.839038 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.839015 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7de4e7e-856b-4747-b929-f2da6b0ea257-kube-api-access-xghlz" (OuterVolumeSpecName: "kube-api-access-xghlz") pod "c7de4e7e-856b-4747-b929-f2da6b0ea257" (UID: "c7de4e7e-856b-4747-b929-f2da6b0ea257"). InnerVolumeSpecName "kube-api-access-xghlz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 12:59:14.938377 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.938308 2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7de4e7e-856b-4747-b929-f2da6b0ea257-webhook-cert\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:59:14.938377 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.938340 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7de4e7e-856b-4747-b929-f2da6b0ea257-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:59:14.938377 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:14.938378 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xghlz\" (UniqueName: \"kubernetes.io/projected/c7de4e7e-856b-4747-b929-f2da6b0ea257-kube-api-access-xghlz\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 12:59:15.644721 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:15.644637 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8c758d8f-ggv74" event={"ID":"c7de4e7e-856b-4747-b929-f2da6b0ea257","Type":"ContainerDied","Data":"e4de6febb6de6c4bf8d3daa790aa6f92b104e3b3a3d69ba9c419cb6aab69f6cd"} Jul 10 12:59:15.644721 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:15.644671 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8c758d8f-ggv74" Jul 10 12:59:15.645151 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:15.644724 2557 scope.go:117] "RemoveContainer" containerID="5dfd98893d42a788d96b6d862ccf774b24ddccb4ceab16a4584daffa574bbe5a" Jul 10 12:59:15.662894 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:15.662856 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c8c758d8f-ggv74"] Jul 10 12:59:15.665078 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:15.665054 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c8c758d8f-ggv74"] Jul 10 12:59:16.407041 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.407014 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c8c758d8f-pvjq9"] Jul 10 12:59:16.407380 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.407368 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7de4e7e-856b-4747-b929-f2da6b0ea257" containerName="manager" Jul 10 12:59:16.407428 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.407382 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7de4e7e-856b-4747-b929-f2da6b0ea257" containerName="manager" Jul 10 12:59:16.407465 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.407458 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7de4e7e-856b-4747-b929-f2da6b0ea257" containerName="manager" Jul 10 12:59:16.411526 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.411507 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 12:59:16.415063 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.415041 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6zh2w\"" Jul 10 12:59:16.415193 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.415042 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 10 12:59:16.415193 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.415102 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 10 12:59:16.420827 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.420803 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c8c758d8f-pvjq9"] Jul 10 12:59:16.553778 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.553745 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70d817de-aeb3-48ac-a553-2a4bafb0c29d-webhook-cert\") pod \"maas-controller-5c8c758d8f-pvjq9\" (UID: \"70d817de-aeb3-48ac-a553-2a4bafb0c29d\") " pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 12:59:16.553951 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.553794 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70d817de-aeb3-48ac-a553-2a4bafb0c29d-service-ca\") pod \"maas-controller-5c8c758d8f-pvjq9\" (UID: \"70d817de-aeb3-48ac-a553-2a4bafb0c29d\") " pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 12:59:16.553951 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.553831 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fczhv\" (UniqueName: \"kubernetes.io/projected/70d817de-aeb3-48ac-a553-2a4bafb0c29d-kube-api-access-fczhv\") pod \"maas-controller-5c8c758d8f-pvjq9\" (UID: \"70d817de-aeb3-48ac-a553-2a4bafb0c29d\") " pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 12:59:16.654520 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.654489 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fczhv\" (UniqueName: \"kubernetes.io/projected/70d817de-aeb3-48ac-a553-2a4bafb0c29d-kube-api-access-fczhv\") pod \"maas-controller-5c8c758d8f-pvjq9\" (UID: \"70d817de-aeb3-48ac-a553-2a4bafb0c29d\") " pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 12:59:16.654963 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.654580 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70d817de-aeb3-48ac-a553-2a4bafb0c29d-webhook-cert\") pod \"maas-controller-5c8c758d8f-pvjq9\" (UID: \"70d817de-aeb3-48ac-a553-2a4bafb0c29d\") " pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 12:59:16.654963 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.654613 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70d817de-aeb3-48ac-a553-2a4bafb0c29d-service-ca\") pod \"maas-controller-5c8c758d8f-pvjq9\" (UID: \"70d817de-aeb3-48ac-a553-2a4bafb0c29d\") " pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 12:59:16.655197 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.655179 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70d817de-aeb3-48ac-a553-2a4bafb0c29d-service-ca\") pod \"maas-controller-5c8c758d8f-pvjq9\" (UID: \"70d817de-aeb3-48ac-a553-2a4bafb0c29d\") " pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 12:59:16.657112 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.657055 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70d817de-aeb3-48ac-a553-2a4bafb0c29d-webhook-cert\") pod \"maas-controller-5c8c758d8f-pvjq9\" (UID: \"70d817de-aeb3-48ac-a553-2a4bafb0c29d\") " pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 12:59:16.663058 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.663029 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fczhv\" (UniqueName: \"kubernetes.io/projected/70d817de-aeb3-48ac-a553-2a4bafb0c29d-kube-api-access-fczhv\") pod \"maas-controller-5c8c758d8f-pvjq9\" (UID: \"70d817de-aeb3-48ac-a553-2a4bafb0c29d\") " pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 12:59:16.723072 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.723030 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 12:59:16.857363 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:16.857322 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c8c758d8f-pvjq9"] Jul 10 12:59:16.859848 ip-10-0-135-152 kubenswrapper[2557]: W0710 12:59:16.859824 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d817de_aeb3_48ac_a553_2a4bafb0c29d.slice/crio-917e50ed803a7e2e73a6f795551f0853f18692ce5f8dc0380800bd47209a20dc WatchSource:0}: Error finding container 917e50ed803a7e2e73a6f795551f0853f18692ce5f8dc0380800bd47209a20dc: Status 404 returned error can't find the container with id 917e50ed803a7e2e73a6f795551f0853f18692ce5f8dc0380800bd47209a20dc Jul 10 12:59:17.267999 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:17.267966 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7de4e7e-856b-4747-b929-f2da6b0ea257" path="/var/lib/kubelet/pods/c7de4e7e-856b-4747-b929-f2da6b0ea257/volumes" Jul 10 12:59:17.656521 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:17.656431 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" event={"ID":"70d817de-aeb3-48ac-a553-2a4bafb0c29d","Type":"ContainerStarted","Data":"1bce754867d49386854ffff78a310b14806d713882e8b79213eed398cb0c3aa7"} Jul 10 12:59:17.656521 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:17.656486 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" event={"ID":"70d817de-aeb3-48ac-a553-2a4bafb0c29d","Type":"ContainerStarted","Data":"917e50ed803a7e2e73a6f795551f0853f18692ce5f8dc0380800bd47209a20dc"} Jul 10 12:59:17.656903 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:17.656524 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 12:59:17.679164 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:17.679111 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" podStartSLOduration=1.143554259 podStartE2EDuration="1.679092778s" totalImagesPullingTime="535.538519ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:59:17.676394536 +0000 UTC m=+784.907504984" watchObservedRunningTime="2026-07-10 12:59:17.679092778 +0000 UTC m=+784.910203258" Jul 10 12:59:28.666918 ip-10-0-135-152 kubenswrapper[2557]: I0710 12:59:28.666888 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c8c758d8f-pvjq9" Jul 10 13:01:13.201818 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:01:13.201745 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:01:13.202396 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:01:13.202150 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:06:13.227484 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:06:13.227452 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:06:13.229875 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:06:13.229856 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:11:13.259064 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:11:13.259039 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:11:13.263595 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:11:13.263567 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:15:16.597436 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:16.597399 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc"] Jul 10 13:15:16.601071 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:16.601046 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:16.603925 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:16.603902 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-72c69b0b-serving-cert\"" Jul 10 13:15:16.614286 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:16.614261 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc"] Jul 10 13:15:16.708665 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:16.708626 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f685dd9-77ed-4147-b925-908b389d1e65-openshift-service-ca\") pod \"maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:16.708665 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:16.708662 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rkgd\" (UniqueName: \"kubernetes.io/projected/3f685dd9-77ed-4147-b925-908b389d1e65-kube-api-access-8rkgd\") pod \"maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:16.708924 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:16.708783 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f685dd9-77ed-4147-b925-908b389d1e65-maas-api-tls\") pod \"maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:16.810307 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:16.810273 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f685dd9-77ed-4147-b925-908b389d1e65-maas-api-tls\") pod \"maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:16.810514 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:15:16.810453 2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-serving-cert: secret "maas-api-e2e-ait-72c69b0b-serving-cert" not found Jul 10 13:15:16.810514 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:16.810475 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f685dd9-77ed-4147-b925-908b389d1e65-openshift-service-ca\") pod \"maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:16.810626 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:16.810510 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rkgd\" (UniqueName: \"kubernetes.io/projected/3f685dd9-77ed-4147-b925-908b389d1e65-kube-api-access-8rkgd\") pod \"maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:16.810626 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:15:16.810544 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f685dd9-77ed-4147-b925-908b389d1e65-maas-api-tls podName:3f685dd9-77ed-4147-b925-908b389d1e65 nodeName:}" failed. No retries permitted until 2026-07-10 13:15:17.310522452 +0000 UTC m=+1744.541632863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f685dd9-77ed-4147-b925-908b389d1e65-maas-api-tls") pod "maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" (UID: "3f685dd9-77ed-4147-b925-908b389d1e65") : secret "maas-api-e2e-ait-72c69b0b-serving-cert" not found Jul 10 13:15:16.811097 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:16.811077 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f685dd9-77ed-4147-b925-908b389d1e65-openshift-service-ca\") pod \"maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:16.826150 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:16.826124 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rkgd\" (UniqueName: \"kubernetes.io/projected/3f685dd9-77ed-4147-b925-908b389d1e65-kube-api-access-8rkgd\") pod \"maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:17.314757 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:17.314718 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f685dd9-77ed-4147-b925-908b389d1e65-maas-api-tls\") pod \"maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:17.317245 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:17.317222 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f685dd9-77ed-4147-b925-908b389d1e65-maas-api-tls\") pod \"maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:17.512118 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:17.512085 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:17.682145 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:17.682108 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc"] Jul 10 13:15:17.683850 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:17.683823 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 13:15:17.929778 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:17.929687 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" event={"ID":"3f685dd9-77ed-4147-b925-908b389d1e65","Type":"ContainerStarted","Data":"3c7cabcd1321ca9a1c794b49a5b4d05efbc1a7ae61dc3cde97ab9a9f847938d8"} Jul 10 13:15:18.936491 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:18.936401 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" event={"ID":"3f685dd9-77ed-4147-b925-908b389d1e65","Type":"ContainerStarted","Data":"6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10"} Jul 10 13:15:18.936917 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:18.936551 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:18.955759 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:18.955708 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" podStartSLOduration=2.154254288 podStartE2EDuration="2.95569023s" totalImagesPullingTime="801.435942ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:15:18.954733146 +0000 UTC m=+1746.185843582" watchObservedRunningTime="2026-07-10 13:15:18.95569023 +0000 UTC m=+1746.186800662" Jul 10 13:15:22.084467 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.084433 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc"] Jul 10 13:15:22.085046 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.084657 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" podUID="3f685dd9-77ed-4147-b925-908b389d1e65" containerName="maas-api" containerID="cri-o://6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10" gracePeriod=30 Jul 10 13:15:22.333242 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.333219 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:22.462411 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.462385 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f685dd9-77ed-4147-b925-908b389d1e65-maas-api-tls\") pod \"3f685dd9-77ed-4147-b925-908b389d1e65\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " Jul 10 13:15:22.462571 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.462474 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f685dd9-77ed-4147-b925-908b389d1e65-openshift-service-ca\") pod \"3f685dd9-77ed-4147-b925-908b389d1e65\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " Jul 10 13:15:22.462571 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.462503 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rkgd\" (UniqueName: \"kubernetes.io/projected/3f685dd9-77ed-4147-b925-908b389d1e65-kube-api-access-8rkgd\") pod \"3f685dd9-77ed-4147-b925-908b389d1e65\" (UID: \"3f685dd9-77ed-4147-b925-908b389d1e65\") " Jul 10 13:15:22.462820 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.462796 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f685dd9-77ed-4147-b925-908b389d1e65-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f685dd9-77ed-4147-b925-908b389d1e65" (UID: "3f685dd9-77ed-4147-b925-908b389d1e65"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:15:22.464540 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.464513 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f685dd9-77ed-4147-b925-908b389d1e65-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f685dd9-77ed-4147-b925-908b389d1e65" (UID: "3f685dd9-77ed-4147-b925-908b389d1e65"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:15:22.464642 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.464616 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f685dd9-77ed-4147-b925-908b389d1e65-kube-api-access-8rkgd" (OuterVolumeSpecName: "kube-api-access-8rkgd") pod "3f685dd9-77ed-4147-b925-908b389d1e65" (UID: "3f685dd9-77ed-4147-b925-908b389d1e65"). InnerVolumeSpecName "kube-api-access-8rkgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:15:22.563794 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.563761 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f685dd9-77ed-4147-b925-908b389d1e65-maas-api-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:15:22.563794 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.563791 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f685dd9-77ed-4147-b925-908b389d1e65-openshift-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:15:22.563794 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.563800 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rkgd\" (UniqueName: \"kubernetes.io/projected/3f685dd9-77ed-4147-b925-908b389d1e65-kube-api-access-8rkgd\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:15:22.953970 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.953881 2557 generic.go:356] "Generic (PLEG): container finished" podID="3f685dd9-77ed-4147-b925-908b389d1e65" containerID="6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10" exitCode=0 Jul 10 13:15:22.953970 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.953922 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" Jul 10 13:15:22.953970 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.953960 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" event={"ID":"3f685dd9-77ed-4147-b925-908b389d1e65","Type":"ContainerDied","Data":"6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10"} Jul 10 13:15:22.954238 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.954016 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc" event={"ID":"3f685dd9-77ed-4147-b925-908b389d1e65","Type":"ContainerDied","Data":"3c7cabcd1321ca9a1c794b49a5b4d05efbc1a7ae61dc3cde97ab9a9f847938d8"} Jul 10 13:15:22.954238 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.954044 2557 scope.go:117] "RemoveContainer" containerID="6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10" Jul 10 13:15:22.962863 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.962845 2557 scope.go:117] "RemoveContainer" containerID="6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10" Jul 10 13:15:22.963113 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:15:22.963096 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10\": container with ID starting with 6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10 not found: ID does not exist" containerID="6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10" Jul 10 13:15:22.963167 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.963122 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10"} err="failed to get container status \"6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10\": rpc error: code = NotFound desc = could not find container \"6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10\": container with ID starting with 6fe330f42fe27554185cba3c40de381ed70359ec73dfc65f3a1abac60b895f10 not found: ID does not exist" Jul 10 13:15:22.988045 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.983854 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc"] Jul 10 13:15:22.994118 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:22.994085 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-72c69b0b-564db69f85-bjjkc"] Jul 10 13:15:23.267081 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:23.267050 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f685dd9-77ed-4147-b925-908b389d1e65" path="/var/lib/kubelet/pods/3f685dd9-77ed-4147-b925-908b389d1e65/volumes" Jul 10 13:15:29.271765 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.271733 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm"] Jul 10 13:15:29.272145 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.272132 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f685dd9-77ed-4147-b925-908b389d1e65" containerName="maas-api" Jul 10 13:15:29.272210 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.272150 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f685dd9-77ed-4147-b925-908b389d1e65" containerName="maas-api" Jul 10 13:15:29.272286 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.272273 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f685dd9-77ed-4147-b925-908b389d1e65" containerName="maas-api" Jul 10 13:15:29.276774 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.276753 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:29.281111 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.281083 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1bce492d-serving-cert\"" Jul 10 13:15:29.287195 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.287176 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm"] Jul 10 13:15:29.427879 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.427842 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc716183-5531-421d-a291-4f83f0155720-openshift-service-ca\") pod \"maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:29.428046 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.427882 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vghff\" (UniqueName: \"kubernetes.io/projected/dc716183-5531-421d-a291-4f83f0155720-kube-api-access-vghff\") pod \"maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:29.428046 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.427992 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc716183-5531-421d-a291-4f83f0155720-maas-api-tls\") pod \"maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:29.529277 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.529196 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc716183-5531-421d-a291-4f83f0155720-openshift-service-ca\") pod \"maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:29.529277 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.529233 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghff\" (UniqueName: \"kubernetes.io/projected/dc716183-5531-421d-a291-4f83f0155720-kube-api-access-vghff\") pod \"maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:29.529596 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.529305 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc716183-5531-421d-a291-4f83f0155720-maas-api-tls\") pod \"maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:29.529596 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:15:29.529435 2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-serving-cert: secret "maas-api-e2e-ait-1bce492d-serving-cert" not found Jul 10 13:15:29.529596 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:15:29.529508 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc716183-5531-421d-a291-4f83f0155720-maas-api-tls podName:dc716183-5531-421d-a291-4f83f0155720 nodeName:}" failed. No retries permitted until 2026-07-10 13:15:30.029491253 +0000 UTC m=+1757.260601667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dc716183-5531-421d-a291-4f83f0155720-maas-api-tls") pod "maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" (UID: "dc716183-5531-421d-a291-4f83f0155720") : secret "maas-api-e2e-ait-1bce492d-serving-cert" not found Jul 10 13:15:29.529952 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.529932 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc716183-5531-421d-a291-4f83f0155720-openshift-service-ca\") pod \"maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:29.541589 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:29.541562 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vghff\" (UniqueName: \"kubernetes.io/projected/dc716183-5531-421d-a291-4f83f0155720-kube-api-access-vghff\") pod \"maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:30.033964 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:30.033927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc716183-5531-421d-a291-4f83f0155720-maas-api-tls\") pod \"maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:30.036391 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:30.036361 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc716183-5531-421d-a291-4f83f0155720-maas-api-tls\") pod \"maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:30.190270 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:30.190230 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:30.539697 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:30.539672 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm"] Jul 10 13:15:30.541923 ip-10-0-135-152 kubenswrapper[2557]: W0710 13:15:30.541896 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc716183_5531_421d_a291_4f83f0155720.slice/crio-ef9f03a1a9c7415461ef78e93444d6535750550ec6f7861c837e840e8a47019a WatchSource:0}: Error finding container ef9f03a1a9c7415461ef78e93444d6535750550ec6f7861c837e840e8a47019a: Status 404 returned error can't find the container with id ef9f03a1a9c7415461ef78e93444d6535750550ec6f7861c837e840e8a47019a Jul 10 13:15:30.991226 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:30.991184 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" event={"ID":"dc716183-5531-421d-a291-4f83f0155720","Type":"ContainerStarted","Data":"7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031"} Jul 10 13:15:30.991339 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:30.991248 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" event={"ID":"dc716183-5531-421d-a291-4f83f0155720","Type":"ContainerStarted","Data":"ef9f03a1a9c7415461ef78e93444d6535750550ec6f7861c837e840e8a47019a"} Jul 10 13:15:30.991339 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:30.991289 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:31.022647 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:31.022592 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" podStartSLOduration=1.662366099 podStartE2EDuration="2.022577401s" totalImagesPullingTime="360.211302ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:15:31.020558541 +0000 UTC m=+1758.251668986" watchObservedRunningTime="2026-07-10 13:15:31.022577401 +0000 UTC m=+1758.253687833" Jul 10 13:15:34.538087 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:34.538056 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm"] Jul 10 13:15:34.538473 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:34.538253 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" podUID="dc716183-5531-421d-a291-4f83f0155720" containerName="maas-api" containerID="cri-o://7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031" gracePeriod=30 Jul 10 13:15:34.785176 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:34.785150 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:34.979573 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:34.979531 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc716183-5531-421d-a291-4f83f0155720-openshift-service-ca\") pod \"dc716183-5531-421d-a291-4f83f0155720\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " Jul 10 13:15:34.979760 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:34.979592 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc716183-5531-421d-a291-4f83f0155720-maas-api-tls\") pod \"dc716183-5531-421d-a291-4f83f0155720\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " Jul 10 13:15:34.979760 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:34.979634 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vghff\" (UniqueName: \"kubernetes.io/projected/dc716183-5531-421d-a291-4f83f0155720-kube-api-access-vghff\") pod \"dc716183-5531-421d-a291-4f83f0155720\" (UID: \"dc716183-5531-421d-a291-4f83f0155720\") " Jul 10 13:15:34.979966 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:34.979944 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc716183-5531-421d-a291-4f83f0155720-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc716183-5531-421d-a291-4f83f0155720" (UID: "dc716183-5531-421d-a291-4f83f0155720"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:15:34.981730 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:34.981709 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc716183-5531-421d-a291-4f83f0155720-kube-api-access-vghff" (OuterVolumeSpecName: "kube-api-access-vghff") pod "dc716183-5531-421d-a291-4f83f0155720" (UID: "dc716183-5531-421d-a291-4f83f0155720"). InnerVolumeSpecName "kube-api-access-vghff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:15:34.981926 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:34.981903 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc716183-5531-421d-a291-4f83f0155720-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc716183-5531-421d-a291-4f83f0155720" (UID: "dc716183-5531-421d-a291-4f83f0155720"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:15:35.009982 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.009949 2557 generic.go:356] "Generic (PLEG): container finished" podID="dc716183-5531-421d-a291-4f83f0155720" containerID="7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031" exitCode=0 Jul 10 13:15:35.010084 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.010007 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" Jul 10 13:15:35.010084 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.010027 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" event={"ID":"dc716183-5531-421d-a291-4f83f0155720","Type":"ContainerDied","Data":"7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031"} Jul 10 13:15:35.010165 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.010103 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm" event={"ID":"dc716183-5531-421d-a291-4f83f0155720","Type":"ContainerDied","Data":"ef9f03a1a9c7415461ef78e93444d6535750550ec6f7861c837e840e8a47019a"} Jul 10 13:15:35.010165 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.010127 2557 scope.go:117] "RemoveContainer" containerID="7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031" Jul 10 13:15:35.018540 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.018521 2557 scope.go:117] "RemoveContainer" containerID="7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031" Jul 10 13:15:35.018772 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:15:35.018754 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031\": container with ID starting with 7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031 not found: ID does not exist" containerID="7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031" Jul 10 13:15:35.018817 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.018781 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031"} err="failed to get container status \"7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031\": rpc error: code = NotFound desc = could not find container \"7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031\": container with ID starting with 7a829588c1ca97f161102cce3ce71d0ad496e62c8bd17008deb7bb0170223031 not found: ID does not exist" Jul 10 13:15:35.042271 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.042245 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm"] Jul 10 13:15:35.051628 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.051599 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1bce492d-5ddbcb4f64-4cpjm"] Jul 10 13:15:35.080456 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.080424 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vghff\" (UniqueName: \"kubernetes.io/projected/dc716183-5531-421d-a291-4f83f0155720-kube-api-access-vghff\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:15:35.080456 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.080451 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc716183-5531-421d-a291-4f83f0155720-openshift-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:15:35.080456 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.080461 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc716183-5531-421d-a291-4f83f0155720-maas-api-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:15:35.267562 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:35.267486 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc716183-5531-421d-a291-4f83f0155720" path="/var/lib/kubelet/pods/dc716183-5531-421d-a291-4f83f0155720/volumes" Jul 10 13:15:48.083896 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.083852 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk"] Jul 10 13:15:48.084284 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.084257 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc716183-5531-421d-a291-4f83f0155720" containerName="maas-api" Jul 10 13:15:48.084284 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.084274 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc716183-5531-421d-a291-4f83f0155720" containerName="maas-api" Jul 10 13:15:48.084385 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.084376 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc716183-5531-421d-a291-4f83f0155720" containerName="maas-api" Jul 10 13:15:48.087325 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.087309 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:48.090519 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.090500 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-68840b9c-serving-cert\"" Jul 10 13:15:48.102113 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.102080 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk"] Jul 10 13:15:48.191310 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.191273 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhhkr\" (UniqueName: \"kubernetes.io/projected/e49f3d96-f589-4e4e-9367-a48550e04a0a-kube-api-access-jhhkr\") pod \"maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk\" (UID: \"e49f3d96-f589-4e4e-9367-a48550e04a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:48.191310 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.191318 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e49f3d96-f589-4e4e-9367-a48550e04a0a-maas-api-tls\") pod \"maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk\" (UID: \"e49f3d96-f589-4e4e-9367-a48550e04a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:48.191531 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.191336 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e49f3d96-f589-4e4e-9367-a48550e04a0a-openshift-service-ca\") pod \"maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk\" (UID: \"e49f3d96-f589-4e4e-9367-a48550e04a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:48.292802 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.292760 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhhkr\" (UniqueName: \"kubernetes.io/projected/e49f3d96-f589-4e4e-9367-a48550e04a0a-kube-api-access-jhhkr\") pod \"maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk\" (UID: \"e49f3d96-f589-4e4e-9367-a48550e04a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:48.293006 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.292813 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e49f3d96-f589-4e4e-9367-a48550e04a0a-maas-api-tls\") pod \"maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk\" (UID: \"e49f3d96-f589-4e4e-9367-a48550e04a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:48.293006 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.292832 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e49f3d96-f589-4e4e-9367-a48550e04a0a-openshift-service-ca\") pod \"maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk\" (UID: \"e49f3d96-f589-4e4e-9367-a48550e04a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:48.293537 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.293515 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e49f3d96-f589-4e4e-9367-a48550e04a0a-openshift-service-ca\") pod \"maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk\" (UID: \"e49f3d96-f589-4e4e-9367-a48550e04a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:48.295241 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.295217 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e49f3d96-f589-4e4e-9367-a48550e04a0a-maas-api-tls\") pod \"maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk\" (UID: \"e49f3d96-f589-4e4e-9367-a48550e04a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:48.304451 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.304426 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhhkr\" (UniqueName: \"kubernetes.io/projected/e49f3d96-f589-4e4e-9367-a48550e04a0a-kube-api-access-jhhkr\") pod \"maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk\" (UID: \"e49f3d96-f589-4e4e-9367-a48550e04a0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:48.398330 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.398244 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:48.537151 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:48.537090 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk"] Jul 10 13:15:48.539448 ip-10-0-135-152 kubenswrapper[2557]: W0710 13:15:48.539418 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode49f3d96_f589_4e4e_9367_a48550e04a0a.slice/crio-5b734616c7160acbf76902d5f34c280c9cae3703aa5f93f6888919c70312bf67 WatchSource:0}: Error finding container 5b734616c7160acbf76902d5f34c280c9cae3703aa5f93f6888919c70312bf67: Status 404 returned error can't find the container with id 5b734616c7160acbf76902d5f34c280c9cae3703aa5f93f6888919c70312bf67 Jul 10 13:15:49.073570 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:49.073534 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" event={"ID":"e49f3d96-f589-4e4e-9367-a48550e04a0a","Type":"ContainerStarted","Data":"7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf"} Jul 10 13:15:49.073769 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:49.073594 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" event={"ID":"e49f3d96-f589-4e4e-9367-a48550e04a0a","Type":"ContainerStarted","Data":"5b734616c7160acbf76902d5f34c280c9cae3703aa5f93f6888919c70312bf67"} Jul 10 13:15:49.073769 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:49.073666 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:49.094255 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:49.094205 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" podStartSLOduration=0.688958716 podStartE2EDuration="1.094190309s" totalImagesPullingTime="405.231593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:15:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:15:49.092403129 +0000 UTC m=+1776.323513562" watchObservedRunningTime="2026-07-10 13:15:49.094190309 +0000 UTC m=+1776.325300741" Jul 10 13:15:52.677920 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:52.677889 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk"] Jul 10 13:15:52.678392 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:52.678134 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" podUID="e49f3d96-f589-4e4e-9367-a48550e04a0a" containerName="maas-api" containerID="cri-o://7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf" gracePeriod=30 Jul 10 13:15:52.932982 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:52.932921 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:53.033396 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.033368 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhhkr\" (UniqueName: \"kubernetes.io/projected/e49f3d96-f589-4e4e-9367-a48550e04a0a-kube-api-access-jhhkr\") pod \"e49f3d96-f589-4e4e-9367-a48550e04a0a\" (UID: \"e49f3d96-f589-4e4e-9367-a48550e04a0a\") " Jul 10 13:15:53.033588 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.033485 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e49f3d96-f589-4e4e-9367-a48550e04a0a-maas-api-tls\") pod \"e49f3d96-f589-4e4e-9367-a48550e04a0a\" (UID: \"e49f3d96-f589-4e4e-9367-a48550e04a0a\") " Jul 10 13:15:53.033588 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.033509 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e49f3d96-f589-4e4e-9367-a48550e04a0a-openshift-service-ca\") pod \"e49f3d96-f589-4e4e-9367-a48550e04a0a\" (UID: \"e49f3d96-f589-4e4e-9367-a48550e04a0a\") " Jul 10 13:15:53.033926 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.033891 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e49f3d96-f589-4e4e-9367-a48550e04a0a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e49f3d96-f589-4e4e-9367-a48550e04a0a" (UID: "e49f3d96-f589-4e4e-9367-a48550e04a0a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:15:53.035576 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.035541 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e49f3d96-f589-4e4e-9367-a48550e04a0a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e49f3d96-f589-4e4e-9367-a48550e04a0a" (UID: "e49f3d96-f589-4e4e-9367-a48550e04a0a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:15:53.035670 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.035571 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e49f3d96-f589-4e4e-9367-a48550e04a0a-kube-api-access-jhhkr" (OuterVolumeSpecName: "kube-api-access-jhhkr") pod "e49f3d96-f589-4e4e-9367-a48550e04a0a" (UID: "e49f3d96-f589-4e4e-9367-a48550e04a0a"). InnerVolumeSpecName "kube-api-access-jhhkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:15:53.093667 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.093636 2557 generic.go:356] "Generic (PLEG): container finished" podID="e49f3d96-f589-4e4e-9367-a48550e04a0a" containerID="7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf" exitCode=0 Jul 10 13:15:53.093822 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.093681 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" Jul 10 13:15:53.093822 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.093690 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" event={"ID":"e49f3d96-f589-4e4e-9367-a48550e04a0a","Type":"ContainerDied","Data":"7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf"} Jul 10 13:15:53.093822 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.093734 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk" event={"ID":"e49f3d96-f589-4e4e-9367-a48550e04a0a","Type":"ContainerDied","Data":"5b734616c7160acbf76902d5f34c280c9cae3703aa5f93f6888919c70312bf67"} Jul 10 13:15:53.093822 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.093756 2557 scope.go:117] "RemoveContainer" containerID="7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf" Jul 10 13:15:53.106556 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.105001 2557 scope.go:117] "RemoveContainer" containerID="7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf" Jul 10 13:15:53.106556 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:15:53.105364 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf\": container with ID starting with 7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf not found: ID does not exist" containerID="7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf" Jul 10 13:15:53.106556 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.105401 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf"} err="failed to get container status \"7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf\": rpc error: code = NotFound desc = could not find container \"7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf\": container with ID starting with 7f956ce1d842f6d4c1fd44942fb721c2bb056a35857ad273c6dc8ef10c2214cf not found: ID does not exist" Jul 10 13:15:53.123673 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.123640 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk"] Jul 10 13:15:53.125776 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.125754 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-68840b9c-5c5bfdcdc7-2r5rk"] Jul 10 13:15:53.134623 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.134597 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e49f3d96-f589-4e4e-9367-a48550e04a0a-maas-api-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:15:53.134736 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.134627 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e49f3d96-f589-4e4e-9367-a48550e04a0a-openshift-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:15:53.134736 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.134644 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhhkr\" (UniqueName: \"kubernetes.io/projected/e49f3d96-f589-4e4e-9367-a48550e04a0a-kube-api-access-jhhkr\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:15:53.267447 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:15:53.267411 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e49f3d96-f589-4e4e-9367-a48550e04a0a" path="/var/lib/kubelet/pods/e49f3d96-f589-4e4e-9367-a48550e04a0a/volumes" Jul 10 13:16:13.287090 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:16:13.286989 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:16:13.292158 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:16:13.292138 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:18:22.818508 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:22.818477 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f"] Jul 10 13:18:22.819030 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:22.818879 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e49f3d96-f589-4e4e-9367-a48550e04a0a" containerName="maas-api" Jul 10 13:18:22.819030 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:22.818897 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e49f3d96-f589-4e4e-9367-a48550e04a0a" containerName="maas-api" Jul 10 13:18:22.819030 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:22.818989 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e49f3d96-f589-4e4e-9367-a48550e04a0a" containerName="maas-api" Jul 10 13:18:22.821886 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:22.821865 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:18:22.824898 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:22.824876 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6c7c4d1d-serving-cert\"" Jul 10 13:18:22.897259 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:22.897223 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f"] Jul 10 13:18:22.961628 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:22.961590 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/516a189f-9a21-4141-bbd9-1a96c655eee1-openshift-service-ca\") pod \"maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f\" (UID: \"516a189f-9a21-4141-bbd9-1a96c655eee1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:18:22.961839 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:22.961712 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmk8w\" (UniqueName: \"kubernetes.io/projected/516a189f-9a21-4141-bbd9-1a96c655eee1-kube-api-access-rmk8w\") pod \"maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f\" (UID: \"516a189f-9a21-4141-bbd9-1a96c655eee1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:18:22.961839 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:22.961749 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/516a189f-9a21-4141-bbd9-1a96c655eee1-maas-api-tls\") pod \"maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f\" (UID: \"516a189f-9a21-4141-bbd9-1a96c655eee1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:18:23.062489 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:23.062446 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/516a189f-9a21-4141-bbd9-1a96c655eee1-openshift-service-ca\") pod \"maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f\" (UID: \"516a189f-9a21-4141-bbd9-1a96c655eee1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:18:23.062664 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:23.062554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmk8w\" (UniqueName: \"kubernetes.io/projected/516a189f-9a21-4141-bbd9-1a96c655eee1-kube-api-access-rmk8w\") pod \"maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f\" (UID: \"516a189f-9a21-4141-bbd9-1a96c655eee1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:18:23.062664 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:23.062580 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/516a189f-9a21-4141-bbd9-1a96c655eee1-maas-api-tls\") pod \"maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f\" (UID: \"516a189f-9a21-4141-bbd9-1a96c655eee1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:18:23.063075 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:23.063054 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/516a189f-9a21-4141-bbd9-1a96c655eee1-openshift-service-ca\") pod \"maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f\" (UID: \"516a189f-9a21-4141-bbd9-1a96c655eee1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:18:23.064997 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:23.064941 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/516a189f-9a21-4141-bbd9-1a96c655eee1-maas-api-tls\") pod \"maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f\" (UID: \"516a189f-9a21-4141-bbd9-1a96c655eee1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:18:23.071891 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:23.071815 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmk8w\" (UniqueName: \"kubernetes.io/projected/516a189f-9a21-4141-bbd9-1a96c655eee1-kube-api-access-rmk8w\") pod \"maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f\" (UID: \"516a189f-9a21-4141-bbd9-1a96c655eee1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:18:23.132790 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:23.132754 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:18:23.268218 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:23.268196 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f"] Jul 10 13:18:23.270450 ip-10-0-135-152 kubenswrapper[2557]: W0710 13:18:23.270425 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516a189f_9a21_4141_bbd9_1a96c655eee1.slice/crio-58bb708f7992c270a5bccbbf1b267b10901bf8f259a58bd5c4456b068ca33587 WatchSource:0}: Error finding container 58bb708f7992c270a5bccbbf1b267b10901bf8f259a58bd5c4456b068ca33587: Status 404 returned error can't find the container with id 58bb708f7992c270a5bccbbf1b267b10901bf8f259a58bd5c4456b068ca33587 Jul 10 13:18:23.759028 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:23.758994 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" event={"ID":"516a189f-9a21-4141-bbd9-1a96c655eee1","Type":"ContainerStarted","Data":"0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96"} Jul 10 13:18:23.759208 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:23.759046 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" event={"ID":"516a189f-9a21-4141-bbd9-1a96c655eee1","Type":"ContainerStarted","Data":"58bb708f7992c270a5bccbbf1b267b10901bf8f259a58bd5c4456b068ca33587"} Jul 10 13:18:23.759208 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:23.759122 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:18:23.778158 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:23.778110 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" podStartSLOduration=1.4873673379999999 podStartE2EDuration="1.778094028s" totalImagesPullingTime="290.72669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:18:23.776720646 +0000 UTC m=+1931.007831104" watchObservedRunningTime="2026-07-10 13:18:23.778094028 +0000 UTC m=+1931.009204486" Jul 10 13:18:29.769776 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:18:29.769748 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:19:10.205396 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.205167 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f"] Jul 10 13:19:10.206369 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.206288 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" podUID="516a189f-9a21-4141-bbd9-1a96c655eee1" containerName="maas-api" containerID="cri-o://0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96" gracePeriod=30 Jul 10 13:19:10.456820 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.456800 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:19:10.575851 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.575804 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/516a189f-9a21-4141-bbd9-1a96c655eee1-maas-api-tls\") pod \"516a189f-9a21-4141-bbd9-1a96c655eee1\" (UID: \"516a189f-9a21-4141-bbd9-1a96c655eee1\") " Jul 10 13:19:10.575851 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.575860 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmk8w\" (UniqueName: \"kubernetes.io/projected/516a189f-9a21-4141-bbd9-1a96c655eee1-kube-api-access-rmk8w\") pod \"516a189f-9a21-4141-bbd9-1a96c655eee1\" (UID: \"516a189f-9a21-4141-bbd9-1a96c655eee1\") " Jul 10 13:19:10.576115 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.575901 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/516a189f-9a21-4141-bbd9-1a96c655eee1-openshift-service-ca\") pod \"516a189f-9a21-4141-bbd9-1a96c655eee1\" (UID: \"516a189f-9a21-4141-bbd9-1a96c655eee1\") " Jul 10 13:19:10.576305 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.576280 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/516a189f-9a21-4141-bbd9-1a96c655eee1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "516a189f-9a21-4141-bbd9-1a96c655eee1" (UID: "516a189f-9a21-4141-bbd9-1a96c655eee1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:19:10.578018 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.577994 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/516a189f-9a21-4141-bbd9-1a96c655eee1-kube-api-access-rmk8w" (OuterVolumeSpecName: "kube-api-access-rmk8w") pod "516a189f-9a21-4141-bbd9-1a96c655eee1" (UID: "516a189f-9a21-4141-bbd9-1a96c655eee1"). InnerVolumeSpecName "kube-api-access-rmk8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:19:10.578096 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.578020 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/516a189f-9a21-4141-bbd9-1a96c655eee1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "516a189f-9a21-4141-bbd9-1a96c655eee1" (UID: "516a189f-9a21-4141-bbd9-1a96c655eee1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:19:10.676691 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.676654 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/516a189f-9a21-4141-bbd9-1a96c655eee1-maas-api-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:19:10.676691 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.676686 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmk8w\" (UniqueName: \"kubernetes.io/projected/516a189f-9a21-4141-bbd9-1a96c655eee1-kube-api-access-rmk8w\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:19:10.676691 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.676698 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/516a189f-9a21-4141-bbd9-1a96c655eee1-openshift-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:19:10.980506 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.980471 2557 generic.go:356] "Generic (PLEG): container finished" podID="516a189f-9a21-4141-bbd9-1a96c655eee1" containerID="0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96" exitCode=0 Jul 10 13:19:10.980692 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.980540 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" Jul 10 13:19:10.980692 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.980555 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" event={"ID":"516a189f-9a21-4141-bbd9-1a96c655eee1","Type":"ContainerDied","Data":"0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96"} Jul 10 13:19:10.980692 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.980633 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f" event={"ID":"516a189f-9a21-4141-bbd9-1a96c655eee1","Type":"ContainerDied","Data":"58bb708f7992c270a5bccbbf1b267b10901bf8f259a58bd5c4456b068ca33587"} Jul 10 13:19:10.980692 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.980655 2557 scope.go:117] "RemoveContainer" containerID="0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96" Jul 10 13:19:10.989242 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.989221 2557 scope.go:117] "RemoveContainer" containerID="0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96" Jul 10 13:19:10.989497 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:19:10.989478 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96\": container with ID starting with 0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96 not found: ID does not exist" containerID="0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96" Jul 10 13:19:10.989567 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:10.989503 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96"} err="failed to get container status \"0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96\": rpc error: code = NotFound desc = could not find container \"0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96\": container with ID starting with 0c774bb816c1bffb165d8bd84d86d13fb225ddd6d83d534899a59a9b73096e96 not found: ID does not exist" Jul 10 13:19:11.003053 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:11.003027 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f"] Jul 10 13:19:11.007336 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:11.007315 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6c7c4d1d-69c6f4fb7f-7qm7f"] Jul 10 13:19:11.266686 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:19:11.266614 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="516a189f-9a21-4141-bbd9-1a96c655eee1" path="/var/lib/kubelet/pods/516a189f-9a21-4141-bbd9-1a96c655eee1/volumes" Jul 10 13:21:06.689809 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.689778 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh"] Jul 10 13:21:06.690233 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.690111 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="516a189f-9a21-4141-bbd9-1a96c655eee1" containerName="maas-api" Jul 10 13:21:06.690233 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.690122 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="516a189f-9a21-4141-bbd9-1a96c655eee1" containerName="maas-api" Jul 10 13:21:06.690233 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.690193 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="516a189f-9a21-4141-bbd9-1a96c655eee1" containerName="maas-api" Jul 10 13:21:06.693291 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.693273 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:06.698640 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.698620 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-9a834f-serving-cert\"" Jul 10 13:21:06.706074 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.706050 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh"] Jul 10 13:21:06.757586 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.757554 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxqjf\" (UniqueName: \"kubernetes.io/projected/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-kube-api-access-jxqjf\") pod \"maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh\" (UID: \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:06.757747 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.757616 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-maas-api-tls\") pod \"maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh\" (UID: \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:06.757747 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.757719 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh\" (UID: \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:06.858274 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.858240 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh\" (UID: \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:06.858274 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.858281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxqjf\" (UniqueName: \"kubernetes.io/projected/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-kube-api-access-jxqjf\") pod \"maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh\" (UID: \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:06.858533 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.858317 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-maas-api-tls\") pod \"maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh\" (UID: \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:06.858954 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.858930 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh\" (UID: \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:06.860758 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.860740 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-maas-api-tls\") pod \"maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh\" (UID: \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:06.880936 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:06.880908 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxqjf\" (UniqueName: \"kubernetes.io/projected/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-kube-api-access-jxqjf\") pod \"maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh\" (UID: \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:07.003135 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:07.003090 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:07.144719 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:07.144692 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh"] Jul 10 13:21:07.146236 ip-10-0-135-152 kubenswrapper[2557]: W0710 13:21:07.146177 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f274bd_c1a7_4717_bc2e_7203bfe46a8a.slice/crio-46be710778cea3f37e6f4d809bd7a92e7dd82d00783d35b261af4b28c9e57b5b WatchSource:0}: Error finding container 46be710778cea3f37e6f4d809bd7a92e7dd82d00783d35b261af4b28c9e57b5b: Status 404 returned error can't find the container with id 46be710778cea3f37e6f4d809bd7a92e7dd82d00783d35b261af4b28c9e57b5b Jul 10 13:21:07.147552 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:07.147534 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 13:21:07.510766 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:07.510730 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" event={"ID":"76f274bd-c1a7-4717-bc2e-7203bfe46a8a","Type":"ContainerStarted","Data":"46be710778cea3f37e6f4d809bd7a92e7dd82d00783d35b261af4b28c9e57b5b"} Jul 10 13:21:08.516767 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:08.516723 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" event={"ID":"76f274bd-c1a7-4717-bc2e-7203bfe46a8a","Type":"ContainerStarted","Data":"5d4e42eabeea394d1a1d2de5b5d5ef919cc609819901bb631f255cd604c00ff2"} Jul 10 13:21:08.517198 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:08.516866 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:08.537463 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:08.537322 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" podStartSLOduration=1.909230346 podStartE2EDuration="2.537301519s" totalImagesPullingTime="628.071173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:21:08.536992825 +0000 UTC m=+2095.768103262" watchObservedRunningTime="2026-07-10 13:21:08.537301519 +0000 UTC m=+2095.768411953" Jul 10 13:21:13.321437 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:13.321292 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:21:13.326287 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:13.326266 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:21:14.526959 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:14.526932 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:21:14.844121 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:14.844042 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj"] Jul 10 13:21:14.847496 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:14.847474 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:21:14.853412 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:14.853376 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-76c01a-serving-cert\"" Jul 10 13:21:14.860485 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:14.860461 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj"] Jul 10 13:21:14.931402 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:14.931366 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-maas-api-tls\") pod \"maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj\" (UID: \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:21:14.931581 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:14.931426 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-openshift-service-ca\") pod \"maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj\" (UID: \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:21:14.931581 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:14.931453 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrqdt\" (UniqueName: \"kubernetes.io/projected/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-kube-api-access-mrqdt\") pod \"maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj\" (UID: \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:21:15.032750 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:15.032717 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-maas-api-tls\") pod \"maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj\" (UID: \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:21:15.032957 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:15.032789 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-openshift-service-ca\") pod \"maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj\" (UID: \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:21:15.032957 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:15.032826 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqdt\" (UniqueName: \"kubernetes.io/projected/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-kube-api-access-mrqdt\") pod \"maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj\" (UID: \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:21:15.033588 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:15.033561 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-openshift-service-ca\") pod \"maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj\" (UID: \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:21:15.035387 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:15.035363 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-maas-api-tls\") pod \"maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj\" (UID: \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:21:15.042567 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:15.042546 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrqdt\" (UniqueName: \"kubernetes.io/projected/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-kube-api-access-mrqdt\") pod \"maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj\" (UID: \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:21:15.160163 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:15.160084 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:21:15.293650 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:15.293586 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj"] Jul 10 13:21:15.295955 ip-10-0-135-152 kubenswrapper[2557]: W0710 13:21:15.295923 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6fe014_a4df_4a4f_b77d_96f1a84e1ede.slice/crio-4fc9335ac94c6e89be1bb520c154205f5fb25fd294f81aece47a1cd14156cc41 WatchSource:0}: Error finding container 4fc9335ac94c6e89be1bb520c154205f5fb25fd294f81aece47a1cd14156cc41: Status 404 returned error can't find the container with id 4fc9335ac94c6e89be1bb520c154205f5fb25fd294f81aece47a1cd14156cc41 Jul 10 13:21:15.549704 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:15.549670 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" event={"ID":"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede","Type":"ContainerStarted","Data":"4fc9335ac94c6e89be1bb520c154205f5fb25fd294f81aece47a1cd14156cc41"} Jul 10 13:21:16.555941 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:16.555905 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" event={"ID":"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede","Type":"ContainerStarted","Data":"0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7"} Jul 10 13:21:16.556312 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:16.555970 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:21:16.575945 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:16.575899 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" podStartSLOduration=2.2466810170000002 podStartE2EDuration="2.575881701s" totalImagesPullingTime="329.200684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:21:16.574879455 +0000 UTC m=+2103.805989886" watchObservedRunningTime="2026-07-10 13:21:16.575881701 +0000 UTC m=+2103.806992134" Jul 10 13:21:22.567394 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:21:22.567365 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:22:10.202489 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.202393 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw"] Jul 10 13:22:10.206660 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.206634 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:10.209793 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.209767 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-reuse-0fbd6d-serving-cert\"" Jul 10 13:22:10.220039 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.220011 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw"] Jul 10 13:22:10.346765 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.346730 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45b435cc-774a-4826-8695-25f58e4cc82d-maas-api-tls\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw\" (UID: \"45b435cc-774a-4826-8695-25f58e4cc82d\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:10.346952 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.346778 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45b435cc-774a-4826-8695-25f58e4cc82d-openshift-service-ca\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw\" (UID: \"45b435cc-774a-4826-8695-25f58e4cc82d\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:10.346952 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.346897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhbz6\" (UniqueName: \"kubernetes.io/projected/45b435cc-774a-4826-8695-25f58e4cc82d-kube-api-access-lhbz6\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw\" (UID: \"45b435cc-774a-4826-8695-25f58e4cc82d\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:10.448321 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.448290 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45b435cc-774a-4826-8695-25f58e4cc82d-maas-api-tls\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw\" (UID: \"45b435cc-774a-4826-8695-25f58e4cc82d\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:10.448524 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.448340 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45b435cc-774a-4826-8695-25f58e4cc82d-openshift-service-ca\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw\" (UID: \"45b435cc-774a-4826-8695-25f58e4cc82d\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:10.448524 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.448444 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhbz6\" (UniqueName: \"kubernetes.io/projected/45b435cc-774a-4826-8695-25f58e4cc82d-kube-api-access-lhbz6\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw\" (UID: \"45b435cc-774a-4826-8695-25f58e4cc82d\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:10.449552 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.449511 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45b435cc-774a-4826-8695-25f58e4cc82d-openshift-service-ca\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw\" (UID: \"45b435cc-774a-4826-8695-25f58e4cc82d\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:10.451005 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.450981 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45b435cc-774a-4826-8695-25f58e4cc82d-maas-api-tls\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw\" (UID: \"45b435cc-774a-4826-8695-25f58e4cc82d\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:10.460155 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.460127 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhbz6\" (UniqueName: \"kubernetes.io/projected/45b435cc-774a-4826-8695-25f58e4cc82d-kube-api-access-lhbz6\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw\" (UID: \"45b435cc-774a-4826-8695-25f58e4cc82d\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:10.518969 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.518931 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:10.658409 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.658331 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw"] Jul 10 13:22:10.660784 ip-10-0-135-152 kubenswrapper[2557]: W0710 13:22:10.660758 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b435cc_774a_4826_8695_25f58e4cc82d.slice/crio-a8009074e4dfce3e816637b679ba50a8c735d2c0806fd1e66739aad45003ea89 WatchSource:0}: Error finding container a8009074e4dfce3e816637b679ba50a8c735d2c0806fd1e66739aad45003ea89: Status 404 returned error can't find the container with id a8009074e4dfce3e816637b679ba50a8c735d2c0806fd1e66739aad45003ea89 Jul 10 13:22:10.814442 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:10.814328 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" event={"ID":"45b435cc-774a-4826-8695-25f58e4cc82d","Type":"ContainerStarted","Data":"a8009074e4dfce3e816637b679ba50a8c735d2c0806fd1e66739aad45003ea89"} Jul 10 13:22:11.820851 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:11.820811 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" event={"ID":"45b435cc-774a-4826-8695-25f58e4cc82d","Type":"ContainerStarted","Data":"10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a"} Jul 10 13:22:11.821270 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:11.820887 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:11.847656 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:11.847597 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" podStartSLOduration=1.31121025 podStartE2EDuration="1.847581206s" totalImagesPullingTime="536.370956ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:22:11.846320342 +0000 UTC m=+2159.077430787" watchObservedRunningTime="2026-07-10 13:22:11.847581206 +0000 UTC m=+2159.078691639" Jul 10 13:22:17.831787 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:17.831749 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:46.506601 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:46.506569 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw"] Jul 10 13:22:46.507175 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:46.506828 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" podUID="45b435cc-774a-4826-8695-25f58e4cc82d" containerName="maas-api" containerID="cri-o://10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a" gracePeriod=30 Jul 10 13:22:46.959243 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:46.959218 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:46.982400 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:46.982365 2557 generic.go:356] "Generic (PLEG): container finished" podID="45b435cc-774a-4826-8695-25f58e4cc82d" containerID="10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a" exitCode=0 Jul 10 13:22:46.982577 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:46.982409 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" Jul 10 13:22:46.982577 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:46.982442 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" event={"ID":"45b435cc-774a-4826-8695-25f58e4cc82d","Type":"ContainerDied","Data":"10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a"} Jul 10 13:22:46.982577 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:46.982504 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw" event={"ID":"45b435cc-774a-4826-8695-25f58e4cc82d","Type":"ContainerDied","Data":"a8009074e4dfce3e816637b679ba50a8c735d2c0806fd1e66739aad45003ea89"} Jul 10 13:22:46.982577 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:46.982527 2557 scope.go:117] "RemoveContainer" containerID="10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a" Jul 10 13:22:46.991040 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:46.991022 2557 scope.go:117] "RemoveContainer" containerID="10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a" Jul 10 13:22:46.991282 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:22:46.991264 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a\": container with ID starting with 10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a not found: ID does not exist" containerID="10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a" Jul 10 13:22:46.991373 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:46.991290 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a"} err="failed to get container status \"10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a\": rpc error: code = NotFound desc = could not find container \"10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a\": container with ID starting with 10706284d5d8d3302ddea423f93be0611eaa3601ddff81da8f75564a5892786a not found: ID does not exist" Jul 10 13:22:47.082388 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:47.082278 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhbz6\" (UniqueName: \"kubernetes.io/projected/45b435cc-774a-4826-8695-25f58e4cc82d-kube-api-access-lhbz6\") pod \"45b435cc-774a-4826-8695-25f58e4cc82d\" (UID: \"45b435cc-774a-4826-8695-25f58e4cc82d\") " Jul 10 13:22:47.082388 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:47.082336 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45b435cc-774a-4826-8695-25f58e4cc82d-openshift-service-ca\") pod \"45b435cc-774a-4826-8695-25f58e4cc82d\" (UID: \"45b435cc-774a-4826-8695-25f58e4cc82d\") " Jul 10 13:22:47.082628 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:47.082411 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45b435cc-774a-4826-8695-25f58e4cc82d-maas-api-tls\") pod \"45b435cc-774a-4826-8695-25f58e4cc82d\" (UID: \"45b435cc-774a-4826-8695-25f58e4cc82d\") " Jul 10 13:22:47.082783 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:47.082758 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45b435cc-774a-4826-8695-25f58e4cc82d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "45b435cc-774a-4826-8695-25f58e4cc82d" (UID: "45b435cc-774a-4826-8695-25f58e4cc82d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:22:47.084530 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:47.084501 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45b435cc-774a-4826-8695-25f58e4cc82d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "45b435cc-774a-4826-8695-25f58e4cc82d" (UID: "45b435cc-774a-4826-8695-25f58e4cc82d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:22:47.084623 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:47.084540 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45b435cc-774a-4826-8695-25f58e4cc82d-kube-api-access-lhbz6" (OuterVolumeSpecName: "kube-api-access-lhbz6") pod "45b435cc-774a-4826-8695-25f58e4cc82d" (UID: "45b435cc-774a-4826-8695-25f58e4cc82d"). InnerVolumeSpecName "kube-api-access-lhbz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:22:47.183525 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:47.183486 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45b435cc-774a-4826-8695-25f58e4cc82d-maas-api-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:22:47.183525 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:47.183516 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhbz6\" (UniqueName: \"kubernetes.io/projected/45b435cc-774a-4826-8695-25f58e4cc82d-kube-api-access-lhbz6\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:22:47.183525 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:47.183526 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45b435cc-774a-4826-8695-25f58e4cc82d-openshift-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:22:47.298649 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:47.298620 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw"] Jul 10 13:22:47.302224 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:47.302198 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-c7rjw"] Jul 10 13:22:49.267516 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:22:49.267484 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45b435cc-774a-4826-8695-25f58e4cc82d" path="/var/lib/kubelet/pods/45b435cc-774a-4826-8695-25f58e4cc82d/volumes" Jul 10 13:23:38.169683 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.169594 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr"] Jul 10 13:23:38.170269 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.169980 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b435cc-774a-4826-8695-25f58e4cc82d" containerName="maas-api" Jul 10 13:23:38.170269 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.169996 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b435cc-774a-4826-8695-25f58e4cc82d" containerName="maas-api" Jul 10 13:23:38.170269 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.170074 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="45b435cc-774a-4826-8695-25f58e4cc82d" containerName="maas-api" Jul 10 13:23:38.173075 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.173054 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:38.177339 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.177319 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-reuse-0fbd6d-serving-cert\"" Jul 10 13:23:38.220272 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.220241 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr"] Jul 10 13:23:38.271968 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.271920 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zv4t\" (UniqueName: \"kubernetes.io/projected/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-kube-api-access-6zv4t\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:38.272382 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.271998 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-maas-api-tls\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:38.272382 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.272103 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-openshift-service-ca\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:38.373008 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.372964 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-openshift-service-ca\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:38.373241 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.373055 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zv4t\" (UniqueName: \"kubernetes.io/projected/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-kube-api-access-6zv4t\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:38.373241 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.373097 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-maas-api-tls\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:38.373241 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:23:38.373202 2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-serving-cert: secret "maas-api-e2e-reuse-0fbd6d-serving-cert" not found Jul 10 13:23:38.373467 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:23:38.373266 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-maas-api-tls podName:5c3dba4b-1903-42fa-ae5d-b1b5025f799e nodeName:}" failed. No retries permitted until 2026-07-10 13:23:38.873250751 +0000 UTC m=+2246.104361162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-maas-api-tls") pod "maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" (UID: "5c3dba4b-1903-42fa-ae5d-b1b5025f799e") : secret "maas-api-e2e-reuse-0fbd6d-serving-cert" not found Jul 10 13:23:38.373823 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.373800 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-openshift-service-ca\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:38.398968 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.398938 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zv4t\" (UniqueName: \"kubernetes.io/projected/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-kube-api-access-6zv4t\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:38.878428 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.878390 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-maas-api-tls\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:38.880897 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:38.880874 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-maas-api-tls\") pod \"maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:39.083517 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:39.083478 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:39.226338 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:39.226313 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr"] Jul 10 13:23:39.229389 ip-10-0-135-152 kubenswrapper[2557]: W0710 13:23:39.229335 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3dba4b_1903_42fa_ae5d_b1b5025f799e.slice/crio-1a2d8b870902bacce11c08d2f4ec999eb55458a46c67c7e852fcdfaac9c064a4 WatchSource:0}: Error finding container 1a2d8b870902bacce11c08d2f4ec999eb55458a46c67c7e852fcdfaac9c064a4: Status 404 returned error can't find the container with id 1a2d8b870902bacce11c08d2f4ec999eb55458a46c67c7e852fcdfaac9c064a4 Jul 10 13:23:40.224613 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:40.224581 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" event={"ID":"5c3dba4b-1903-42fa-ae5d-b1b5025f799e","Type":"ContainerStarted","Data":"df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a"} Jul 10 13:23:40.224805 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:40.224628 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" event={"ID":"5c3dba4b-1903-42fa-ae5d-b1b5025f799e","Type":"ContainerStarted","Data":"1a2d8b870902bacce11c08d2f4ec999eb55458a46c67c7e852fcdfaac9c064a4"} Jul 10 13:23:40.224805 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:40.224718 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:23:40.245181 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:40.245126 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" podStartSLOduration=1.591152955 podStartE2EDuration="2.245109173s" totalImagesPullingTime="653.956218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:23:40.243191013 +0000 UTC m=+2247.474301445" watchObservedRunningTime="2026-07-10 13:23:40.245109173 +0000 UTC m=+2247.476219605" Jul 10 13:23:46.235554 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:23:46.235521 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:24:39.498213 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:39.498182 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr"] Jul 10 13:24:39.498791 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:39.498388 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" podUID="5c3dba4b-1903-42fa-ae5d-b1b5025f799e" containerName="maas-api" containerID="cri-o://df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a" gracePeriod=30 Jul 10 13:24:39.751244 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:39.751186 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:24:39.879376 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:39.879328 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-openshift-service-ca\") pod \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " Jul 10 13:24:39.879573 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:39.879394 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-maas-api-tls\") pod \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " Jul 10 13:24:39.879573 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:39.879435 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zv4t\" (UniqueName: \"kubernetes.io/projected/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-kube-api-access-6zv4t\") pod \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\" (UID: \"5c3dba4b-1903-42fa-ae5d-b1b5025f799e\") " Jul 10 13:24:39.879774 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:39.879747 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5c3dba4b-1903-42fa-ae5d-b1b5025f799e" (UID: "5c3dba4b-1903-42fa-ae5d-b1b5025f799e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:24:39.881651 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:39.881616 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5c3dba4b-1903-42fa-ae5d-b1b5025f799e" (UID: "5c3dba4b-1903-42fa-ae5d-b1b5025f799e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:24:39.881651 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:39.881639 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-kube-api-access-6zv4t" (OuterVolumeSpecName: "kube-api-access-6zv4t") pod "5c3dba4b-1903-42fa-ae5d-b1b5025f799e" (UID: "5c3dba4b-1903-42fa-ae5d-b1b5025f799e"). InnerVolumeSpecName "kube-api-access-6zv4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:24:39.980770 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:39.980736 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-openshift-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:24:39.980770 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:39.980764 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-maas-api-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:24:39.980770 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:39.980774 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zv4t\" (UniqueName: \"kubernetes.io/projected/5c3dba4b-1903-42fa-ae5d-b1b5025f799e-kube-api-access-6zv4t\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:24:40.505659 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:40.505618 2557 generic.go:356] "Generic (PLEG): container finished" podID="5c3dba4b-1903-42fa-ae5d-b1b5025f799e" containerID="df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a" exitCode=0 Jul 10 13:24:40.506066 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:40.505665 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" Jul 10 13:24:40.506066 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:40.505691 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" event={"ID":"5c3dba4b-1903-42fa-ae5d-b1b5025f799e","Type":"ContainerDied","Data":"df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a"} Jul 10 13:24:40.506066 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:40.505742 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr" event={"ID":"5c3dba4b-1903-42fa-ae5d-b1b5025f799e","Type":"ContainerDied","Data":"1a2d8b870902bacce11c08d2f4ec999eb55458a46c67c7e852fcdfaac9c064a4"} Jul 10 13:24:40.506066 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:40.505772 2557 scope.go:117] "RemoveContainer" containerID="df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a" Jul 10 13:24:40.514801 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:40.514780 2557 scope.go:117] "RemoveContainer" containerID="df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a" Jul 10 13:24:40.515067 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:24:40.515048 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a\": container with ID starting with df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a not found: ID does not exist" containerID="df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a" Jul 10 13:24:40.515139 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:40.515077 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a"} err="failed to get container status \"df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a\": rpc error: code = NotFound desc = could not find container \"df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a\": container with ID starting with df585ffc6d64ce29efdecb566274efcaff836ed5ae991038b177826add3cda7a not found: ID does not exist" Jul 10 13:24:40.528940 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:40.528912 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr"] Jul 10 13:24:40.536066 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:40.536045 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-0fbd6d-646d77b694-77lhr"] Jul 10 13:24:41.266980 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:24:41.266950 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c3dba4b-1903-42fa-ae5d-b1b5025f799e" path="/var/lib/kubelet/pods/5c3dba4b-1903-42fa-ae5d-b1b5025f799e/volumes" Jul 10 13:25:37.643374 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:37.643325 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh"] Jul 10 13:25:37.643990 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:37.643557 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" podUID="76f274bd-c1a7-4717-bc2e-7203bfe46a8a" containerName="maas-api" containerID="cri-o://5d4e42eabeea394d1a1d2de5b5d5ef919cc609819901bb631f255cd604c00ff2" gracePeriod=30 Jul 10 13:25:37.780361 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:37.780318 2557 generic.go:356] "Generic (PLEG): container finished" podID="76f274bd-c1a7-4717-bc2e-7203bfe46a8a" containerID="5d4e42eabeea394d1a1d2de5b5d5ef919cc609819901bb631f255cd604c00ff2" exitCode=0 Jul 10 13:25:37.780503 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:37.780382 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" event={"ID":"76f274bd-c1a7-4717-bc2e-7203bfe46a8a","Type":"ContainerDied","Data":"5d4e42eabeea394d1a1d2de5b5d5ef919cc609819901bb631f255cd604c00ff2"} Jul 10 13:25:37.887507 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:37.887482 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:25:37.924110 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:37.924041 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-openshift-service-ca\") pod \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\" (UID: \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\") " Jul 10 13:25:37.924110 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:37.924104 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-maas-api-tls\") pod \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\" (UID: \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\") " Jul 10 13:25:37.924371 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:37.924148 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxqjf\" (UniqueName: \"kubernetes.io/projected/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-kube-api-access-jxqjf\") pod \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\" (UID: \"76f274bd-c1a7-4717-bc2e-7203bfe46a8a\") " Jul 10 13:25:37.924511 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:37.924478 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "76f274bd-c1a7-4717-bc2e-7203bfe46a8a" (UID: "76f274bd-c1a7-4717-bc2e-7203bfe46a8a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:25:37.926401 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:37.926342 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "76f274bd-c1a7-4717-bc2e-7203bfe46a8a" (UID: "76f274bd-c1a7-4717-bc2e-7203bfe46a8a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:25:37.926505 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:37.926447 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-kube-api-access-jxqjf" (OuterVolumeSpecName: "kube-api-access-jxqjf") pod "76f274bd-c1a7-4717-bc2e-7203bfe46a8a" (UID: "76f274bd-c1a7-4717-bc2e-7203bfe46a8a"). InnerVolumeSpecName "kube-api-access-jxqjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:25:38.025109 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:38.025068 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-maas-api-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:25:38.025109 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:38.025100 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxqjf\" (UniqueName: \"kubernetes.io/projected/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-kube-api-access-jxqjf\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:25:38.025109 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:38.025110 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76f274bd-c1a7-4717-bc2e-7203bfe46a8a-openshift-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:25:38.786340 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:38.786305 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" event={"ID":"76f274bd-c1a7-4717-bc2e-7203bfe46a8a","Type":"ContainerDied","Data":"46be710778cea3f37e6f4d809bd7a92e7dd82d00783d35b261af4b28c9e57b5b"} Jul 10 13:25:38.786765 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:38.786393 2557 scope.go:117] "RemoveContainer" containerID="5d4e42eabeea394d1a1d2de5b5d5ef919cc609819901bb631f255cd604c00ff2" Jul 10 13:25:38.786765 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:38.786318 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh" Jul 10 13:25:38.807522 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:38.807494 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh"] Jul 10 13:25:38.814466 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:38.814443 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9a834f-7d8f596b66-lwxqh"] Jul 10 13:25:39.268344 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:25:39.268309 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76f274bd-c1a7-4717-bc2e-7203bfe46a8a" path="/var/lib/kubelet/pods/76f274bd-c1a7-4717-bc2e-7203bfe46a8a/volumes" Jul 10 13:26:13.352008 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:13.351883 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:26:13.360009 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:13.358900 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:26:20.544847 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.544807 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj"] Jul 10 13:26:20.545483 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.545044 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" podUID="9b6fe014-a4df-4a4f-b77d-96f1a84e1ede" containerName="maas-api" containerID="cri-o://0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7" gracePeriod=30 Jul 10 13:26:20.791964 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.791939 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:26:20.900891 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.900784 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrqdt\" (UniqueName: \"kubernetes.io/projected/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-kube-api-access-mrqdt\") pod \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\" (UID: \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\") " Jul 10 13:26:20.901070 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.900894 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-openshift-service-ca\") pod \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\" (UID: \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\") " Jul 10 13:26:20.901070 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.900936 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-maas-api-tls\") pod \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\" (UID: \"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede\") " Jul 10 13:26:20.901270 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.901243 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b6fe014-a4df-4a4f-b77d-96f1a84e1ede" (UID: "9b6fe014-a4df-4a4f-b77d-96f1a84e1ede"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:26:20.903045 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.903013 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-kube-api-access-mrqdt" (OuterVolumeSpecName: "kube-api-access-mrqdt") pod "9b6fe014-a4df-4a4f-b77d-96f1a84e1ede" (UID: "9b6fe014-a4df-4a4f-b77d-96f1a84e1ede"). InnerVolumeSpecName "kube-api-access-mrqdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:26:20.903142 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.903048 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b6fe014-a4df-4a4f-b77d-96f1a84e1ede" (UID: "9b6fe014-a4df-4a4f-b77d-96f1a84e1ede"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:26:20.977641 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.977610 2557 generic.go:356] "Generic (PLEG): container finished" podID="9b6fe014-a4df-4a4f-b77d-96f1a84e1ede" containerID="0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7" exitCode=0 Jul 10 13:26:20.977807 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.977659 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" event={"ID":"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede","Type":"ContainerDied","Data":"0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7"} Jul 10 13:26:20.977807 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.977699 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" event={"ID":"9b6fe014-a4df-4a4f-b77d-96f1a84e1ede","Type":"ContainerDied","Data":"4fc9335ac94c6e89be1bb520c154205f5fb25fd294f81aece47a1cd14156cc41"} Jul 10 13:26:20.977807 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.977721 2557 scope.go:117] "RemoveContainer" containerID="0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7" Jul 10 13:26:20.977807 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.977659 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj" Jul 10 13:26:20.986831 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.986815 2557 scope.go:117] "RemoveContainer" containerID="0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7" Jul 10 13:26:20.987089 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:26:20.987071 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7\": container with ID starting with 0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7 not found: ID does not exist" containerID="0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7" Jul 10 13:26:20.987136 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:20.987097 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7"} err="failed to get container status \"0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7\": rpc error: code = NotFound desc = could not find container \"0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7\": container with ID starting with 0fd510156becf8d280b223aaffc91f1f32521f22e96781208f2cd8b4d832c6c7 not found: ID does not exist" Jul 10 13:26:21.000721 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:21.000698 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj"] Jul 10 13:26:21.002153 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:21.002136 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrqdt\" (UniqueName: \"kubernetes.io/projected/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-kube-api-access-mrqdt\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:26:21.002215 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:21.002158 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-openshift-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:26:21.002215 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:21.002169 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede-maas-api-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:26:21.005232 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:21.005212 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-76c01a-856cbfb86d-n6cnj"] Jul 10 13:26:21.267115 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:21.267074 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b6fe014-a4df-4a4f-b77d-96f1a84e1ede" path="/var/lib/kubelet/pods/9b6fe014-a4df-4a4f-b77d-96f1a84e1ede/volumes" Jul 10 13:26:30.882159 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.882127 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22"] Jul 10 13:26:30.882613 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.882549 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76f274bd-c1a7-4717-bc2e-7203bfe46a8a" containerName="maas-api" Jul 10 13:26:30.882613 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.882571 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="76f274bd-c1a7-4717-bc2e-7203bfe46a8a" containerName="maas-api" Jul 10 13:26:30.882613 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.882584 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b6fe014-a4df-4a4f-b77d-96f1a84e1ede" containerName="maas-api" Jul 10 13:26:30.882613 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.882595 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b6fe014-a4df-4a4f-b77d-96f1a84e1ede" containerName="maas-api" Jul 10 13:26:30.882613 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.882613 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3dba4b-1903-42fa-ae5d-b1b5025f799e" containerName="maas-api" Jul 10 13:26:30.882773 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.882624 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3dba4b-1903-42fa-ae5d-b1b5025f799e" containerName="maas-api" Jul 10 13:26:30.882773 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.882706 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b6fe014-a4df-4a4f-b77d-96f1a84e1ede" containerName="maas-api" Jul 10 13:26:30.882773 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.882721 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="76f274bd-c1a7-4717-bc2e-7203bfe46a8a" containerName="maas-api" Jul 10 13:26:30.882773 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.882737 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3dba4b-1903-42fa-ae5d-b1b5025f799e" containerName="maas-api" Jul 10 13:26:30.887170 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.887144 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:30.889749 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.889731 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-01c5f9-serving-cert\"" Jul 10 13:26:30.895336 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.895307 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22"] Jul 10 13:26:30.990192 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.990153 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mkk2\" (UniqueName: \"kubernetes.io/projected/d092dfaa-cac3-4965-811f-1979f3a32b48-kube-api-access-8mkk2\") pod \"maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22\" (UID: \"d092dfaa-cac3-4965-811f-1979f3a32b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:30.990393 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.990210 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d092dfaa-cac3-4965-811f-1979f3a32b48-maas-api-tls\") pod \"maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22\" (UID: \"d092dfaa-cac3-4965-811f-1979f3a32b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:30.990393 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:30.990226 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d092dfaa-cac3-4965-811f-1979f3a32b48-openshift-service-ca\") pod \"maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22\" (UID: \"d092dfaa-cac3-4965-811f-1979f3a32b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:31.091133 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:31.091098 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mkk2\" (UniqueName: \"kubernetes.io/projected/d092dfaa-cac3-4965-811f-1979f3a32b48-kube-api-access-8mkk2\") pod \"maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22\" (UID: \"d092dfaa-cac3-4965-811f-1979f3a32b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:31.091334 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:31.091156 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d092dfaa-cac3-4965-811f-1979f3a32b48-maas-api-tls\") pod \"maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22\" (UID: \"d092dfaa-cac3-4965-811f-1979f3a32b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:31.091334 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:31.091177 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d092dfaa-cac3-4965-811f-1979f3a32b48-openshift-service-ca\") pod \"maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22\" (UID: \"d092dfaa-cac3-4965-811f-1979f3a32b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:31.091816 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:31.091797 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d092dfaa-cac3-4965-811f-1979f3a32b48-openshift-service-ca\") pod \"maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22\" (UID: \"d092dfaa-cac3-4965-811f-1979f3a32b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:31.093701 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:31.093678 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d092dfaa-cac3-4965-811f-1979f3a32b48-maas-api-tls\") pod \"maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22\" (UID: \"d092dfaa-cac3-4965-811f-1979f3a32b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:31.100628 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:31.100607 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mkk2\" (UniqueName: \"kubernetes.io/projected/d092dfaa-cac3-4965-811f-1979f3a32b48-kube-api-access-8mkk2\") pod \"maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22\" (UID: \"d092dfaa-cac3-4965-811f-1979f3a32b48\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:31.198797 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:31.198706 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:31.339887 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:31.339837 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22"] Jul 10 13:26:31.342681 ip-10-0-135-152 kubenswrapper[2557]: W0710 13:26:31.342639 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd092dfaa_cac3_4965_811f_1979f3a32b48.slice/crio-92013451eea85fd2f3551ee837964f04a9023d0d738cc99114ac160bc3f6f3e2 WatchSource:0}: Error finding container 92013451eea85fd2f3551ee837964f04a9023d0d738cc99114ac160bc3f6f3e2: Status 404 returned error can't find the container with id 92013451eea85fd2f3551ee837964f04a9023d0d738cc99114ac160bc3f6f3e2 Jul 10 13:26:31.344082 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:31.344065 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 13:26:32.030593 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:32.030560 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" event={"ID":"d092dfaa-cac3-4965-811f-1979f3a32b48","Type":"ContainerStarted","Data":"92013451eea85fd2f3551ee837964f04a9023d0d738cc99114ac160bc3f6f3e2"} Jul 10 13:26:33.036873 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:33.036836 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" event={"ID":"d092dfaa-cac3-4965-811f-1979f3a32b48","Type":"ContainerStarted","Data":"916ef57d91caf73446d8a144dead335464ca577af58a595a585a7b78b32b2815"} Jul 10 13:26:33.037265 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:33.036906 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:33.055466 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:33.055417 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" podStartSLOduration=2.426845744 podStartE2EDuration="3.055398488s" totalImagesPullingTime="628.552744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:33.054216146 +0000 UTC m=+2420.285326590" watchObservedRunningTime="2026-07-10 13:26:33.055398488 +0000 UTC m=+2420.286508920" Jul 10 13:26:38.759828 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.759732 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z"] Jul 10 13:26:38.763636 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.763612 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:38.766527 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.766507 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-ed2758-serving-cert\"" Jul 10 13:26:38.773634 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.773609 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z"] Jul 10 13:26:38.867028 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.866992 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj9pf\" (UniqueName: \"kubernetes.io/projected/60f1394d-70ce-4ea7-ba8e-13560045873a-kube-api-access-kj9pf\") pod \"maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z\" (UID: \"60f1394d-70ce-4ea7-ba8e-13560045873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:38.867216 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.867036 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60f1394d-70ce-4ea7-ba8e-13560045873a-openshift-service-ca\") pod \"maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z\" (UID: \"60f1394d-70ce-4ea7-ba8e-13560045873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:38.867216 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.867158 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60f1394d-70ce-4ea7-ba8e-13560045873a-maas-api-tls\") pod \"maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z\" (UID: \"60f1394d-70ce-4ea7-ba8e-13560045873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:38.968215 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.968175 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60f1394d-70ce-4ea7-ba8e-13560045873a-maas-api-tls\") pod \"maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z\" (UID: \"60f1394d-70ce-4ea7-ba8e-13560045873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:38.968421 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.968241 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj9pf\" (UniqueName: \"kubernetes.io/projected/60f1394d-70ce-4ea7-ba8e-13560045873a-kube-api-access-kj9pf\") pod \"maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z\" (UID: \"60f1394d-70ce-4ea7-ba8e-13560045873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:38.968421 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.968259 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60f1394d-70ce-4ea7-ba8e-13560045873a-openshift-service-ca\") pod \"maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z\" (UID: \"60f1394d-70ce-4ea7-ba8e-13560045873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:38.968904 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.968885 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60f1394d-70ce-4ea7-ba8e-13560045873a-openshift-service-ca\") pod \"maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z\" (UID: \"60f1394d-70ce-4ea7-ba8e-13560045873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:38.970674 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.970652 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60f1394d-70ce-4ea7-ba8e-13560045873a-maas-api-tls\") pod \"maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z\" (UID: \"60f1394d-70ce-4ea7-ba8e-13560045873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:38.977536 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:38.977504 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj9pf\" (UniqueName: \"kubernetes.io/projected/60f1394d-70ce-4ea7-ba8e-13560045873a-kube-api-access-kj9pf\") pod \"maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z\" (UID: \"60f1394d-70ce-4ea7-ba8e-13560045873a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:39.047581 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:39.047491 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:39.075980 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:39.075944 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:39.218143 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:39.218059 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z"] Jul 10 13:26:39.220610 ip-10-0-135-152 kubenswrapper[2557]: W0710 13:26:39.220580 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f1394d_70ce_4ea7_ba8e_13560045873a.slice/crio-90b68c81d7c41977b72c3f4c7c9751c57d413e0fbeff1593b21fe750afadf9e1 WatchSource:0}: Error finding container 90b68c81d7c41977b72c3f4c7c9751c57d413e0fbeff1593b21fe750afadf9e1: Status 404 returned error can't find the container with id 90b68c81d7c41977b72c3f4c7c9751c57d413e0fbeff1593b21fe750afadf9e1 Jul 10 13:26:40.070013 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:40.069971 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" event={"ID":"60f1394d-70ce-4ea7-ba8e-13560045873a","Type":"ContainerStarted","Data":"d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8"} Jul 10 13:26:40.070509 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:40.070027 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" event={"ID":"60f1394d-70ce-4ea7-ba8e-13560045873a","Type":"ContainerStarted","Data":"90b68c81d7c41977b72c3f4c7c9751c57d413e0fbeff1593b21fe750afadf9e1"} Jul 10 13:26:40.070509 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:40.070054 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:40.088151 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:40.088088 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" podStartSLOduration=1.757237027 podStartE2EDuration="2.088068368s" totalImagesPullingTime="330.831341ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:40.087719512 +0000 UTC m=+2427.318829946" watchObservedRunningTime="2026-07-10 13:26:40.088068368 +0000 UTC m=+2427.319178802" Jul 10 13:26:46.082361 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:46.082329 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:51.956405 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:51.956335 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22"] Jul 10 13:26:51.956869 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:51.956630 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" podUID="d092dfaa-cac3-4965-811f-1979f3a32b48" containerName="maas-api" containerID="cri-o://916ef57d91caf73446d8a144dead335464ca577af58a595a585a7b78b32b2815" gracePeriod=30 Jul 10 13:26:52.127754 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:52.127535 2557 generic.go:356] "Generic (PLEG): container finished" podID="d092dfaa-cac3-4965-811f-1979f3a32b48" containerID="916ef57d91caf73446d8a144dead335464ca577af58a595a585a7b78b32b2815" exitCode=0 Jul 10 13:26:52.127754 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:52.127648 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" event={"ID":"d092dfaa-cac3-4965-811f-1979f3a32b48","Type":"ContainerDied","Data":"916ef57d91caf73446d8a144dead335464ca577af58a595a585a7b78b32b2815"} Jul 10 13:26:52.206857 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:52.206800 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:52.288830 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:52.288800 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d092dfaa-cac3-4965-811f-1979f3a32b48-openshift-service-ca\") pod \"d092dfaa-cac3-4965-811f-1979f3a32b48\" (UID: \"d092dfaa-cac3-4965-811f-1979f3a32b48\") " Jul 10 13:26:52.289008 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:52.288848 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d092dfaa-cac3-4965-811f-1979f3a32b48-maas-api-tls\") pod \"d092dfaa-cac3-4965-811f-1979f3a32b48\" (UID: \"d092dfaa-cac3-4965-811f-1979f3a32b48\") " Jul 10 13:26:52.289008 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:52.288917 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mkk2\" (UniqueName: \"kubernetes.io/projected/d092dfaa-cac3-4965-811f-1979f3a32b48-kube-api-access-8mkk2\") pod \"d092dfaa-cac3-4965-811f-1979f3a32b48\" (UID: \"d092dfaa-cac3-4965-811f-1979f3a32b48\") " Jul 10 13:26:52.289222 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:52.289196 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d092dfaa-cac3-4965-811f-1979f3a32b48-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d092dfaa-cac3-4965-811f-1979f3a32b48" (UID: "d092dfaa-cac3-4965-811f-1979f3a32b48"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:26:52.291063 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:52.291031 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d092dfaa-cac3-4965-811f-1979f3a32b48-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d092dfaa-cac3-4965-811f-1979f3a32b48" (UID: "d092dfaa-cac3-4965-811f-1979f3a32b48"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:26:52.291063 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:52.291035 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d092dfaa-cac3-4965-811f-1979f3a32b48-kube-api-access-8mkk2" (OuterVolumeSpecName: "kube-api-access-8mkk2") pod "d092dfaa-cac3-4965-811f-1979f3a32b48" (UID: "d092dfaa-cac3-4965-811f-1979f3a32b48"). InnerVolumeSpecName "kube-api-access-8mkk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:26:52.390471 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:52.390431 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mkk2\" (UniqueName: \"kubernetes.io/projected/d092dfaa-cac3-4965-811f-1979f3a32b48-kube-api-access-8mkk2\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:26:52.390471 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:52.390462 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d092dfaa-cac3-4965-811f-1979f3a32b48-openshift-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:26:52.390471 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:52.390472 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d092dfaa-cac3-4965-811f-1979f3a32b48-maas-api-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:26:53.133148 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:53.133120 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" Jul 10 13:26:53.133610 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:53.133145 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22" event={"ID":"d092dfaa-cac3-4965-811f-1979f3a32b48","Type":"ContainerDied","Data":"92013451eea85fd2f3551ee837964f04a9023d0d738cc99114ac160bc3f6f3e2"} Jul 10 13:26:53.133610 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:53.133237 2557 scope.go:117] "RemoveContainer" containerID="916ef57d91caf73446d8a144dead335464ca577af58a595a585a7b78b32b2815" Jul 10 13:26:53.155950 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:53.155918 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22"] Jul 10 13:26:53.160258 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:53.160236 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01c5f9-9c6bb7d9b-s2d22"] Jul 10 13:26:53.267420 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:53.267390 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d092dfaa-cac3-4965-811f-1979f3a32b48" path="/var/lib/kubelet/pods/d092dfaa-cac3-4965-811f-1979f3a32b48/volumes" Jul 10 13:26:59.147944 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:59.147904 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z"] Jul 10 13:26:59.148426 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:59.148197 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" podUID="60f1394d-70ce-4ea7-ba8e-13560045873a" containerName="maas-api" containerID="cri-o://d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8" gracePeriod=30 Jul 10 13:26:59.194874 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:26:59.194837 2557 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f1394d_70ce_4ea7_ba8e_13560045873a.slice/crio-conmon-d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8.scope\": RecentStats: unable to find data in memory cache]" Jul 10 13:26:59.404474 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:59.404402 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:26:59.563567 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:59.563524 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60f1394d-70ce-4ea7-ba8e-13560045873a-openshift-service-ca\") pod \"60f1394d-70ce-4ea7-ba8e-13560045873a\" (UID: \"60f1394d-70ce-4ea7-ba8e-13560045873a\") " Jul 10 13:26:59.563769 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:59.563643 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60f1394d-70ce-4ea7-ba8e-13560045873a-maas-api-tls\") pod \"60f1394d-70ce-4ea7-ba8e-13560045873a\" (UID: \"60f1394d-70ce-4ea7-ba8e-13560045873a\") " Jul 10 13:26:59.563769 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:59.563725 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj9pf\" (UniqueName: \"kubernetes.io/projected/60f1394d-70ce-4ea7-ba8e-13560045873a-kube-api-access-kj9pf\") pod \"60f1394d-70ce-4ea7-ba8e-13560045873a\" (UID: \"60f1394d-70ce-4ea7-ba8e-13560045873a\") " Jul 10 13:26:59.563988 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:59.563956 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60f1394d-70ce-4ea7-ba8e-13560045873a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "60f1394d-70ce-4ea7-ba8e-13560045873a" (UID: "60f1394d-70ce-4ea7-ba8e-13560045873a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:26:59.565748 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:59.565713 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60f1394d-70ce-4ea7-ba8e-13560045873a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "60f1394d-70ce-4ea7-ba8e-13560045873a" (UID: "60f1394d-70ce-4ea7-ba8e-13560045873a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:26:59.565748 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:59.565736 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60f1394d-70ce-4ea7-ba8e-13560045873a-kube-api-access-kj9pf" (OuterVolumeSpecName: "kube-api-access-kj9pf") pod "60f1394d-70ce-4ea7-ba8e-13560045873a" (UID: "60f1394d-70ce-4ea7-ba8e-13560045873a"). InnerVolumeSpecName "kube-api-access-kj9pf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:26:59.665394 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:59.665267 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60f1394d-70ce-4ea7-ba8e-13560045873a-maas-api-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:26:59.665394 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:59.665301 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj9pf\" (UniqueName: \"kubernetes.io/projected/60f1394d-70ce-4ea7-ba8e-13560045873a-kube-api-access-kj9pf\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:26:59.665394 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:26:59.665312 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60f1394d-70ce-4ea7-ba8e-13560045873a-openshift-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:27:00.170185 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:00.170147 2557 generic.go:356] "Generic (PLEG): container finished" podID="60f1394d-70ce-4ea7-ba8e-13560045873a" containerID="d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8" exitCode=0 Jul 10 13:27:00.170633 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:00.170197 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" Jul 10 13:27:00.170633 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:00.170235 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" event={"ID":"60f1394d-70ce-4ea7-ba8e-13560045873a","Type":"ContainerDied","Data":"d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8"} Jul 10 13:27:00.170633 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:00.170289 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z" event={"ID":"60f1394d-70ce-4ea7-ba8e-13560045873a","Type":"ContainerDied","Data":"90b68c81d7c41977b72c3f4c7c9751c57d413e0fbeff1593b21fe750afadf9e1"} Jul 10 13:27:00.170633 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:00.170312 2557 scope.go:117] "RemoveContainer" containerID="d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8" Jul 10 13:27:00.179042 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:00.179024 2557 scope.go:117] "RemoveContainer" containerID="d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8" Jul 10 13:27:00.179292 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:27:00.179273 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8\": container with ID starting with d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8 not found: ID does not exist" containerID="d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8" Jul 10 13:27:00.179395 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:00.179300 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8"} err="failed to get container status \"d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8\": rpc error: code = NotFound desc = could not find container \"d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8\": container with ID starting with d0aaa4f48f8f6a403aece0ca86fd7e4534732ec766fd6cbd42dc7260458b95f8 not found: ID does not exist" Jul 10 13:27:00.193469 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:00.193441 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z"] Jul 10 13:27:00.196915 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:00.196886 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ed2758-64ff4d46f8-8742z"] Jul 10 13:27:01.266650 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:01.266617 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60f1394d-70ce-4ea7-ba8e-13560045873a" path="/var/lib/kubelet/pods/60f1394d-70ce-4ea7-ba8e-13560045873a/volumes" Jul 10 13:27:08.869858 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.869820 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5"] Jul 10 13:27:08.870386 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.870369 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d092dfaa-cac3-4965-811f-1979f3a32b48" containerName="maas-api" Jul 10 13:27:08.870449 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.870391 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d092dfaa-cac3-4965-811f-1979f3a32b48" containerName="maas-api" Jul 10 13:27:08.870449 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.870419 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60f1394d-70ce-4ea7-ba8e-13560045873a" containerName="maas-api" Jul 10 13:27:08.870449 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.870428 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="60f1394d-70ce-4ea7-ba8e-13560045873a" containerName="maas-api" Jul 10 13:27:08.870563 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.870540 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d092dfaa-cac3-4965-811f-1979f3a32b48" containerName="maas-api" Jul 10 13:27:08.870563 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.870558 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="60f1394d-70ce-4ea7-ba8e-13560045873a" containerName="maas-api" Jul 10 13:27:08.874156 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.874139 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:08.876737 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.876721 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-7266ad-serving-cert\"" Jul 10 13:27:08.884484 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.884463 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5"] Jul 10 13:27:08.955178 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.955144 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk6d5\" (UniqueName: \"kubernetes.io/projected/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-kube-api-access-wk6d5\") pod \"maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5\" (UID: \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:08.955395 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.955242 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5\" (UID: \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:08.955395 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:08.955288 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5\" (UID: \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:09.055934 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:09.055899 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5\" (UID: \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:09.055934 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:09.055938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5\" (UID: \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:09.056136 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:09.055974 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk6d5\" (UniqueName: \"kubernetes.io/projected/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-kube-api-access-wk6d5\") pod \"maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5\" (UID: \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:09.056736 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:09.056709 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5\" (UID: \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:09.058550 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:09.058502 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5\" (UID: \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:09.065483 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:09.065454 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk6d5\" (UniqueName: \"kubernetes.io/projected/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-kube-api-access-wk6d5\") pod \"maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5\" (UID: \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:09.185105 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:09.185013 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:09.326028 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:09.326001 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5"] Jul 10 13:27:09.328169 ip-10-0-135-152 kubenswrapper[2557]: W0710 13:27:09.328138 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6464dbca_8e9d_4a0f_9e2a_f045c9de02ca.slice/crio-cb27bcd12eabf0b4696b648efcb2228411da087dcc7546078083816c612a3b78 WatchSource:0}: Error finding container cb27bcd12eabf0b4696b648efcb2228411da087dcc7546078083816c612a3b78: Status 404 returned error can't find the container with id cb27bcd12eabf0b4696b648efcb2228411da087dcc7546078083816c612a3b78 Jul 10 13:27:10.218734 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:10.218692 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" event={"ID":"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca","Type":"ContainerStarted","Data":"3aef094206d0b2aaa79782fcf7e29be2dda99c045a7fc3e2eb273c44515600ef"} Jul 10 13:27:10.218734 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:10.218740 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" event={"ID":"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca","Type":"ContainerStarted","Data":"cb27bcd12eabf0b4696b648efcb2228411da087dcc7546078083816c612a3b78"} Jul 10 13:27:10.219274 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:10.218826 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:10.252851 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:10.252804 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" podStartSLOduration=1.879795626 podStartE2EDuration="2.252788433s" totalImagesPullingTime="372.992807ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:10.251268872 +0000 UTC m=+2457.482379307" watchObservedRunningTime="2026-07-10 13:27:10.252788433 +0000 UTC m=+2457.483898865" Jul 10 13:27:16.230718 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:16.230682 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:27:17.083403 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.083367 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p"] Jul 10 13:27:17.088752 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.088729 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:17.092229 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.092205 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-d5a846-serving-cert\"" Jul 10 13:27:17.096014 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.095993 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p"] Jul 10 13:27:17.132311 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.132277 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b72856d0-f2b9-49cc-8516-156fb7550b3a-maas-api-tls\") pod \"maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:17.132497 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.132364 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b72856d0-f2b9-49cc-8516-156fb7550b3a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:17.132497 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.132396 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvk4p\" (UniqueName: \"kubernetes.io/projected/b72856d0-f2b9-49cc-8516-156fb7550b3a-kube-api-access-xvk4p\") pod \"maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:17.233427 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.233395 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b72856d0-f2b9-49cc-8516-156fb7550b3a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:17.233801 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.233436 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvk4p\" (UniqueName: \"kubernetes.io/projected/b72856d0-f2b9-49cc-8516-156fb7550b3a-kube-api-access-xvk4p\") pod \"maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:17.233801 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.233498 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b72856d0-f2b9-49cc-8516-156fb7550b3a-maas-api-tls\") pod \"maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:17.233801 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:27:17.233624 2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-serving-cert: secret "maas-api-e2e-shared-b-d5a846-serving-cert" not found Jul 10 13:27:17.233801 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:27:17.233680 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72856d0-f2b9-49cc-8516-156fb7550b3a-maas-api-tls podName:b72856d0-f2b9-49cc-8516-156fb7550b3a nodeName:}" failed. No retries permitted until 2026-07-10 13:27:17.733663719 +0000 UTC m=+2464.964774138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b72856d0-f2b9-49cc-8516-156fb7550b3a-maas-api-tls") pod "maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" (UID: "b72856d0-f2b9-49cc-8516-156fb7550b3a") : secret "maas-api-e2e-shared-b-d5a846-serving-cert" not found Jul 10 13:27:17.234028 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.234009 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b72856d0-f2b9-49cc-8516-156fb7550b3a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:17.243817 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.243790 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvk4p\" (UniqueName: \"kubernetes.io/projected/b72856d0-f2b9-49cc-8516-156fb7550b3a-kube-api-access-xvk4p\") pod \"maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:17.738816 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.738775 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b72856d0-f2b9-49cc-8516-156fb7550b3a-maas-api-tls\") pod \"maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:17.741277 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:17.741252 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b72856d0-f2b9-49cc-8516-156fb7550b3a-maas-api-tls\") pod \"maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:18.002369 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:18.002268 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:18.133916 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:18.133891 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p"] Jul 10 13:27:18.136128 ip-10-0-135-152 kubenswrapper[2557]: W0710 13:27:18.136099 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72856d0_f2b9_49cc_8516_156fb7550b3a.slice/crio-364b7bcc7d3b56a7a305de162895f7922e67dadafd6441cca0112611f3256f0d WatchSource:0}: Error finding container 364b7bcc7d3b56a7a305de162895f7922e67dadafd6441cca0112611f3256f0d: Status 404 returned error can't find the container with id 364b7bcc7d3b56a7a305de162895f7922e67dadafd6441cca0112611f3256f0d Jul 10 13:27:18.255457 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:18.255373 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" event={"ID":"b72856d0-f2b9-49cc-8516-156fb7550b3a","Type":"ContainerStarted","Data":"364b7bcc7d3b56a7a305de162895f7922e67dadafd6441cca0112611f3256f0d"} Jul 10 13:27:19.266533 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:19.266502 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" event={"ID":"b72856d0-f2b9-49cc-8516-156fb7550b3a","Type":"ContainerStarted","Data":"74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee"} Jul 10 13:27:19.266896 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:19.266555 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:27:19.286947 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:19.286901 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" podStartSLOduration=1.89710483 podStartE2EDuration="2.286885494s" totalImagesPullingTime="389.780664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:19.284966179 +0000 UTC m=+2466.516076610" watchObservedRunningTime="2026-07-10 13:27:19.286885494 +0000 UTC m=+2466.517995926" Jul 10 13:27:25.271607 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:27:25.271575 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:31:13.386787 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:31:13.386673 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:31:13.394531 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:31:13.394508 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:35:48.159789 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.159752 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5"] Jul 10 13:35:48.160363 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.160128 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" podUID="6464dbca-8e9d-4a0f-9e2a-f045c9de02ca" containerName="maas-api" containerID="cri-o://3aef094206d0b2aaa79782fcf7e29be2dda99c045a7fc3e2eb273c44515600ef" gracePeriod=30 Jul 10 13:35:48.605753 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.605722 2557 generic.go:356] "Generic (PLEG): container finished" podID="6464dbca-8e9d-4a0f-9e2a-f045c9de02ca" containerID="3aef094206d0b2aaa79782fcf7e29be2dda99c045a7fc3e2eb273c44515600ef" exitCode=0 Jul 10 13:35:48.605902 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.605801 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" event={"ID":"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca","Type":"ContainerDied","Data":"3aef094206d0b2aaa79782fcf7e29be2dda99c045a7fc3e2eb273c44515600ef"} Jul 10 13:35:48.605902 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.605861 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" event={"ID":"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca","Type":"ContainerDied","Data":"cb27bcd12eabf0b4696b648efcb2228411da087dcc7546078083816c612a3b78"} Jul 10 13:35:48.605902 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.605884 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb27bcd12eabf0b4696b648efcb2228411da087dcc7546078083816c612a3b78" Jul 10 13:35:48.606706 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.606690 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:35:48.717240 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.717200 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk6d5\" (UniqueName: \"kubernetes.io/projected/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-kube-api-access-wk6d5\") pod \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\" (UID: \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\") " Jul 10 13:35:48.717423 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.717289 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-openshift-service-ca\") pod \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\" (UID: \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\") " Jul 10 13:35:48.717476 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.717450 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-maas-api-tls\") pod \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\" (UID: \"6464dbca-8e9d-4a0f-9e2a-f045c9de02ca\") " Jul 10 13:35:48.717599 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.717581 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6464dbca-8e9d-4a0f-9e2a-f045c9de02ca" (UID: "6464dbca-8e9d-4a0f-9e2a-f045c9de02ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:35:48.717795 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.717776 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-openshift-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:35:48.719405 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.719384 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6464dbca-8e9d-4a0f-9e2a-f045c9de02ca" (UID: "6464dbca-8e9d-4a0f-9e2a-f045c9de02ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:35:48.719515 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.719471 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-kube-api-access-wk6d5" (OuterVolumeSpecName: "kube-api-access-wk6d5") pod "6464dbca-8e9d-4a0f-9e2a-f045c9de02ca" (UID: "6464dbca-8e9d-4a0f-9e2a-f045c9de02ca"). InnerVolumeSpecName "kube-api-access-wk6d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:35:48.818487 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.818455 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk6d5\" (UniqueName: \"kubernetes.io/projected/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-kube-api-access-wk6d5\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:35:48.818487 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:48.818480 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca-maas-api-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:35:49.610185 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:49.610101 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5" Jul 10 13:35:49.627787 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:49.627760 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5"] Jul 10 13:35:49.630027 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:49.630003 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7266ad-77cdd477df-mbzb5"] Jul 10 13:35:51.266728 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:51.266685 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6464dbca-8e9d-4a0f-9e2a-f045c9de02ca" path="/var/lib/kubelet/pods/6464dbca-8e9d-4a0f-9e2a-f045c9de02ca/volumes" Jul 10 13:35:55.309316 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.309280 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p"] Jul 10 13:35:55.309752 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.309561 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" podUID="b72856d0-f2b9-49cc-8516-156fb7550b3a" containerName="maas-api" containerID="cri-o://74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee" gracePeriod=30 Jul 10 13:35:55.556559 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.556532 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:35:55.643940 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.643850 2557 generic.go:356] "Generic (PLEG): container finished" podID="b72856d0-f2b9-49cc-8516-156fb7550b3a" containerID="74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee" exitCode=0 Jul 10 13:35:55.643940 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.643894 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" Jul 10 13:35:55.643940 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.643916 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" event={"ID":"b72856d0-f2b9-49cc-8516-156fb7550b3a","Type":"ContainerDied","Data":"74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee"} Jul 10 13:35:55.644217 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.643956 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p" event={"ID":"b72856d0-f2b9-49cc-8516-156fb7550b3a","Type":"ContainerDied","Data":"364b7bcc7d3b56a7a305de162895f7922e67dadafd6441cca0112611f3256f0d"} Jul 10 13:35:55.644217 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.643979 2557 scope.go:117] "RemoveContainer" containerID="74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee" Jul 10 13:35:55.652153 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.652128 2557 scope.go:117] "RemoveContainer" containerID="74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee" Jul 10 13:35:55.652418 ip-10-0-135-152 kubenswrapper[2557]: E0710 13:35:55.652395 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee\": container with ID starting with 74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee not found: ID does not exist" containerID="74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee" Jul 10 13:35:55.652526 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.652422 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee"} err="failed to get container status \"74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee\": rpc error: code = NotFound desc = could not find container \"74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee\": container with ID starting with 74abb043537c31cf0d40d951bf9075457f19ce0421353803d3062e8b52655dee not found: ID does not exist" Jul 10 13:35:55.679738 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.679713 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b72856d0-f2b9-49cc-8516-156fb7550b3a-maas-api-tls\") pod \"b72856d0-f2b9-49cc-8516-156fb7550b3a\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " Jul 10 13:35:55.679853 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.679777 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvk4p\" (UniqueName: \"kubernetes.io/projected/b72856d0-f2b9-49cc-8516-156fb7550b3a-kube-api-access-xvk4p\") pod \"b72856d0-f2b9-49cc-8516-156fb7550b3a\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " Jul 10 13:35:55.679967 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.679949 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b72856d0-f2b9-49cc-8516-156fb7550b3a-openshift-service-ca\") pod \"b72856d0-f2b9-49cc-8516-156fb7550b3a\" (UID: \"b72856d0-f2b9-49cc-8516-156fb7550b3a\") " Jul 10 13:35:55.680324 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.680296 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b72856d0-f2b9-49cc-8516-156fb7550b3a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b72856d0-f2b9-49cc-8516-156fb7550b3a" (UID: "b72856d0-f2b9-49cc-8516-156fb7550b3a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:35:55.681946 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.681922 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b72856d0-f2b9-49cc-8516-156fb7550b3a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b72856d0-f2b9-49cc-8516-156fb7550b3a" (UID: "b72856d0-f2b9-49cc-8516-156fb7550b3a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:35:55.682043 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.681928 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b72856d0-f2b9-49cc-8516-156fb7550b3a-kube-api-access-xvk4p" (OuterVolumeSpecName: "kube-api-access-xvk4p") pod "b72856d0-f2b9-49cc-8516-156fb7550b3a" (UID: "b72856d0-f2b9-49cc-8516-156fb7550b3a"). InnerVolumeSpecName "kube-api-access-xvk4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:35:55.781731 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.781692 2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b72856d0-f2b9-49cc-8516-156fb7550b3a-maas-api-tls\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:35:55.781731 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.781723 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvk4p\" (UniqueName: \"kubernetes.io/projected/b72856d0-f2b9-49cc-8516-156fb7550b3a-kube-api-access-xvk4p\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:35:55.781731 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.781735 2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b72856d0-f2b9-49cc-8516-156fb7550b3a-openshift-service-ca\") on node \"ip-10-0-135-152.ec2.internal\" DevicePath \"\"" Jul 10 13:35:55.965699 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.965652 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p"] Jul 10 13:35:55.967893 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:55.967866 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5a846-7d477c7876-vh78p"] Jul 10 13:35:57.267064 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:35:57.267032 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b72856d0-f2b9-49cc-8516-156fb7550b3a" path="/var/lib/kubelet/pods/b72856d0-f2b9-49cc-8516-156fb7550b3a/volumes" Jul 10 13:36:07.141937 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:07.141900 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c8c758d8f-pvjq9_70d817de-aeb3-48ac-a553-2a4bafb0c29d/manager/0.log" Jul 10 13:36:07.714053 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:07.714024 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6798dbc-x6jfz_f5853625-f188-46be-86e1-98fb966e3e6c/copy-manifests/0.log" Jul 10 13:36:07.732361 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:07.732309 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6798dbc-x6jfz_f5853625-f188-46be-86e1-98fb966e3e6c/manager/0.log" Jul 10 13:36:08.074824 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:08.074729 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-56d488c5b7-rpzpx_be00e063-5c9f-412b-ab7b-1b4f18ebfb44/maas-api/0.log" Jul 10 13:36:08.184326 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:08.184298 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-t2r9n_f6b35d7f-49a5-43d7-abc7-84ba1967c81c/postgres/0.log" Jul 10 13:36:10.905083 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:10.905049 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tmj77_2429c60c-2720-4623-bb7c-2cf3b3e31f83/discovery/0.log" Jul 10 13:36:11.520177 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:11.520139 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ph8v2_9ec452fd-92c5-4d36-82cc-74b633da9dec/payload-processing/0.log" Jul 10 13:36:12.104650 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:12.104616 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-k4v4s_8bc3c846-cde6-4dec-9f5f-a1314d35f937/main/0.log" Jul 10 13:36:12.217588 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:12.217559 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4fvtv_501abf8d-1a2e-4b83-b6ce-aa69c2686852/main/0.log" Jul 10 13:36:12.443363 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:12.443255 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-mtvtb_abac79c2-d95a-4186-ae7f-b10bb03be344/main/0.log" Jul 10 13:36:13.414051 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:13.413951 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:36:13.421840 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:13.421821 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:36:13.480338 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:13.480307 2557 scope.go:117] "RemoveContainer" containerID="3aef094206d0b2aaa79782fcf7e29be2dda99c045a7fc3e2eb273c44515600ef" Jul 10 13:36:19.272670 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:19.272643 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-thrnw_2b18e6b0-54a0-4f26-a217-e58f61c6d45c/global-pull-secret-syncer/0.log" Jul 10 13:36:19.421699 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:19.421663 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zd5ws_cdb963f2-e593-4dca-ba8b-807e88492383/konnectivity-agent/0.log" Jul 10 13:36:19.476116 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:19.476078 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-152.ec2.internal_d584449cbcb95d6d238a8af1d56645ac/haproxy/0.log" Jul 10 13:36:27.064072 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:27.064042 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-kb6tc_260b30c7-1e8d-476e-a2ff-d03d82cacd2d/monitoring-plugin/0.log" Jul 10 13:36:27.110862 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:27.110838 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m4rln_d0a41df0-8efc-4b29-af89-77e5ba1e2ce4/node-exporter/0.log" Jul 10 13:36:27.148844 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:27.148811 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m4rln_d0a41df0-8efc-4b29-af89-77e5ba1e2ce4/kube-rbac-proxy/0.log" Jul 10 13:36:27.185484 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:27.185461 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m4rln_d0a41df0-8efc-4b29-af89-77e5ba1e2ce4/init-textfile/0.log" Jul 10 13:36:27.515110 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:27.515073 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fb07461-492a-493e-9dea-d1ec7c40b158/prometheus/0.log" Jul 10 13:36:27.549907 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:27.549873 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fb07461-492a-493e-9dea-d1ec7c40b158/config-reloader/0.log" Jul 10 13:36:27.589021 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:27.588993 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fb07461-492a-493e-9dea-d1ec7c40b158/thanos-sidecar/0.log" Jul 10 13:36:27.626733 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:27.626696 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fb07461-492a-493e-9dea-d1ec7c40b158/kube-rbac-proxy-web/0.log" Jul 10 13:36:27.652689 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:27.652667 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fb07461-492a-493e-9dea-d1ec7c40b158/kube-rbac-proxy/0.log" Jul 10 13:36:27.681707 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:27.681675 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fb07461-492a-493e-9dea-d1ec7c40b158/kube-rbac-proxy-thanos/0.log" Jul 10 13:36:27.714607 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:27.714579 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9fb07461-492a-493e-9dea-d1ec7c40b158/init-config-reloader/0.log" Jul 10 13:36:29.518785 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.518755 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2"] Jul 10 13:36:29.519153 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.519097 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72856d0-f2b9-49cc-8516-156fb7550b3a" containerName="maas-api" Jul 10 13:36:29.519153 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.519107 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72856d0-f2b9-49cc-8516-156fb7550b3a" containerName="maas-api" Jul 10 13:36:29.519153 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.519115 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6464dbca-8e9d-4a0f-9e2a-f045c9de02ca" containerName="maas-api" Jul 10 13:36:29.519153 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.519122 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6464dbca-8e9d-4a0f-9e2a-f045c9de02ca" containerName="maas-api" Jul 10 13:36:29.519285 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.519178 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6464dbca-8e9d-4a0f-9e2a-f045c9de02ca" containerName="maas-api" Jul 10 13:36:29.519285 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.519186 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b72856d0-f2b9-49cc-8516-156fb7550b3a" containerName="maas-api" Jul 10 13:36:29.522198 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.522182 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.524910 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.524891 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qthfs\"/\"openshift-service-ca.crt\"" Jul 10 13:36:29.525052 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.525000 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qthfs\"/\"kube-root-ca.crt\"" Jul 10 13:36:29.526288 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.526261 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qthfs\"/\"default-dockercfg-x4wbf\"" Jul 10 13:36:29.531919 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.531895 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2"] Jul 10 13:36:29.577770 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.577739 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97374142-3966-442a-8323-a35f7b7d35ce-lib-modules\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.577919 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.577776 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97374142-3966-442a-8323-a35f7b7d35ce-proc\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.577919 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.577804 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97374142-3966-442a-8323-a35f7b7d35ce-sys\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.577919 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.577902 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxj6q\" (UniqueName: \"kubernetes.io/projected/97374142-3966-442a-8323-a35f7b7d35ce-kube-api-access-jxj6q\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.578027 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.577938 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97374142-3966-442a-8323-a35f7b7d35ce-podres\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.679118 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.679080 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97374142-3966-442a-8323-a35f7b7d35ce-lib-modules\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.679292 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.679127 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97374142-3966-442a-8323-a35f7b7d35ce-proc\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.679292 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.679162 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97374142-3966-442a-8323-a35f7b7d35ce-sys\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.679292 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.679227 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97374142-3966-442a-8323-a35f7b7d35ce-proc\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.679292 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.679231 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxj6q\" (UniqueName: \"kubernetes.io/projected/97374142-3966-442a-8323-a35f7b7d35ce-kube-api-access-jxj6q\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.679292 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.679267 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97374142-3966-442a-8323-a35f7b7d35ce-lib-modules\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.679292 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.679282 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97374142-3966-442a-8323-a35f7b7d35ce-sys\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.679292 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.679285 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97374142-3966-442a-8323-a35f7b7d35ce-podres\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.679578 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.679406 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97374142-3966-442a-8323-a35f7b7d35ce-podres\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.687618 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.687590 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxj6q\" (UniqueName: \"kubernetes.io/projected/97374142-3966-442a-8323-a35f7b7d35ce-kube-api-access-jxj6q\") pod \"perf-node-gather-daemonset-c7wk2\" (UID: \"97374142-3966-442a-8323-a35f7b7d35ce\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.833504 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.833421 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:29.910826 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.910717 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/1.log" Jul 10 13:36:29.920796 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.920693 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hplm6_2e53c9a8-69c8-4347-a889-b27dd5e98cf5/console-operator/2.log" Jul 10 13:36:29.969937 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:29.969914 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2"] Jul 10 13:36:29.972381 ip-10-0-135-152 kubenswrapper[2557]: W0710 13:36:29.972342 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod97374142_3966_442a_8323_a35f7b7d35ce.slice/crio-b930943bd1bb1c51ce65728bccb59bc01dfea8a0337f9e8a81ea388b370b8a53 WatchSource:0}: Error finding container b930943bd1bb1c51ce65728bccb59bc01dfea8a0337f9e8a81ea388b370b8a53: Status 404 returned error can't find the container with id b930943bd1bb1c51ce65728bccb59bc01dfea8a0337f9e8a81ea388b370b8a53 Jul 10 13:36:30.804427 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:30.804391 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" event={"ID":"97374142-3966-442a-8323-a35f7b7d35ce","Type":"ContainerStarted","Data":"aace6d01d8d93b7ccb22531bbf03a1047e37324abf3d5a5f837784e3c89b4e9b"} Jul 10 13:36:30.804801 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:30.804449 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" event={"ID":"97374142-3966-442a-8323-a35f7b7d35ce","Type":"ContainerStarted","Data":"b930943bd1bb1c51ce65728bccb59bc01dfea8a0337f9e8a81ea388b370b8a53"} Jul 10 13:36:30.804801 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:30.804481 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:30.823066 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:30.823018 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" podStartSLOduration=1.8230022670000001 podStartE2EDuration="1.823002267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:36:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:36:30.821823882 +0000 UTC m=+3018.052934315" watchObservedRunningTime="2026-07-10 13:36:30.823002267 +0000 UTC m=+3018.054112717" Jul 10 13:36:32.198931 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:32.198897 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rqc9p_b42f5712-357f-483a-b744-c9d36cbb99ca/dns/0.log" Jul 10 13:36:32.220606 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:32.220576 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rqc9p_b42f5712-357f-483a-b744-c9d36cbb99ca/kube-rbac-proxy/0.log" Jul 10 13:36:32.299667 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:32.299641 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v78dm_32444ef9-93e0-4ddc-9645-5d32a3548eee/dns-node-resolver/0.log" Jul 10 13:36:32.835213 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:32.835169 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6fc9888469-9tfxz_93a85552-a589-4203-9194-9fd39bde8bdc/registry/0.log" Jul 10 13:36:32.909539 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:32.909508 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xbzrz_25c28891-e02d-475f-a145-486db0b0e335/node-ca/0.log" Jul 10 13:36:34.085476 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:34.085442 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tmj77_2429c60c-2720-4623-bb7c-2cf3b3e31f83/discovery/0.log" Jul 10 13:36:34.315064 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:34.315028 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ph8v2_9ec452fd-92c5-4d36-82cc-74b633da9dec/payload-processing/0.log" Jul 10 13:36:35.079091 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:35.079061 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wg7m4_a4e5935e-a766-4c5e-8bb2-5b12c48ade14/serve-healthcheck-canary/0.log" Jul 10 13:36:35.552987 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:35.552946 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-bb72g_df1de48b-6ecb-477b-8313-2d7070554708/insights-operator/0.log" Jul 10 13:36:35.554677 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:35.554655 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-bb72g_df1de48b-6ecb-477b-8313-2d7070554708/insights-operator/1.log" Jul 10 13:36:35.711258 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:35.711232 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2pqg_047aeb6b-0106-4f1a-a49b-3affb6e3401b/kube-rbac-proxy/0.log" Jul 10 13:36:35.732702 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:35.732679 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2pqg_047aeb6b-0106-4f1a-a49b-3affb6e3401b/exporter/0.log" Jul 10 13:36:35.759069 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:35.759045 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2pqg_047aeb6b-0106-4f1a-a49b-3affb6e3401b/extractor/0.log" Jul 10 13:36:36.819112 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:36.819082 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-c7wk2" Jul 10 13:36:38.428070 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:38.428037 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c8c758d8f-pvjq9_70d817de-aeb3-48ac-a553-2a4bafb0c29d/manager/0.log" Jul 10 13:36:38.916401 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:38.916362 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6798dbc-x6jfz_f5853625-f188-46be-86e1-98fb966e3e6c/manager/0.log" Jul 10 13:36:38.934704 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:38.934640 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6798dbc-x6jfz_f5853625-f188-46be-86e1-98fb966e3e6c/copy-manifests/0.log" Jul 10 13:36:39.753481 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:39.753446 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tmj77_2429c60c-2720-4623-bb7c-2cf3b3e31f83/discovery/0.log" Jul 10 13:36:39.940966 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:39.940879 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ph8v2_9ec452fd-92c5-4d36-82cc-74b633da9dec/payload-processing/0.log" Jul 10 13:36:40.279037 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:40.278999 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86f6864fb7-wg4bz_044bb745-dc16-4550-8eb1-cc3df77ad3c0/manager/0.log" Jul 10 13:36:41.396297 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:41.396245 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tmj77_2429c60c-2720-4623-bb7c-2cf3b3e31f83/discovery/0.log" Jul 10 13:36:41.577417 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:41.577300 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-ph8v2_9ec452fd-92c5-4d36-82cc-74b633da9dec/payload-processing/0.log" Jul 10 13:36:45.970475 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:45.970439 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-xxg9v_f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429/kube-storage-version-migrator-operator/1.log" Jul 10 13:36:45.972094 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:45.972065 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-xxg9v_f2de5d54-acaf-47ff-a8d2-c4cc7b5b1429/kube-storage-version-migrator-operator/0.log" Jul 10 13:36:47.063408 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:47.063377 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7b9x4_c33427ab-8871-428e-8eab-5d11cd0f2c65/kube-multus/0.log" Jul 10 13:36:47.405181 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:47.405102 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lh7hv_f52d9bdf-1792-4e26-8b37-c2913530a624/kube-multus-additional-cni-plugins/0.log" Jul 10 13:36:47.440628 ip-10-0-135-152 kubenswrapper[2557]: I0710 13:36:47.440596 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lh7hv_f52d9bdf-1792-4e26-8b37-c2913530a624/egress-router-binary-copy/0.log"