Jun 03 22:50:19.669518 ip-10-0-143-45 systemd[1]: Starting Kubernetes Kubelet... Jun 03 22:50:20.079645 ip-10-0-143-45 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 22:50:20.079645 ip-10-0-143-45 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 22:50:20.079645 ip-10-0-143-45 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 22:50:20.079645 ip-10-0-143-45 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 22:50:20.079645 ip-10-0-143-45 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 22:50:20.082025 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.081948 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 22:50:20.088287 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088266 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 22:50:20.088287 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088284 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 22:50:20.088287 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088288 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 22:50:20.088287 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088292 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088295 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088298 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088301 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088304 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088307 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088310 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088312 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088315 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088318 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088320 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088323 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088325 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088328 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088331 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088333 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088336 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088338 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088341 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088343 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 22:50:20.088448 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088346 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088348 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088351 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088353 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088356 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088358 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088360 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088363 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088365 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088373 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088376 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088378 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088381 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088384 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088388 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088390 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088394 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088398 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088401 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 22:50:20.089051 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088404 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088407 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088410 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088413 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088415 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088418 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088421 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088423 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088425 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088428 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088430 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088433 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088435 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088438 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088440 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088442 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088445 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088448 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088450 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088453 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088455 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 22:50:20.089546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088459 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088461 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088464 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088466 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088470 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088481 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088484 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088487 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088490 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088492 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088495 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088497 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088500 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088502 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088505 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088508 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088510 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088513 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088515 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088518 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 22:50:20.090048 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088522 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088524 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088527 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088530 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088534 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088538 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088541 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088544 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088547 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088549 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088552 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088555 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088557 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088560 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.088562 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089248 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089255 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089258 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089261 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 22:50:20.090546 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089264 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089266 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089269 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089271 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089274 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089277 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089280 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089283 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089285 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089288 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089291 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089293 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089296 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089298 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089301 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089304 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089307 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089310 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089312 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089315 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 22:50:20.091007 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089317 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089320 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089322 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089324 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089327 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089329 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089333 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089337 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089340 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089344 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089347 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089350 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089353 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089355 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089358 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089360 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089364 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089366 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089369 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089371 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 22:50:20.091533 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089374 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089376 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089379 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089381 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089384 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089386 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089391 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089395 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089398 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089401 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089403 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089406 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089409 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089411 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089415 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089418 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089421 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089424 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089427 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089430 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 22:50:20.092028 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089432 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089435 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089437 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089440 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089443 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089445 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089448 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089450 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089453 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089455 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089459 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089463 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089466 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089468 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089471 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089474 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089476 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089478 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089481 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 22:50:20.092580 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089483 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089486 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089489 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089491 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089494 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089499 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089501 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089504 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089506 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089508 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089511 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089513 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089516 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089518 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089521 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089875 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089879 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089882 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089885 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089888 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 22:50:20.093041 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089890 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089893 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089896 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089898 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089901 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089903 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089906 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089909 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089911 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089914 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089916 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089919 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089922 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089924 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089927 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089929 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089932 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089937 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089939 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089942 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 22:50:20.093554 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089944 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089947 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089949 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089952 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089954 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089958 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089960 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089963 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089966 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089968 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089971 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089973 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089976 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089978 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089981 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089983 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089986 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089988 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089991 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089993 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 22:50:20.094077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089996 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.089998 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090000 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090003 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090005 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090008 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090011 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090013 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090016 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090019 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090022 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090025 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090027 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090029 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090032 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090034 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090036 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090040 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090043 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090046 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 22:50:20.094613 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090048 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090051 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090054 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090056 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090059 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090061 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090064 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090066 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090069 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090071 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090075 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090079 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090082 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090085 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090088 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090091 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090093 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090096 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090099 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 22:50:20.095114 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090102 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090105 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090111 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090115 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090120 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090123 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090126 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090128 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090131 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090134 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090138 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090141 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090143 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090145 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090232 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090239 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090247 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090251 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090254 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090257 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090261 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 22:50:20.095597 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090265 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090268 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090271 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090274 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090277 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090280 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090283 2561 flags.go:64] FLAG: --cgroup-root="" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090286 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090288 2561 flags.go:64] FLAG: --client-ca-file="" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090291 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090294 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090298 2561 flags.go:64] FLAG: --cluster-domain="" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090302 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090306 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090309 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090312 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090316 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090318 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090321 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090325 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090328 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090332 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090335 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090338 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 22:50:20.096104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090341 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090345 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090348 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090351 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090353 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090356 2561 flags.go:64] FLAG: --enable-server="true" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090359 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090364 2561 flags.go:64] FLAG: --event-burst="100" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090367 2561 flags.go:64] FLAG: --event-qps="50" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090370 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090373 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090376 2561 flags.go:64] FLAG: --eviction-hard="" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090379 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090382 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090385 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090387 2561 flags.go:64] FLAG: --eviction-soft="" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090390 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090393 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090396 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090398 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090401 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090405 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090408 2561 flags.go:64] FLAG: --feature-gates="" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090411 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090414 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 22:50:20.096712 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090417 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090420 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090423 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090425 2561 flags.go:64] FLAG: --help="false" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090429 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090445 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090449 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090452 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090455 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090459 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090462 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090464 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090467 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090470 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090473 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090476 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090478 2561 flags.go:64] FLAG: --kube-reserved="" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090481 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090484 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090487 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090489 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090492 2561 flags.go:64] FLAG: --lock-file="" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090495 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090497 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 22:50:20.097399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090500 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090505 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090508 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090510 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090514 2561 flags.go:64] FLAG: --logging-format="text" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090518 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090521 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090524 2561 flags.go:64] FLAG: --manifest-url="" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090526 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090530 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090533 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090537 2561 flags.go:64] FLAG: --max-pods="110" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090541 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090543 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090546 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090549 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090552 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090555 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090558 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090564 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090567 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090570 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090573 2561 flags.go:64] FLAG: --pod-cidr="" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090575 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 22:50:20.097968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090580 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090583 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090586 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090589 2561 flags.go:64] FLAG: --port="10250" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090592 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090595 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0660a29c9703dd374" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090598 2561 flags.go:64] FLAG: --qos-reserved="" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090601 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090603 2561 flags.go:64] FLAG: --register-node="true" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090606 2561 flags.go:64] FLAG: --register-with-taints="" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090609 2561 flags.go:64] FLAG: --registry-burst="10" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090612 2561 flags.go:64] FLAG: --registry-qps="5" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090616 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090619 2561 flags.go:64] FLAG: --reserved-memory="" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090623 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090626 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090629 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090631 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090634 2561 flags.go:64] FLAG: --runonce="false" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090636 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090639 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090643 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090646 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090649 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090651 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090654 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 22:50:20.098604 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090657 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090660 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090662 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090665 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090668 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090671 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090673 2561 flags.go:64] FLAG: --system-cgroups="" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090676 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090681 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090684 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090686 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090690 2561 flags.go:64] FLAG: --tls-min-version="" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090692 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090695 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090698 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090701 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090703 2561 flags.go:64] FLAG: --v="2" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090707 2561 flags.go:64] FLAG: --version="false" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090711 2561 flags.go:64] FLAG: --vmodule="" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090715 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.090717 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090846 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090850 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090853 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 22:50:20.099240 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090855 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090858 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090861 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090865 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090868 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090870 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090873 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090875 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090878 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090880 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090883 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090885 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090888 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090890 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090893 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090895 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090898 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090900 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090903 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090906 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 22:50:20.099849 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090908 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090910 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090913 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090915 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090918 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090920 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090924 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090928 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090931 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090934 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090938 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090941 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090944 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090946 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090949 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090953 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090955 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090958 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090961 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 22:50:20.100367 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090964 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090967 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090970 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090973 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090975 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090978 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090981 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090983 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090986 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090988 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090991 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090993 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090996 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.090999 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091001 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091004 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091006 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091008 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091011 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091014 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 22:50:20.100846 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091017 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091020 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091022 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091026 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091030 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091033 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091036 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091038 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091042 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091045 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091047 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091050 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091052 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091055 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091057 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091061 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091064 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091067 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091069 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 22:50:20.101432 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091072 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091074 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091076 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091079 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091082 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091084 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091087 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091089 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091092 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091094 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091097 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091099 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091103 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091105 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091108 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091110 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 22:50:20.101900 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.091113 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.091955 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.098372 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.098387 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.098406 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.098411 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098467 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098472 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098476 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098478 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098482 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098485 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098488 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098490 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 22:50:20.102317 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098493 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098496 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098499 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098501 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098504 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098506 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098509 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098511 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098514 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098516 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098519 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098522 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098524 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098527 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098529 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098531 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098534 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098537 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098539 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098542 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 22:50:20.102668 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098545 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098549 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098551 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098554 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098557 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098559 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098561 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098564 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098567 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098569 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098571 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098575 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098579 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098582 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098584 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098588 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098590 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098593 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098596 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098599 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 22:50:20.103153 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098601 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098604 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098606 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098610 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098613 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098616 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098618 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098621 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098624 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098628 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098630 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098633 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098636 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098639 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098642 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098645 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098647 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098650 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098666 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098669 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 22:50:20.103651 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098673 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098675 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098678 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098681 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098684 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098687 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098689 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098692 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098694 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098697 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098700 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098702 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098705 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098708 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098710 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098713 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098716 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098718 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098721 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098723 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 22:50:20.104120 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098726 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098730 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098734 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098736 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098739 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098742 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098745 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098747 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098750 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098752 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.098757 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098861 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098865 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098868 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098871 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 22:50:20.104637 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098874 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098877 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098879 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098882 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098884 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098887 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098889 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098892 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098895 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098897 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098899 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098902 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098904 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098907 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098909 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098912 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098914 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098917 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098920 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098922 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 22:50:20.105018 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098925 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098927 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098930 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098933 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098937 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098940 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098943 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098946 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098949 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098952 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098954 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098957 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098960 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098962 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098965 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098967 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098970 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098972 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098975 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098979 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 22:50:20.105599 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098982 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098985 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098987 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098990 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098993 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.098996 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099000 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099002 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099005 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099007 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099010 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099012 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099015 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099017 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099020 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099022 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099025 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099028 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099030 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099033 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 22:50:20.106077 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099035 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099038 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099040 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099042 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099045 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099047 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099049 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099052 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099054 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099057 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099059 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099062 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099064 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099066 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099069 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099074 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099077 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099079 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099081 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099084 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 22:50:20.106561 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099086 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099089 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099091 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099094 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099096 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099099 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099101 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099103 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099106 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099108 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099111 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099114 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099116 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:20.099119 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.099124 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 22:50:20.107040 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.099228 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 22:50:20.107411 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.101182 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 22:50:20.107411 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.102582 2561 server.go:1019] "Starting client certificate rotation" Jun 03 22:50:20.107411 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.102681 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 22:50:20.107411 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.102713 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 22:50:20.107411 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.105203 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 22:50:20.109738 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.109715 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 22:50:20.125298 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.125281 2561 log.go:25] "Validated CRI v1 runtime API" Jun 03 22:50:20.127931 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.127909 2561 log.go:25] "Validated CRI v1 image API" Jun 03 22:50:20.128696 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.128682 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 22:50:20.131885 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.131867 2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7fb0d8e2-e053-4889-bd4e-702f0259f745:/dev/nvme0n1p3 cbd8b60f-91f7-4548-adea-341619aba904:/dev/nvme0n1p4] Jun 03 22:50:20.131944 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.131884 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 22:50:20.136832 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.136732 2561 manager.go:216] Machine: {Timestamp:2026-06-03 22:50:20.135492662 +0000 UTC m=+0.332515522 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104067 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29dc132ae7706eee6e60ee3ceba1e9 SystemUUID:ec29dc13-2ae7-706e-ee6e-60ee3ceba1e9 BootID:bed31eab-bd26-4fe7-81a9-7dda07e69878 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5c:ee:1a:aa:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5c:ee:1a:aa:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:2d:f6:e0:5f:c9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 22:50:20.136832 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.136827 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 22:50:20.136940 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.136894 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 22:50:20.139899 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.139876 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 22:50:20.140015 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.139901 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-45.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 22:50:20.140562 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.140552 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 22:50:20.140605 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.140565 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 22:50:20.140605 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.140573 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 22:50:20.141125 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.141114 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 22:50:20.141881 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.141869 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 22:50:20.144559 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.144548 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 03 22:50:20.144670 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.144660 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 22:50:20.144709 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.144691 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 03 22:50:20.144709 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.144707 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 22:50:20.144769 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.144721 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 22:50:20.144769 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.144730 2561 kubelet.go:398] "Adding apiserver pod source" Jun 03 22:50:20.144769 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.144739 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 22:50:20.145044 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.145033 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 22:50:20.145095 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.145050 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 22:50:20.145352 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.145337 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 22:50:20.147242 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.147225 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 22:50:20.148518 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.148505 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 22:50:20.148556 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.148536 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 22:50:20.149096 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149085 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 22:50:20.149134 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149104 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 22:50:20.149134 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149112 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 22:50:20.149134 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149121 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 22:50:20.149134 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149131 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 22:50:20.149249 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149136 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 22:50:20.149249 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149170 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 22:50:20.149249 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149177 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 22:50:20.149249 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149183 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 22:50:20.149249 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149189 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 22:50:20.149249 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149197 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 22:50:20.149249 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149204 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 22:50:20.149931 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149922 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 22:50:20.149931 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.149931 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 22:50:20.152851 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.152839 2561 server.go:1268] "Started kubelet" Jun 03 22:50:20.153021 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.152980 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 22:50:20.153118 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.153020 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 22:50:20.153118 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.153085 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 22:50:20.153675 ip-10-0-143-45 systemd[1]: Started Kubernetes Kubelet. Jun 03 22:50:20.158046 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.158021 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 22:50:20.160900 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.160881 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 03 22:50:20.160992 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.160980 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 22:50:20.165396 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.165291 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 22:50:20.165396 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.165316 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 22:50:20.165512 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.165481 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-45.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 22:50:20.166006 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.165986 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 22:50:20.166099 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.166005 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 22:50:20.166099 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.166081 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:20.166348 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.165284 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-45.ec2.internal.18b5b3e425317dde default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-45.ec2.internal,UID:ip-10-0-143-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-45.ec2.internal,},FirstTimestamp:2026-06-03 22:50:20.15281507 +0000 UTC m=+0.349837929,LastTimestamp:2026-06-03 22:50:20.15281507 +0000 UTC m=+0.349837929,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-45.ec2.internal,}" Jun 03 22:50:20.166509 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.166488 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 22:50:20.166603 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.166588 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 22:50:20.166658 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.166606 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 22:50:20.167860 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.167175 2561 factory.go:55] Registering systemd factory Jun 03 22:50:20.167860 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.167193 2561 factory.go:223] Registration of the systemd container factory successfully Jun 03 22:50:20.167860 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.167415 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 03 22:50:20.167860 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.167445 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 03 22:50:20.169034 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.169017 2561 factory.go:153] Registering CRI-O factory Jun 03 22:50:20.169034 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.169035 2561 factory.go:223] Registration of the crio container factory successfully Jun 03 22:50:20.169148 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.169114 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 22:50:20.169148 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.169141 2561 factory.go:103] Registering Raw factory Jun 03 22:50:20.169240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.169154 2561 manager.go:1196] Started watching for new ooms in manager Jun 03 22:50:20.169552 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.169537 2561 manager.go:349] Starting recovery of all containers Jun 03 22:50:20.178738 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.178719 2561 manager.go:354] Recovery completed Jun 03 22:50:20.179124 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.179098 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 22:50:20.179201 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.179178 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 22:50:20.182550 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.182537 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:20.185643 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.185627 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:20.185720 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.185659 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:20.185720 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.185673 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:20.186131 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.186118 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 22:50:20.186131 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.186126 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:20.186240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.186132 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 22:50:20.186240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.186149 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 03 22:50:20.187281 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.187200 2561 policy_none.go:49] "None policy: Start" Jun 03 22:50:20.187338 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.187282 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 22:50:20.187338 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.187294 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 22:50:20.187625 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.187609 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:20.187688 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.187637 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:20.187688 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.187646 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:20.187861 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.187790 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-45.ec2.internal.18b5b3e4272663e8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-45.ec2.internal,UID:ip-10-0-143-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-45.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-45.ec2.internal,},FirstTimestamp:2026-06-03 22:50:20.18564196 +0000 UTC m=+0.382664831,LastTimestamp:2026-06-03 22:50:20.18564196 +0000 UTC m=+0.382664831,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-45.ec2.internal,}" Jun 03 22:50:20.188176 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.188159 2561 policy_none.go:47] "Start" Jun 03 22:50:20.197892 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.197824 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-45.ec2.internal.18b5b3e42726bfb2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-45.ec2.internal,UID:ip-10-0-143-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-45.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-45.ec2.internal,},FirstTimestamp:2026-06-03 22:50:20.185665458 +0000 UTC m=+0.382688323,LastTimestamp:2026-06-03 22:50:20.185665458 +0000 UTC m=+0.382688323,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-45.ec2.internal,}" Jun 03 22:50:20.200608 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.200586 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9z69k" Jun 03 22:50:20.208063 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.208000 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-45.ec2.internal.18b5b3e42726f319 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-45.ec2.internal,UID:ip-10-0-143-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-45.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-45.ec2.internal,},FirstTimestamp:2026-06-03 22:50:20.185678617 +0000 UTC m=+0.382701478,LastTimestamp:2026-06-03 22:50:20.185678617 +0000 UTC m=+0.382701478,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-45.ec2.internal,}" Jun 03 22:50:20.208477 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.208455 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9z69k" Jun 03 22:50:20.222765 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.222750 2561 manager.go:337] "Starting Device Plugin manager" Jun 03 22:50:20.222831 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.222786 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 22:50:20.222831 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.222798 2561 server.go:87] "Starting device plugin registration server" Jun 03 22:50:20.223024 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.223010 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 22:50:20.223078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.223028 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 22:50:20.223138 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.223126 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 22:50:20.223225 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.223190 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 22:50:20.223225 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.223202 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 22:50:20.223748 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.223732 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 22:50:20.223829 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.223819 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:20.238539 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.238510 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 22:50:20.241539 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.239733 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 22:50:20.241539 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.239767 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 22:50:20.241539 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.239787 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 22:50:20.241539 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.239814 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 22:50:20.242076 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.242060 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 22:50:20.323293 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.323275 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:20.324476 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.324450 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:20.324567 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.324481 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:20.324567 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.324497 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:20.324567 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.324517 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.334457 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.334420 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.334457 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.334438 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-45.ec2.internal\": node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:20.340726 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.340709 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-45.ec2.internal"] Jun 03 22:50:20.340803 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.340770 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:20.342117 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.342104 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:20.342223 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.342134 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:20.342223 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.342148 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:20.343348 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.343333 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:20.343459 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.343445 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.343505 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.343475 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:20.344155 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.344138 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:20.344155 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.344147 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:20.344294 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.344169 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:20.344294 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.344182 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:20.344294 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.344170 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:20.344402 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.344316 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:20.345592 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.345575 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.345653 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.345603 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:20.346323 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.346308 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:20.346412 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.346334 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:20.346412 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.346344 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:20.346493 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.346467 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:20.361779 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.361761 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-45.ec2.internal\" not found" node="ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.366070 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.366055 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-45.ec2.internal\" not found" node="ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.369184 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.369168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60c430d20ac6987ebc793987a773cffd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal\" (UID: \"60c430d20ac6987ebc793987a773cffd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.369277 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.369197 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9756f600fbce4f01e92424ed781b5f3a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-45.ec2.internal\" (UID: \"9756f600fbce4f01e92424ed781b5f3a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.369277 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.369241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60c430d20ac6987ebc793987a773cffd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal\" (UID: \"60c430d20ac6987ebc793987a773cffd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.447263 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.447240 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:20.470361 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.470339 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60c430d20ac6987ebc793987a773cffd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal\" (UID: \"60c430d20ac6987ebc793987a773cffd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.470444 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.470371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60c430d20ac6987ebc793987a773cffd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal\" (UID: \"60c430d20ac6987ebc793987a773cffd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.470444 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.470395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9756f600fbce4f01e92424ed781b5f3a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-45.ec2.internal\" (UID: \"9756f600fbce4f01e92424ed781b5f3a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.470525 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.470444 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60c430d20ac6987ebc793987a773cffd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal\" (UID: \"60c430d20ac6987ebc793987a773cffd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.470525 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.470449 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60c430d20ac6987ebc793987a773cffd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal\" (UID: \"60c430d20ac6987ebc793987a773cffd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.470525 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.470448 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9756f600fbce4f01e92424ed781b5f3a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-45.ec2.internal\" (UID: \"9756f600fbce4f01e92424ed781b5f3a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.547761 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.547740 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:20.648405 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.648338 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:20.664524 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.664499 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.669967 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:20.669953 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-45.ec2.internal" Jun 03 22:50:20.748719 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.748689 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:20.849070 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.849047 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:20.949511 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:20.949452 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:21.050000 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:21.049980 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:21.102426 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.102402 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 22:50:21.102923 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.102537 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 22:50:21.132832 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:21.132801 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9756f600fbce4f01e92424ed781b5f3a.slice/crio-0a6fdf876688d650cf6522dda1a90b96074afe50de39699eb1ef21b81faf908f WatchSource:0}: Error finding container 0a6fdf876688d650cf6522dda1a90b96074afe50de39699eb1ef21b81faf908f: Status 404 returned error can't find the container with id 0a6fdf876688d650cf6522dda1a90b96074afe50de39699eb1ef21b81faf908f Jun 03 22:50:21.135908 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.135894 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 22:50:21.150970 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:21.150951 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:21.211175 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.211119 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 22:45:20 +0000 UTC" deadline="2027-11-02 14:32:04.053952267 +0000 UTC" Jun 03 22:50:21.211175 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.211144 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12399h41m42.842810909s" Jun 03 22:50:21.243629 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.243588 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" event={"ID":"60c430d20ac6987ebc793987a773cffd","Type":"ContainerStarted","Data":"0cbde8b338902ec78c3f4e5087177a8deaa14e3fec819e5774775b55e1e1687d"} Jun 03 22:50:21.244623 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.244603 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-45.ec2.internal" event={"ID":"9756f600fbce4f01e92424ed781b5f3a","Type":"ContainerStarted","Data":"0a6fdf876688d650cf6522dda1a90b96074afe50de39699eb1ef21b81faf908f"} Jun 03 22:50:21.251751 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:21.251737 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:21.264898 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.264879 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 22:50:21.265690 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.265673 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientMemory" Jun 03 22:50:21.265757 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.265703 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 22:50:21.265757 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.265713 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeHasSufficientPID" Jun 03 22:50:21.352085 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:21.352063 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:21.429059 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.429033 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 22:50:21.452992 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:21.452961 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-45.ec2.internal\" not found" Jun 03 22:50:21.508323 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.508260 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 22:50:21.566793 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.566649 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" Jun 03 22:50:21.577973 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.577949 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 22:50:21.578968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.578943 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-45.ec2.internal" Jun 03 22:50:21.586774 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.586755 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 22:50:21.758695 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:21.758611 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 22:50:22.083965 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.083891 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 22:50:22.146389 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.146359 2561 apiserver.go:52] "Watching apiserver" Jun 03 22:50:22.150807 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.150781 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 22:50:22.151178 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.151156 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-lgjjb","openshift-cluster-node-tuning-operator/tuned-csjxl","openshift-image-registry/node-ca-xkqbx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal","openshift-multus/multus-7h7zh","openshift-multus/multus-additional-cni-plugins-4htsl","openshift-network-operator/iptables-alerter-ntnwx","openshift-ovn-kubernetes/ovnkube-node-fwdwt","kube-system/global-pull-secret-syncer-2xvmf","kube-system/konnectivity-agent-gjg7x","kube-system/kube-apiserver-proxy-ip-10-0-143-45.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp","openshift-dns/node-resolver-gjk4g","openshift-multus/network-metrics-daemon-gfcm7"] Jun 03 22:50:22.152785 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.152756 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gjg7x" Jun 03 22:50:22.153792 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.153771 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gjk4g" Jun 03 22:50:22.155193 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.155068 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 22:50:22.155509 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.155451 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 22:50:22.155665 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.155455 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gngxr\"" Jun 03 22:50:22.155795 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.155779 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gxqlv\"" Jun 03 22:50:22.155850 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.155654 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 22:50:22.156000 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.155984 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xkqbx" Jun 03 22:50:22.156039 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.156009 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 22:50:22.156982 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.156734 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:22.156982 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.156812 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:22.157996 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.157669 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 22:50:22.157996 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.157705 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 22:50:22.157996 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.157778 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mjqq4\"" Jun 03 22:50:22.157996 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.157861 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 22:50:22.157996 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.157940 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.159120 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.159060 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.159821 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.159471 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 22:50:22.159821 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.159538 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 22:50:22.159821 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.159603 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 22:50:22.159821 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.159701 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hzwwk\"" Jun 03 22:50:22.159821 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.159782 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 22:50:22.160295 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.160278 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:22.160389 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.160342 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:22.160683 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.160658 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zm4pp\"" Jun 03 22:50:22.161056 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.161037 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 22:50:22.161588 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.161080 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 22:50:22.162169 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.162150 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ntnwx" Jun 03 22:50:22.163707 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.163690 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.164157 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.164142 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mjrzd\"" Jun 03 22:50:22.164157 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.164152 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 22:50:22.164328 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.164158 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 22:50:22.164406 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.164387 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 22:50:22.165296 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.165278 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:22.165391 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.165342 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 22:50:22.165391 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.165359 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8r8pj\"" Jun 03 22:50:22.165500 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.165342 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:22.165686 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.165667 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 22:50:22.167300 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.167268 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 22:50:22.167429 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.167409 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.171252 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.170603 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.171252 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.171065 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 22:50:22.171403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.171294 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 22:50:22.171720 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.171703 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g5knq\"" Jun 03 22:50:22.172053 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.172032 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 22:50:22.172183 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.172133 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 22:50:22.172269 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.172186 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 22:50:22.172338 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.172274 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 22:50:22.172338 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.172317 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 22:50:22.173311 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.172900 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 22:50:22.173311 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.173127 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 22:50:22.173311 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.173141 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8vslx\"" Jun 03 22:50:22.177347 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.177325 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 22:50:22.181104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181084 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.181203 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181112 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.181203 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wc8s\" (UniqueName: \"kubernetes.io/projected/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-kube-api-access-2wc8s\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.181203 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-sys-fs\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.181358 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6315c8bf-857f-48ba-a84b-55549dae3d75-konnectivity-ca\") pod \"konnectivity-agent-gjg7x\" (UID: \"6315c8bf-857f-48ba-a84b-55549dae3d75\") " pod="kube-system/konnectivity-agent-gjg7x" Jun 03 22:50:22.181358 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkzzw\" (UniqueName: \"kubernetes.io/projected/ab98b3af-dc1d-4750-a720-23743d62f5ae-kube-api-access-jkzzw\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.181358 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181312 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75cdff9b-2d30-4a8e-bb7b-685011837e4b-serviceca\") pod \"node-ca-xkqbx\" (UID: \"75cdff9b-2d30-4a8e-bb7b-685011837e4b\") " pod="openshift-image-registry/node-ca-xkqbx" Jun 03 22:50:22.181358 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181337 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-run-netns\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.181358 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.181566 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e38e8295-f82a-48d7-8c25-726eeed76404-kubelet-config\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:22.181566 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-multus-socket-dir-parent\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.181566 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-device-dir\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.181566 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181458 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75cdff9b-2d30-4a8e-bb7b-685011837e4b-host\") pod \"node-ca-xkqbx\" (UID: \"75cdff9b-2d30-4a8e-bb7b-685011837e4b\") " pod="openshift-image-registry/node-ca-xkqbx" Jun 03 22:50:22.181566 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msgq2\" (UniqueName: \"kubernetes.io/projected/ac962794-8899-4702-8a68-43561036621a-kube-api-access-msgq2\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:22.181566 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181507 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvqn9\" (UniqueName: \"kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9\") pod \"network-check-target-lgjjb\" (UID: \"234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae\") " pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:22.181566 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-var-lib-kubelet\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.181566 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk5wd\" (UniqueName: \"kubernetes.io/projected/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-kube-api-access-dk5wd\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.181566 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-node-log\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-run-multus-certs\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181593 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-etc-kubernetes\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptdnd\" (UniqueName: \"kubernetes.io/projected/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-kube-api-access-ptdnd\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181622 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-cnibin\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181634 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/498c3d72-0d37-4bab-8284-ee06ea438210-host-slash\") pod \"iptables-alerter-ntnwx\" (UID: \"498c3d72-0d37-4bab-8284-ee06ea438210\") " pod="openshift-network-operator/iptables-alerter-ntnwx" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-sys\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181666 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-slash\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181685 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ls6l\" (UniqueName: \"kubernetes.io/projected/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-kube-api-access-7ls6l\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181705 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181718 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-modprobe-d\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-sysconfig\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181750 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-systemd\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181764 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-run-systemd\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181777 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f115edfc-b8cf-40d0-a424-e990f478cab3-hosts-file\") pod \"node-resolver-gjk4g\" (UID: \"f115edfc-b8cf-40d0-a424-e990f478cab3\") " pod="openshift-dns/node-resolver-gjk4g" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sngn\" (UniqueName: \"kubernetes.io/projected/f115edfc-b8cf-40d0-a424-e990f478cab3-kube-api-access-9sngn\") pod \"node-resolver-gjk4g\" (UID: \"f115edfc-b8cf-40d0-a424-e990f478cab3\") " pod="openshift-dns/node-resolver-gjk4g" Jun 03 22:50:22.181816 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181811 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-lib-modules\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181842 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-tuned\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-run-ovn\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-log-socket\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181885 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-var-lib-kubelet\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181898 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-systemd-units\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181912 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-run-netns\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e38e8295-f82a-48d7-8c25-726eeed76404-dbus\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181942 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181955 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-kubernetes\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-cni-bin\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.181993 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab98b3af-dc1d-4750-a720-23743d62f5ae-env-overrides\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-etc-selinux\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182023 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-multus-daemon-config\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-system-cni-dir\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.182403 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-cni-binary-copy\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-etc-openvswitch\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182078 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-var-lib-cni-bin\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-hostroot\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182125 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f115edfc-b8cf-40d0-a424-e990f478cab3-tmp-dir\") pod \"node-resolver-gjk4g\" (UID: \"f115edfc-b8cf-40d0-a424-e990f478cab3\") " pod="openshift-dns/node-resolver-gjk4g" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzz4r\" (UniqueName: \"kubernetes.io/projected/75cdff9b-2d30-4a8e-bb7b-685011837e4b-kube-api-access-vzz4r\") pod \"node-ca-xkqbx\" (UID: \"75cdff9b-2d30-4a8e-bb7b-685011837e4b\") " pod="openshift-image-registry/node-ca-xkqbx" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182153 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6315c8bf-857f-48ba-a84b-55549dae3d75-agent-certs\") pod \"konnectivity-agent-gjg7x\" (UID: \"6315c8bf-857f-48ba-a84b-55549dae3d75\") " pod="kube-system/konnectivity-agent-gjg7x" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182167 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-host\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-var-lib-openvswitch\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182204 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-cni-netd\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-system-cni-dir\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-os-release\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182288 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-cni-binary-copy\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182304 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-sysctl-conf\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182331 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-kubelet\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182576 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab98b3af-dc1d-4750-a720-23743d62f5ae-ovnkube-config\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.183103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab98b3af-dc1d-4750-a720-23743d62f5ae-ovn-node-metrics-cert\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182647 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-multus-cni-dir\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-run-k8s-cni-cncf-io\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-var-lib-cni-multus\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182758 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab98b3af-dc1d-4750-a720-23743d62f5ae-ovnkube-script-lib\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-socket-dir\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182827 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/498c3d72-0d37-4bab-8284-ee06ea438210-iptables-alerter-script\") pod \"iptables-alerter-ntnwx\" (UID: \"498c3d72-0d37-4bab-8284-ee06ea438210\") " pod="openshift-network-operator/iptables-alerter-ntnwx" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182885 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff8tn\" (UniqueName: \"kubernetes.io/projected/498c3d72-0d37-4bab-8284-ee06ea438210-kube-api-access-ff8tn\") pod \"iptables-alerter-ntnwx\" (UID: \"498c3d72-0d37-4bab-8284-ee06ea438210\") " pod="openshift-network-operator/iptables-alerter-ntnwx" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-sysctl-d\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182961 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-registration-dir\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.182984 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-cnibin\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.183011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-multus-conf-dir\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.183046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-os-release\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.183073 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-run\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.183094 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-tmp\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.183981 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.183116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-run-openvswitch\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.205744 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.205721 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qdgvw" Jun 03 22:50:22.213627 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.213611 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qdgvw" Jun 03 22:50:22.267292 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.267266 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 22:50:22.284249 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-sysctl-d\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.284401 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-registration-dir\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.284401 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284289 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-cnibin\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.284401 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284313 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-multus-conf-dir\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.284401 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-os-release\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.284401 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284353 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-run\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.284401 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-tmp\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284402 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-run-openvswitch\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284409 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-multus-conf-dir\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284473 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-registration-dir\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284476 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wc8s\" (UniqueName: \"kubernetes.io/projected/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-kube-api-access-2wc8s\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-sys-fs\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6315c8bf-857f-48ba-a84b-55549dae3d75-konnectivity-ca\") pod \"konnectivity-agent-gjg7x\" (UID: \"6315c8bf-857f-48ba-a84b-55549dae3d75\") " pod="kube-system/konnectivity-agent-gjg7x" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkzzw\" (UniqueName: \"kubernetes.io/projected/ab98b3af-dc1d-4750-a720-23743d62f5ae-kube-api-access-jkzzw\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75cdff9b-2d30-4a8e-bb7b-685011837e4b-serviceca\") pod \"node-ca-xkqbx\" (UID: \"75cdff9b-2d30-4a8e-bb7b-685011837e4b\") " pod="openshift-image-registry/node-ca-xkqbx" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-run-netns\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284649 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284674 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e38e8295-f82a-48d7-8c25-726eeed76404-kubelet-config\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:22.284703 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284707 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-multus-socket-dir-parent\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-device-dir\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284754 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75cdff9b-2d30-4a8e-bb7b-685011837e4b-host\") pod \"node-ca-xkqbx\" (UID: \"75cdff9b-2d30-4a8e-bb7b-685011837e4b\") " pod="openshift-image-registry/node-ca-xkqbx" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msgq2\" (UniqueName: \"kubernetes.io/projected/ac962794-8899-4702-8a68-43561036621a-kube-api-access-msgq2\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284798 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-run\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqn9\" (UniqueName: \"kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9\") pod \"network-check-target-lgjjb\" (UID: \"234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae\") " pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-var-lib-kubelet\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk5wd\" (UniqueName: \"kubernetes.io/projected/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-kube-api-access-dk5wd\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284883 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-node-log\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284907 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-run-multus-certs\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284930 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-etc-kubernetes\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284955 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdnd\" (UniqueName: \"kubernetes.io/projected/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-kube-api-access-ptdnd\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284980 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-cnibin\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285007 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/498c3d72-0d37-4bab-8284-ee06ea438210-host-slash\") pod \"iptables-alerter-ntnwx\" (UID: \"498c3d72-0d37-4bab-8284-ee06ea438210\") " pod="openshift-network-operator/iptables-alerter-ntnwx" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285036 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-sys\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285059 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-slash\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ls6l\" (UniqueName: \"kubernetes.io/projected/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-kube-api-access-7ls6l\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.285378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285115 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285140 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-modprobe-d\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285170 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-run-openvswitch\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-sysconfig\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285235 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285244 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-systemd\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-run-systemd\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285283 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285295 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f115edfc-b8cf-40d0-a424-e990f478cab3-hosts-file\") pod \"node-resolver-gjk4g\" (UID: \"f115edfc-b8cf-40d0-a424-e990f478cab3\") " pod="openshift-dns/node-resolver-gjk4g" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sngn\" (UniqueName: \"kubernetes.io/projected/f115edfc-b8cf-40d0-a424-e990f478cab3-kube-api-access-9sngn\") pod \"node-resolver-gjk4g\" (UID: \"f115edfc-b8cf-40d0-a424-e990f478cab3\") " pod="openshift-dns/node-resolver-gjk4g" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-lib-modules\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-tuned\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-run-ovn\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285461 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-log-socket\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-var-lib-kubelet\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-systemd-units\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.286160 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-run-netns\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e38e8295-f82a-48d7-8c25-726eeed76404-dbus\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285615 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285628 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-cnibin\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-kubernetes\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285666 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-cni-bin\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285685 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-cnibin\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab98b3af-dc1d-4750-a720-23743d62f5ae-env-overrides\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-etc-selinux\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285731 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-sys-fs\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-multus-daemon-config\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284758 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-os-release\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285770 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-system-cni-dir\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285799 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-cni-binary-copy\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-etc-openvswitch\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285861 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-var-lib-cni-bin\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-hostroot\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.286962 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285911 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f115edfc-b8cf-40d0-a424-e990f478cab3-tmp-dir\") pod \"node-resolver-gjk4g\" (UID: \"f115edfc-b8cf-40d0-a424-e990f478cab3\") " pod="openshift-dns/node-resolver-gjk4g" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285973 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzz4r\" (UniqueName: \"kubernetes.io/projected/75cdff9b-2d30-4a8e-bb7b-685011837e4b-kube-api-access-vzz4r\") pod \"node-ca-xkqbx\" (UID: \"75cdff9b-2d30-4a8e-bb7b-685011837e4b\") " pod="openshift-image-registry/node-ca-xkqbx" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6315c8bf-857f-48ba-a84b-55549dae3d75-agent-certs\") pod \"konnectivity-agent-gjg7x\" (UID: \"6315c8bf-857f-48ba-a84b-55549dae3d75\") " pod="kube-system/konnectivity-agent-gjg7x" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-host\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286058 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-var-lib-openvswitch\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-cni-netd\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286108 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-system-cni-dir\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286132 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-os-release\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286158 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-cni-binary-copy\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-sysctl-conf\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286228 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-kubelet\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab98b3af-dc1d-4750-a720-23743d62f5ae-ovnkube-config\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286269 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6315c8bf-857f-48ba-a84b-55549dae3d75-konnectivity-ca\") pod \"konnectivity-agent-gjg7x\" (UID: \"6315c8bf-857f-48ba-a84b-55549dae3d75\") " pod="kube-system/konnectivity-agent-gjg7x" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab98b3af-dc1d-4750-a720-23743d62f5ae-ovn-node-metrics-cert\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-multus-cni-dir\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286310 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75cdff9b-2d30-4a8e-bb7b-685011837e4b-serviceca\") pod \"node-ca-xkqbx\" (UID: \"75cdff9b-2d30-4a8e-bb7b-685011837e4b\") " pod="openshift-image-registry/node-ca-xkqbx" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286362 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/498c3d72-0d37-4bab-8284-ee06ea438210-host-slash\") pod \"iptables-alerter-ntnwx\" (UID: \"498c3d72-0d37-4bab-8284-ee06ea438210\") " pod="openshift-network-operator/iptables-alerter-ntnwx" Jun 03 22:50:22.287728 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-run-k8s-cni-cncf-io\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286416 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-sys\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286418 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-var-lib-cni-multus\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286451 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab98b3af-dc1d-4750-a720-23743d62f5ae-ovnkube-script-lib\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286452 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-var-lib-cni-multus\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286514 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-var-lib-kubelet\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286668 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e38e8295-f82a-48d7-8c25-726eeed76404-kubelet-config\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-multus-socket-dir-parent\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286764 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-device-dir\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75cdff9b-2d30-4a8e-bb7b-685011837e4b-host\") pod \"node-ca-xkqbx\" (UID: \"75cdff9b-2d30-4a8e-bb7b-685011837e4b\") " pod="openshift-image-registry/node-ca-xkqbx" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286851 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-multus-cni-dir\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286887 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-run-k8s-cni-cncf-io\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-socket-dir\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.286976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/498c3d72-0d37-4bab-8284-ee06ea438210-iptables-alerter-script\") pod \"iptables-alerter-ntnwx\" (UID: \"498c3d72-0d37-4bab-8284-ee06ea438210\") " pod="openshift-network-operator/iptables-alerter-ntnwx" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287004 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff8tn\" (UniqueName: \"kubernetes.io/projected/498c3d72-0d37-4bab-8284-ee06ea438210-kube-api-access-ff8tn\") pod \"iptables-alerter-ntnwx\" (UID: \"498c3d72-0d37-4bab-8284-ee06ea438210\") " pod="openshift-network-operator/iptables-alerter-ntnwx" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-run-netns\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.288437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287005 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287092 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-slash\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287097 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-node-log\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287134 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-run-multus-certs\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287168 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-etc-kubernetes\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287178 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.285113 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287343 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-socket-dir\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-etc-selinux\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287652 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-modprobe-d\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.284371 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-sysctl-d\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287713 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-sysconfig\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287762 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-systemd\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287786 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/498c3d72-0d37-4bab-8284-ee06ea438210-iptables-alerter-script\") pod \"iptables-alerter-ntnwx\" (UID: \"498c3d72-0d37-4bab-8284-ee06ea438210\") " pod="openshift-network-operator/iptables-alerter-ntnwx" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287803 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-run-systemd\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287848 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f115edfc-b8cf-40d0-a424-e990f478cab3-hosts-file\") pod \"node-resolver-gjk4g\" (UID: \"f115edfc-b8cf-40d0-a424-e990f478cab3\") " pod="openshift-dns/node-resolver-gjk4g" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.287935 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288015 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-host\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.288955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288061 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-system-cni-dir\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288290 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-etc-openvswitch\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288342 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-var-lib-cni-bin\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288381 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-hostroot\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288412 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288451 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-var-lib-openvswitch\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288510 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-cni-netd\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.288556 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288560 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-system-cni-dir\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.288608 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs podName:ac962794-8899-4702-8a68-43561036621a nodeName:}" failed. No retries permitted until 2026-06-03 22:50:22.78859267 +0000 UTC m=+2.985615516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs") pod "network-metrics-daemon-gfcm7" (UID: "ac962794-8899-4702-8a68-43561036621a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288615 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-os-release\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288625 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f115edfc-b8cf-40d0-a424-e990f478cab3-tmp-dir\") pod \"node-resolver-gjk4g\" (UID: \"f115edfc-b8cf-40d0-a424-e990f478cab3\") " pod="openshift-dns/node-resolver-gjk4g" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288758 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-lib-modules\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.288971 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-multus-daemon-config\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289046 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-cni-binary-copy\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289124 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-cni-binary-copy\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289429 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-run-ovn\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289497 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-log-socket\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.289772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289538 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-host-var-lib-kubelet\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.290555 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289579 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-systemd-units\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.290555 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289618 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-run-netns\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.290555 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289698 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab98b3af-dc1d-4750-a720-23743d62f5ae-ovnkube-config\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.290555 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e38e8295-f82a-48d7-8c25-726eeed76404-dbus\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:22.290555 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.289802 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:22.290555 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289836 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-sysctl-conf\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.290555 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.289848 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret podName:e38e8295-f82a-48d7-8c25-726eeed76404 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:22.789831453 +0000 UTC m=+2.986854309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret") pod "global-pull-secret-syncer-2xvmf" (UID: "e38e8295-f82a-48d7-8c25-726eeed76404") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:22.290555 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289890 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-kubelet\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.290555 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289895 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab98b3af-dc1d-4750-a720-23743d62f5ae-host-cni-bin\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.290555 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.289938 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-kubernetes\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.290555 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.290276 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab98b3af-dc1d-4750-a720-23743d62f5ae-env-overrides\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.290555 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.290419 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab98b3af-dc1d-4750-a720-23743d62f5ae-ovnkube-script-lib\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.291063 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.290885 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-tmp\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.291567 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.291544 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-etc-tuned\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.291753 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.291733 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6315c8bf-857f-48ba-a84b-55549dae3d75-agent-certs\") pod \"konnectivity-agent-gjg7x\" (UID: \"6315c8bf-857f-48ba-a84b-55549dae3d75\") " pod="kube-system/konnectivity-agent-gjg7x" Jun 03 22:50:22.293283 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.293260 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab98b3af-dc1d-4750-a720-23743d62f5ae-ovn-node-metrics-cert\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.301778 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.301755 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wc8s\" (UniqueName: \"kubernetes.io/projected/56d468f4-bdc5-4de2-b6c8-4cf46f46d744-kube-api-access-2wc8s\") pod \"multus-additional-cni-plugins-4htsl\" (UID: \"56d468f4-bdc5-4de2-b6c8-4cf46f46d744\") " pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.314934 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.314914 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff8tn\" (UniqueName: \"kubernetes.io/projected/498c3d72-0d37-4bab-8284-ee06ea438210-kube-api-access-ff8tn\") pod \"iptables-alerter-ntnwx\" (UID: \"498c3d72-0d37-4bab-8284-ee06ea438210\") " pod="openshift-network-operator/iptables-alerter-ntnwx" Jun 03 22:50:22.318443 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.318417 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:22.318443 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.318439 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:22.318653 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.318451 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fvqn9 for pod openshift-network-diagnostics/network-check-target-lgjjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:22.318653 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.318498 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9 podName:234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae nodeName:}" failed. No retries permitted until 2026-06-03 22:50:22.818486911 +0000 UTC m=+3.015509758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fvqn9" (UniqueName: "kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9") pod "network-check-target-lgjjb" (UID: "234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:22.320643 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.320581 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzz4r\" (UniqueName: \"kubernetes.io/projected/75cdff9b-2d30-4a8e-bb7b-685011837e4b-kube-api-access-vzz4r\") pod \"node-ca-xkqbx\" (UID: \"75cdff9b-2d30-4a8e-bb7b-685011837e4b\") " pod="openshift-image-registry/node-ca-xkqbx" Jun 03 22:50:22.321046 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.321019 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk5wd\" (UniqueName: \"kubernetes.io/projected/cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3-kube-api-access-dk5wd\") pod \"tuned-csjxl\" (UID: \"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3\") " pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.321511 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.321452 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkzzw\" (UniqueName: \"kubernetes.io/projected/ab98b3af-dc1d-4750-a720-23743d62f5ae-kube-api-access-jkzzw\") pod \"ovnkube-node-fwdwt\" (UID: \"ab98b3af-dc1d-4750-a720-23743d62f5ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.321677 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.321652 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sngn\" (UniqueName: \"kubernetes.io/projected/f115edfc-b8cf-40d0-a424-e990f478cab3-kube-api-access-9sngn\") pod \"node-resolver-gjk4g\" (UID: \"f115edfc-b8cf-40d0-a424-e990f478cab3\") " pod="openshift-dns/node-resolver-gjk4g" Jun 03 22:50:22.322915 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.322890 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptdnd\" (UniqueName: \"kubernetes.io/projected/a434b67e-5ad2-4b55-8e0f-2843fb14a46b-kube-api-access-ptdnd\") pod \"multus-7h7zh\" (UID: \"a434b67e-5ad2-4b55-8e0f-2843fb14a46b\") " pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.323561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.323487 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ls6l\" (UniqueName: \"kubernetes.io/projected/b76ddac5-61e8-4b67-90dc-7faf9e06b96b-kube-api-access-7ls6l\") pod \"aws-ebs-csi-driver-node-99vzp\" (UID: \"b76ddac5-61e8-4b67-90dc-7faf9e06b96b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.323561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.323531 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msgq2\" (UniqueName: \"kubernetes.io/projected/ac962794-8899-4702-8a68-43561036621a-kube-api-access-msgq2\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:22.465878 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.465790 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gjg7x" Jun 03 22:50:22.473923 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.473904 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gjk4g" Jun 03 22:50:22.483255 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.483224 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xkqbx" Jun 03 22:50:22.488533 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.488516 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7h7zh" Jun 03 22:50:22.494826 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.494803 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4htsl" Jun 03 22:50:22.500172 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.500155 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ntnwx" Jun 03 22:50:22.507456 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.507436 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-csjxl" Jun 03 22:50:22.515808 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.515793 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:22.520314 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.520294 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" Jun 03 22:50:22.790909 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.790875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:22.791079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.790925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:22.791079 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.791026 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:22.791079 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.791026 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:22.791205 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.791088 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret podName:e38e8295-f82a-48d7-8c25-726eeed76404 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:23.79107297 +0000 UTC m=+3.988095816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret") pod "global-pull-secret-syncer-2xvmf" (UID: "e38e8295-f82a-48d7-8c25-726eeed76404") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:22.791205 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.791110 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs podName:ac962794-8899-4702-8a68-43561036621a nodeName:}" failed. No retries permitted until 2026-06-03 22:50:23.791099864 +0000 UTC m=+3.988122724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs") pod "network-metrics-daemon-gfcm7" (UID: "ac962794-8899-4702-8a68-43561036621a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:22.891886 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:22.891852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqn9\" (UniqueName: \"kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9\") pod \"network-check-target-lgjjb\" (UID: \"234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae\") " pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:22.892097 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.892075 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:22.892156 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.892109 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:22.892156 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.892124 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fvqn9 for pod openshift-network-diagnostics/network-check-target-lgjjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:22.892258 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:22.892194 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9 podName:234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae nodeName:}" failed. No retries permitted until 2026-06-03 22:50:23.892174755 +0000 UTC m=+4.089197614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvqn9" (UniqueName: "kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9") pod "network-check-target-lgjjb" (UID: "234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:23.008447 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:23.008257 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod498c3d72_0d37_4bab_8284_ee06ea438210.slice/crio-91607d20ada99e26ebb67891edebe532855728ada9bc62b0e571891701cba872 WatchSource:0}: Error finding container 91607d20ada99e26ebb67891edebe532855728ada9bc62b0e571891701cba872: Status 404 returned error can't find the container with id 91607d20ada99e26ebb67891edebe532855728ada9bc62b0e571891701cba872 Jun 03 22:50:23.008941 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:23.008822 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda434b67e_5ad2_4b55_8e0f_2843fb14a46b.slice/crio-d9dbb2b628349c403773c71dcc46ea77ea7c1e1a27888832938ae8e66596706c WatchSource:0}: Error finding container d9dbb2b628349c403773c71dcc46ea77ea7c1e1a27888832938ae8e66596706c: Status 404 returned error can't find the container with id d9dbb2b628349c403773c71dcc46ea77ea7c1e1a27888832938ae8e66596706c Jun 03 22:50:23.010150 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:23.010130 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc57042a_8cb4_48fa_8bfc_cd3ee139e7b3.slice/crio-b76eaeac493eedcc5798a6c54beaff537acc60a7650302caf4f90b914887ce95 WatchSource:0}: Error finding container b76eaeac493eedcc5798a6c54beaff537acc60a7650302caf4f90b914887ce95: Status 404 returned error can't find the container with id b76eaeac493eedcc5798a6c54beaff537acc60a7650302caf4f90b914887ce95 Jun 03 22:50:23.014562 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:23.014539 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75cdff9b_2d30_4a8e_bb7b_685011837e4b.slice/crio-0ff1bc0745102dd689e6210b6bdc2a3f93c9d1958a612940a25ebd1bf3b5b12b WatchSource:0}: Error finding container 0ff1bc0745102dd689e6210b6bdc2a3f93c9d1958a612940a25ebd1bf3b5b12b: Status 404 returned error can't find the container with id 0ff1bc0745102dd689e6210b6bdc2a3f93c9d1958a612940a25ebd1bf3b5b12b Jun 03 22:50:23.015199 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:23.015157 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf115edfc_b8cf_40d0_a424_e990f478cab3.slice/crio-1ea7b4af5befb5ec6611499e6736dabe488dacfa88d604e89c86c115fffa2da5 WatchSource:0}: Error finding container 1ea7b4af5befb5ec6611499e6736dabe488dacfa88d604e89c86c115fffa2da5: Status 404 returned error can't find the container with id 1ea7b4af5befb5ec6611499e6736dabe488dacfa88d604e89c86c115fffa2da5 Jun 03 22:50:23.036067 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:23.036047 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d468f4_bdc5_4de2_b6c8_4cf46f46d744.slice/crio-077e0291ca388e4c29f6623f0badbfd7950c6ae582360963706e6fb310c9e511 WatchSource:0}: Error finding container 077e0291ca388e4c29f6623f0badbfd7950c6ae582360963706e6fb310c9e511: Status 404 returned error can't find the container with id 077e0291ca388e4c29f6623f0badbfd7950c6ae582360963706e6fb310c9e511 Jun 03 22:50:23.037644 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:23.037593 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76ddac5_61e8_4b67_90dc_7faf9e06b96b.slice/crio-e711192a0ff7c1d15de6a960f37958665a329236cdd0194846d7ba245df1166b WatchSource:0}: Error finding container e711192a0ff7c1d15de6a960f37958665a329236cdd0194846d7ba245df1166b: Status 404 returned error can't find the container with id e711192a0ff7c1d15de6a960f37958665a329236cdd0194846d7ba245df1166b Jun 03 22:50:23.039348 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:23.039329 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6315c8bf_857f_48ba_a84b_55549dae3d75.slice/crio-eb2d9c66ae1b5e3cdf5e8d634be7d22b43cee8a7ce37183ae9e49394c7927274 WatchSource:0}: Error finding container eb2d9c66ae1b5e3cdf5e8d634be7d22b43cee8a7ce37183ae9e49394c7927274: Status 404 returned error can't find the container with id eb2d9c66ae1b5e3cdf5e8d634be7d22b43cee8a7ce37183ae9e49394c7927274 Jun 03 22:50:23.041115 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:23.041080 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab98b3af_dc1d_4750_a720_23743d62f5ae.slice/crio-f3803080fb28a8ab84d7ffbe9ec75cb16d90041b8571a7b79ca0d48f48f3efbd WatchSource:0}: Error finding container f3803080fb28a8ab84d7ffbe9ec75cb16d90041b8571a7b79ca0d48f48f3efbd: Status 404 returned error can't find the container with id f3803080fb28a8ab84d7ffbe9ec75cb16d90041b8571a7b79ca0d48f48f3efbd Jun 03 22:50:23.215517 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.215485 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 22:45:22 +0000 UTC" deadline="2028-01-15 20:52:03.90627779 +0000 UTC" Jun 03 22:50:23.215517 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.215512 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14182h1m40.690768828s" Jun 03 22:50:23.250149 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.250106 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-45.ec2.internal" event={"ID":"9756f600fbce4f01e92424ed781b5f3a","Type":"ContainerStarted","Data":"0d38ce66b76be35ca487dcbc237ba33a5971831a4d52ad44bb1c8e7513b284da"} Jun 03 22:50:23.254356 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.254316 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" event={"ID":"ab98b3af-dc1d-4750-a720-23743d62f5ae","Type":"ContainerStarted","Data":"f3803080fb28a8ab84d7ffbe9ec75cb16d90041b8571a7b79ca0d48f48f3efbd"} Jun 03 22:50:23.255558 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.255532 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gjg7x" event={"ID":"6315c8bf-857f-48ba-a84b-55549dae3d75","Type":"ContainerStarted","Data":"eb2d9c66ae1b5e3cdf5e8d634be7d22b43cee8a7ce37183ae9e49394c7927274"} Jun 03 22:50:23.256726 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.256698 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4htsl" event={"ID":"56d468f4-bdc5-4de2-b6c8-4cf46f46d744","Type":"ContainerStarted","Data":"077e0291ca388e4c29f6623f0badbfd7950c6ae582360963706e6fb310c9e511"} Jun 03 22:50:23.257771 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.257750 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xkqbx" event={"ID":"75cdff9b-2d30-4a8e-bb7b-685011837e4b","Type":"ContainerStarted","Data":"0ff1bc0745102dd689e6210b6bdc2a3f93c9d1958a612940a25ebd1bf3b5b12b"} Jun 03 22:50:23.259126 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.259104 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-csjxl" event={"ID":"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3","Type":"ContainerStarted","Data":"b76eaeac493eedcc5798a6c54beaff537acc60a7650302caf4f90b914887ce95"} Jun 03 22:50:23.260322 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.260283 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ntnwx" event={"ID":"498c3d72-0d37-4bab-8284-ee06ea438210","Type":"ContainerStarted","Data":"91607d20ada99e26ebb67891edebe532855728ada9bc62b0e571891701cba872"} Jun 03 22:50:23.261266 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.261241 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" event={"ID":"b76ddac5-61e8-4b67-90dc-7faf9e06b96b","Type":"ContainerStarted","Data":"e711192a0ff7c1d15de6a960f37958665a329236cdd0194846d7ba245df1166b"} Jun 03 22:50:23.262331 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.262306 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gjk4g" event={"ID":"f115edfc-b8cf-40d0-a424-e990f478cab3","Type":"ContainerStarted","Data":"1ea7b4af5befb5ec6611499e6736dabe488dacfa88d604e89c86c115fffa2da5"} Jun 03 22:50:23.263342 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.263316 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7h7zh" event={"ID":"a434b67e-5ad2-4b55-8e0f-2843fb14a46b","Type":"ContainerStarted","Data":"d9dbb2b628349c403773c71dcc46ea77ea7c1e1a27888832938ae8e66596706c"} Jun 03 22:50:23.268425 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.268367 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-45.ec2.internal" podStartSLOduration=2.268353323 podStartE2EDuration="2.268353323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:23.268308331 +0000 UTC m=+3.465331200" watchObservedRunningTime="2026-06-03 22:50:23.268353323 +0000 UTC m=+3.465376192" Jun 03 22:50:23.797929 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.797880 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:23.798114 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.797937 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:23.798114 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:23.798058 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:23.798252 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:23.798121 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret podName:e38e8295-f82a-48d7-8c25-726eeed76404 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:25.798103676 +0000 UTC m=+5.995126537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret") pod "global-pull-secret-syncer-2xvmf" (UID: "e38e8295-f82a-48d7-8c25-726eeed76404") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:23.798546 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:23.798528 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:23.798626 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:23.798585 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs podName:ac962794-8899-4702-8a68-43561036621a nodeName:}" failed. No retries permitted until 2026-06-03 22:50:25.798568653 +0000 UTC m=+5.995591516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs") pod "network-metrics-daemon-gfcm7" (UID: "ac962794-8899-4702-8a68-43561036621a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:23.900071 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:23.898740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqn9\" (UniqueName: \"kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9\") pod \"network-check-target-lgjjb\" (UID: \"234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae\") " pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:23.900071 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:23.898932 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:23.900071 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:23.898952 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:23.900071 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:23.898965 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fvqn9 for pod openshift-network-diagnostics/network-check-target-lgjjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:23.900071 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:23.899024 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9 podName:234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae nodeName:}" failed. No retries permitted until 2026-06-03 22:50:25.899006596 +0000 UTC m=+6.096029442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvqn9" (UniqueName: "kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9") pod "network-check-target-lgjjb" (UID: "234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:24.216320 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:24.216192 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 22:45:22 +0000 UTC" deadline="2027-11-25 06:14:17.682562701 +0000 UTC" Jun 03 22:50:24.216320 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:24.216267 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12943h23m53.466299994s" Jun 03 22:50:24.242506 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:24.242480 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:24.242651 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:24.242614 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:24.243019 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:24.242998 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:24.243122 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:24.243102 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:24.243180 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:24.243170 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:24.243305 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:24.243256 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:24.278838 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:24.278808 2561 generic.go:356] "Generic (PLEG): container finished" podID="60c430d20ac6987ebc793987a773cffd" containerID="888372d96585dd0c30f2c74f94eb9458d8ec319274ceb7d7aed2159a66d0d688" exitCode=0 Jun 03 22:50:24.279750 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:24.279278 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" event={"ID":"60c430d20ac6987ebc793987a773cffd","Type":"ContainerDied","Data":"888372d96585dd0c30f2c74f94eb9458d8ec319274ceb7d7aed2159a66d0d688"} Jun 03 22:50:25.319051 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:25.318460 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" event={"ID":"60c430d20ac6987ebc793987a773cffd","Type":"ContainerStarted","Data":"f710f275e62eb923e1f7d8d9d598ab9c60aee880df363a08274cc1b3db641971"} Jun 03 22:50:25.818815 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:25.818771 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:25.819005 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:25.818825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:25.819005 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:25.818968 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:25.819123 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:25.819031 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret podName:e38e8295-f82a-48d7-8c25-726eeed76404 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:29.819014002 +0000 UTC m=+10.016036851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret") pod "global-pull-secret-syncer-2xvmf" (UID: "e38e8295-f82a-48d7-8c25-726eeed76404") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:25.819446 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:25.819427 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:25.819531 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:25.819481 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs podName:ac962794-8899-4702-8a68-43561036621a nodeName:}" failed. No retries permitted until 2026-06-03 22:50:29.819465663 +0000 UTC m=+10.016488524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs") pod "network-metrics-daemon-gfcm7" (UID: "ac962794-8899-4702-8a68-43561036621a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:25.919875 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:25.919836 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqn9\" (UniqueName: \"kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9\") pod \"network-check-target-lgjjb\" (UID: \"234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae\") " pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:25.920049 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:25.920036 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:25.920149 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:25.920054 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:25.920149 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:25.920064 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fvqn9 for pod openshift-network-diagnostics/network-check-target-lgjjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:25.920149 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:25.920120 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9 podName:234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae nodeName:}" failed. No retries permitted until 2026-06-03 22:50:29.920101926 +0000 UTC m=+10.117124799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvqn9" (UniqueName: "kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9") pod "network-check-target-lgjjb" (UID: "234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:26.240681 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:26.240652 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:26.240842 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:26.240757 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:26.250114 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:26.250086 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:26.250377 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:26.250360 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:26.250477 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:26.250448 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:26.250559 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:26.250301 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:28.240547 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:28.240516 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:28.240991 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:28.240645 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:28.241054 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:28.240998 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:28.241120 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:28.241095 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:28.241189 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:28.241166 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:28.241333 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:28.241259 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:29.853586 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:29.852856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:29.853586 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:29.852906 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:29.853586 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:29.853029 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:29.853586 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:29.853096 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret podName:e38e8295-f82a-48d7-8c25-726eeed76404 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:37.853068905 +0000 UTC m=+18.050091770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret") pod "global-pull-secret-syncer-2xvmf" (UID: "e38e8295-f82a-48d7-8c25-726eeed76404") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:29.853586 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:29.853502 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:29.853586 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:29.853548 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs podName:ac962794-8899-4702-8a68-43561036621a nodeName:}" failed. No retries permitted until 2026-06-03 22:50:37.853535989 +0000 UTC m=+18.050558835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs") pod "network-metrics-daemon-gfcm7" (UID: "ac962794-8899-4702-8a68-43561036621a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:29.953670 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:29.953636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqn9\" (UniqueName: \"kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9\") pod \"network-check-target-lgjjb\" (UID: \"234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae\") " pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:29.953823 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:29.953783 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:29.953823 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:29.953800 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:29.953823 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:29.953811 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fvqn9 for pod openshift-network-diagnostics/network-check-target-lgjjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:29.953952 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:29.953868 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9 podName:234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae nodeName:}" failed. No retries permitted until 2026-06-03 22:50:37.953850992 +0000 UTC m=+18.150873845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvqn9" (UniqueName: "kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9") pod "network-check-target-lgjjb" (UID: "234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:30.241534 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:30.241503 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:30.241695 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:30.241610 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:30.241695 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:30.241678 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:30.241808 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:30.241771 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:30.241888 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:30.241865 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:30.241948 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:30.241771 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:32.240466 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:32.240428 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:32.240466 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:32.240464 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:32.240889 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:32.240428 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:32.240889 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:32.240556 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:32.240889 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:32.240612 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:32.240889 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:32.240669 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:34.240490 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:34.240447 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:34.240892 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:34.240447 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:34.248441 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:34.248405 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:34.248755 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:34.248739 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:34.248836 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:34.248822 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:34.248914 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:34.248892 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:36.240954 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:36.240919 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:36.240954 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:36.240955 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:36.241439 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:36.240929 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:36.241439 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:36.241022 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:36.241439 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:36.241145 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:36.241439 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:36.241251 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:37.919650 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:37.919614 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:37.919650 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:37.919655 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:37.920130 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:37.919768 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:37.920130 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:37.919768 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:37.920130 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:37.919830 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret podName:e38e8295-f82a-48d7-8c25-726eeed76404 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:53.91981659 +0000 UTC m=+34.116839437 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret") pod "global-pull-secret-syncer-2xvmf" (UID: "e38e8295-f82a-48d7-8c25-726eeed76404") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:37.920130 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:37.919848 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs podName:ac962794-8899-4702-8a68-43561036621a nodeName:}" failed. No retries permitted until 2026-06-03 22:50:53.919839622 +0000 UTC m=+34.116862474 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs") pod "network-metrics-daemon-gfcm7" (UID: "ac962794-8899-4702-8a68-43561036621a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:38.020886 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:38.020852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqn9\" (UniqueName: \"kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9\") pod \"network-check-target-lgjjb\" (UID: \"234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae\") " pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:38.021069 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:38.020984 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:38.021069 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:38.021007 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:38.021069 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:38.021019 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fvqn9 for pod openshift-network-diagnostics/network-check-target-lgjjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:38.021251 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:38.021079 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9 podName:234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae nodeName:}" failed. No retries permitted until 2026-06-03 22:50:54.021062347 +0000 UTC m=+34.218085209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvqn9" (UniqueName: "kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9") pod "network-check-target-lgjjb" (UID: "234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:38.240500 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:38.240466 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:38.240657 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:38.240586 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:38.240657 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:38.240597 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:38.240775 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:38.240721 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:38.240775 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:38.240770 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:38.240871 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:38.240842 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:40.246047 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:40.246016 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:40.246619 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:40.246124 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:40.246619 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:40.246522 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:40.246619 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:40.246593 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:40.246785 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:40.246645 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:40.246785 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:40.246711 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:42.240637 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.240309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:42.241382 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.240309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:42.241382 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:42.240736 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:42.241382 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.240314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:42.241382 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:42.240846 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:42.241382 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:42.240964 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:42.356499 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.356475 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 22:50:42.356894 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.356869 2561 generic.go:356] "Generic (PLEG): container finished" podID="ab98b3af-dc1d-4750-a720-23743d62f5ae" containerID="3f11ef6ad152d3e456d807b3bf4b1a0d77f214df52a94ae6ef5e966062a21239" exitCode=1 Jun 03 22:50:42.356984 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.356902 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" event={"ID":"ab98b3af-dc1d-4750-a720-23743d62f5ae","Type":"ContainerStarted","Data":"7cb319bd9ba65cf06b9b197d3fcca934ae937c2cecced6d3f650106843c4c48f"} Jun 03 22:50:42.357041 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.356996 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" event={"ID":"ab98b3af-dc1d-4750-a720-23743d62f5ae","Type":"ContainerStarted","Data":"caa6f238e001eaa79d4e62df2110de33e2a62019ca186aa77162ecfe3b8cdf8b"} Jun 03 22:50:42.357094 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.357046 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" event={"ID":"ab98b3af-dc1d-4750-a720-23743d62f5ae","Type":"ContainerStarted","Data":"b79d4fc41cf0123ccfd10b67f25a02bbc6ae204bcdbd8cbffb5c58830611df5b"} Jun 03 22:50:42.357147 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.357138 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" event={"ID":"ab98b3af-dc1d-4750-a720-23743d62f5ae","Type":"ContainerStarted","Data":"2c62250227f72beefca0c30e995f4890fafc9ee47be7513cde83c8e51cff6a29"} Jun 03 22:50:42.357195 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.357185 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" event={"ID":"ab98b3af-dc1d-4750-a720-23743d62f5ae","Type":"ContainerDied","Data":"3f11ef6ad152d3e456d807b3bf4b1a0d77f214df52a94ae6ef5e966062a21239"} Jun 03 22:50:42.357269 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.357252 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" event={"ID":"ab98b3af-dc1d-4750-a720-23743d62f5ae","Type":"ContainerStarted","Data":"98b250cd4ae230029ee2b9d7381d6a795fb6e48d85b94c86cc45b56f243447f7"} Jun 03 22:50:42.358628 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.358599 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gjg7x" event={"ID":"6315c8bf-857f-48ba-a84b-55549dae3d75","Type":"ContainerStarted","Data":"d62eac71f0e29a1e015347fdcef329741984fb8bb0b75c09e52dde50434de6e7"} Jun 03 22:50:42.360326 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.360302 2561 generic.go:356] "Generic (PLEG): container finished" podID="56d468f4-bdc5-4de2-b6c8-4cf46f46d744" containerID="9d5d5980b835fc208c37264db95a87c62bcfbeca67d106df1afa5a9737ca211a" exitCode=0 Jun 03 22:50:42.360417 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.360370 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4htsl" event={"ID":"56d468f4-bdc5-4de2-b6c8-4cf46f46d744","Type":"ContainerDied","Data":"9d5d5980b835fc208c37264db95a87c62bcfbeca67d106df1afa5a9737ca211a"} Jun 03 22:50:42.362460 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.362433 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xkqbx" event={"ID":"75cdff9b-2d30-4a8e-bb7b-685011837e4b","Type":"ContainerStarted","Data":"b4264d0bf9617a40882cee5680fb577542234e1935770e0cfe0d85f03fbc3259"} Jun 03 22:50:42.364571 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.364542 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-csjxl" event={"ID":"cc57042a-8cb4-48fa-8bfc-cd3ee139e7b3","Type":"ContainerStarted","Data":"cc1289c074303a90299f5fc1274c425303d5cd65727595c00c42fa1d41df59f6"} Jun 03 22:50:42.366224 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.366186 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" event={"ID":"b76ddac5-61e8-4b67-90dc-7faf9e06b96b","Type":"ContainerStarted","Data":"11d8babc6cf3037a48a0f09d7c4aab0a2bead17fa245a4efa15622657ed7de49"} Jun 03 22:50:42.367700 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.367681 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gjk4g" event={"ID":"f115edfc-b8cf-40d0-a424-e990f478cab3","Type":"ContainerStarted","Data":"8b2fd79bf99086be094c774cf0d0a4d47f4b0f3f527f3d34b1e71131a05e1447"} Jun 03 22:50:42.369317 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.369295 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7h7zh" event={"ID":"a434b67e-5ad2-4b55-8e0f-2843fb14a46b","Type":"ContainerStarted","Data":"d0a4bc6f6e130729367bafcfb93052c11347af2747f422d6fb51c6aadf10d0d4"} Jun 03 22:50:42.371919 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.371885 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gjg7x" podStartSLOduration=12.281289262 podStartE2EDuration="22.371873984s" totalImagesPullingTime="10.090584722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:42.371430952 +0000 UTC m=+22.568453819" watchObservedRunningTime="2026-06-03 22:50:42.371873984 +0000 UTC m=+22.568896856" Jun 03 22:50:42.372344 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.372316 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-45.ec2.internal" podStartSLOduration=21.372307333 podStartE2EDuration="21.372307333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:25.334523563 +0000 UTC m=+5.531546436" watchObservedRunningTime="2026-06-03 22:50:42.372307333 +0000 UTC m=+22.569330202" Jun 03 22:50:42.385052 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.384999 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gjk4g" podStartSLOduration=3.939042589 podStartE2EDuration="22.384983615s" totalImagesPullingTime="18.445941026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:42.384701378 +0000 UTC m=+22.581724247" watchObservedRunningTime="2026-06-03 22:50:42.384983615 +0000 UTC m=+22.582006484" Jun 03 22:50:42.399171 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.399125 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7h7zh" podStartSLOduration=3.855689227 podStartE2EDuration="22.399114617s" totalImagesPullingTime="18.54342539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:42.398956146 +0000 UTC m=+22.595979015" watchObservedRunningTime="2026-06-03 22:50:42.399114617 +0000 UTC m=+22.596137485" Jun 03 22:50:42.411270 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.411240 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xkqbx" podStartSLOduration=3.934753574 podStartE2EDuration="22.41122608s" totalImagesPullingTime="18.476472506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:42.411034726 +0000 UTC m=+22.608057595" watchObservedRunningTime="2026-06-03 22:50:42.41122608 +0000 UTC m=+22.608248940" Jun 03 22:50:42.813380 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:42.813353 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 22:50:43.234341 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:43.234231 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T22:50:42.813376759Z","UUID":"0dc7d33e-aaf8-4e19-874f-c13722605c6d","Handler":null,"Name":"","Endpoint":""} Jun 03 22:50:43.236023 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:43.235994 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 22:50:43.236131 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:43.236038 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 22:50:43.373773 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:43.373733 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ntnwx" event={"ID":"498c3d72-0d37-4bab-8284-ee06ea438210","Type":"ContainerStarted","Data":"822313ea36470cfdf9ce4fefde0b2f042a69e8a26974dfd895df792c9268e103"} Jun 03 22:50:43.377040 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:43.377012 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" event={"ID":"b76ddac5-61e8-4b67-90dc-7faf9e06b96b","Type":"ContainerStarted","Data":"523a8366cd9fd32d065639f403c14e69c24ade43a3734016432a774c8b761c5e"} Jun 03 22:50:43.390659 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:43.390610 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-csjxl" podStartSLOduration=4.890378472 podStartE2EDuration="23.390594787s" totalImagesPullingTime="18.500216315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:42.451071038 +0000 UTC m=+22.648093906" watchObservedRunningTime="2026-06-03 22:50:43.390594787 +0000 UTC m=+23.587617657" Jun 03 22:50:43.391103 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:43.391073 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ntnwx" podStartSLOduration=4.890719144 podStartE2EDuration="23.391066235s" totalImagesPullingTime="18.500347091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:43.390407162 +0000 UTC m=+23.587430036" watchObservedRunningTime="2026-06-03 22:50:43.391066235 +0000 UTC m=+23.588089104" Jun 03 22:50:44.241276 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:44.241023 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:44.241439 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:44.241044 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:44.241439 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:44.241096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:44.241439 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:44.241387 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:44.241598 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:44.241465 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:44.241598 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:44.241556 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:44.383114 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:44.383085 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 22:50:44.383576 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:44.383498 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" event={"ID":"ab98b3af-dc1d-4750-a720-23743d62f5ae","Type":"ContainerStarted","Data":"a91395ad4cc12a59a43788583893b031bc4da120e1248bb571159bd01bfba9ea"} Jun 03 22:50:44.385699 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:44.385634 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" event={"ID":"b76ddac5-61e8-4b67-90dc-7faf9e06b96b","Type":"ContainerStarted","Data":"8cffedc7b98e82a32f46f3c86d530ef298ec0c86e0bb5a43a739a551314327f7"} Jun 03 22:50:44.416354 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:44.416307 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99vzp" podStartSLOduration=3.891322046 podStartE2EDuration="24.416289293s" totalImagesPullingTime="20.524967247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:44.416123865 +0000 UTC m=+24.613146733" watchObservedRunningTime="2026-06-03 22:50:44.416289293 +0000 UTC m=+24.613312163" Jun 03 22:50:46.240674 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:46.240644 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:46.241352 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:46.240776 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:46.241352 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:46.241177 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:46.241352 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:46.241286 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:46.241499 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:46.241447 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:46.241577 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:46.241548 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:46.525794 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:46.525450 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gjg7x" Jun 03 22:50:46.526878 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:46.526267 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gjg7x" Jun 03 22:50:47.395579 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:47.395541 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 22:50:47.396233 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:47.395938 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" event={"ID":"ab98b3af-dc1d-4750-a720-23743d62f5ae","Type":"ContainerStarted","Data":"8ab9f5707fe5370920c41afb5834849a0c0db85cc4eb642aed87ebb5a9ed4f6f"} Jun 03 22:50:47.396323 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:47.396263 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:47.396380 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:47.396334 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:47.396428 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:47.396414 2561 scope.go:117] "RemoveContainer" containerID="3f11ef6ad152d3e456d807b3bf4b1a0d77f214df52a94ae6ef5e966062a21239" Jun 03 22:50:47.398294 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:47.398267 2561 generic.go:356] "Generic (PLEG): container finished" podID="56d468f4-bdc5-4de2-b6c8-4cf46f46d744" containerID="73396520f72d4419ebcdf59dbbcd1a583bad6711f4df94c69193b06cb008c407" exitCode=0 Jun 03 22:50:47.398409 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:47.398319 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4htsl" event={"ID":"56d468f4-bdc5-4de2-b6c8-4cf46f46d744","Type":"ContainerDied","Data":"73396520f72d4419ebcdf59dbbcd1a583bad6711f4df94c69193b06cb008c407"} Jun 03 22:50:47.413524 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:47.413508 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:48.240862 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.240718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:48.240985 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.240740 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:48.240985 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:48.240935 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:48.241097 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:48.241014 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:48.241097 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.240781 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:48.241097 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:48.241084 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:48.365672 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.365616 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2xvmf"] Jun 03 22:50:48.368919 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.368897 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lgjjb"] Jun 03 22:50:48.369640 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.369613 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gfcm7"] Jun 03 22:50:48.404585 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.404564 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 22:50:48.405037 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.405012 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" event={"ID":"ab98b3af-dc1d-4750-a720-23743d62f5ae","Type":"ContainerStarted","Data":"588b2c1a2f47c766ce7f07bf5c8340a4cffa7cf6c5bc14b2f7850e791db2c22b"} Jun 03 22:50:48.405506 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.405289 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:48.407405 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.407370 2561 generic.go:356] "Generic (PLEG): container finished" podID="56d468f4-bdc5-4de2-b6c8-4cf46f46d744" containerID="6fe0caa6f329343c97fbda0a1a85f07b89fc3339f4a6fec2b28f202611418cb9" exitCode=0 Jun 03 22:50:48.407499 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.407429 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4htsl" event={"ID":"56d468f4-bdc5-4de2-b6c8-4cf46f46d744","Type":"ContainerDied","Data":"6fe0caa6f329343c97fbda0a1a85f07b89fc3339f4a6fec2b28f202611418cb9"} Jun 03 22:50:48.407499 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.407479 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:48.407613 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:48.407579 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:48.407613 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.407604 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:48.407753 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:48.407734 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:48.407802 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.407782 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:48.407875 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:48.407848 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:48.421661 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.421643 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:50:48.428312 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:48.428270 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" podStartSLOduration=9.943719057 podStartE2EDuration="28.428257666s" totalImagesPullingTime="18.484538609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:48.428097264 +0000 UTC m=+28.625120135" watchObservedRunningTime="2026-06-03 22:50:48.428257666 +0000 UTC m=+28.625280535" Jun 03 22:50:49.411541 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:49.411459 2561 generic.go:356] "Generic (PLEG): container finished" podID="56d468f4-bdc5-4de2-b6c8-4cf46f46d744" containerID="dd6aec02ce4dc0f7ddb90ba753faee416068b201374aa8fe29e0778598d508df" exitCode=0 Jun 03 22:50:49.411955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:49.411537 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4htsl" event={"ID":"56d468f4-bdc5-4de2-b6c8-4cf46f46d744","Type":"ContainerDied","Data":"dd6aec02ce4dc0f7ddb90ba753faee416068b201374aa8fe29e0778598d508df"} Jun 03 22:50:50.240906 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:50.240873 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:50.241064 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:50.240963 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:50.241064 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:50.240972 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:50.241196 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:50.241061 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:50.241196 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:50.241068 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:50.241196 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:50.241155 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:52.240700 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:52.240660 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:52.241428 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:52.240660 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:52.241428 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:52.240788 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:52.241428 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:52.240897 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:52.241428 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:52.240664 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:52.241428 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:52.240989 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:52.454391 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:52.454360 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gjg7x" Jun 03 22:50:52.454581 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:52.454496 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 22:50:52.455039 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:52.455019 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gjg7x" Jun 03 22:50:53.938567 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:53.938423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:53.938567 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:53.938555 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:53.938961 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:53.938589 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:53.938961 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:53.938609 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs podName:ac962794-8899-4702-8a68-43561036621a nodeName:}" failed. No retries permitted until 2026-06-03 22:51:25.938593994 +0000 UTC m=+66.135616839 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs") pod "network-metrics-daemon-gfcm7" (UID: "ac962794-8899-4702-8a68-43561036621a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:50:53.938961 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:53.938675 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:53.938961 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:53.938728 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret podName:e38e8295-f82a-48d7-8c25-726eeed76404 nodeName:}" failed. No retries permitted until 2026-06-03 22:51:25.938713932 +0000 UTC m=+66.135736778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret") pod "global-pull-secret-syncer-2xvmf" (UID: "e38e8295-f82a-48d7-8c25-726eeed76404") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:50:54.039115 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.039075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqn9\" (UniqueName: \"kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9\") pod \"network-check-target-lgjjb\" (UID: \"234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae\") " pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:54.039311 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:54.039275 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:50:54.039311 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:54.039302 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:50:54.039436 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:54.039315 2561 projected.go:196] Error preparing data for projected volume kube-api-access-fvqn9 for pod openshift-network-diagnostics/network-check-target-lgjjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:54.039436 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:54.039377 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9 podName:234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae nodeName:}" failed. No retries permitted until 2026-06-03 22:51:26.039356493 +0000 UTC m=+66.236379354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvqn9" (UniqueName: "kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9") pod "network-check-target-lgjjb" (UID: "234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:50:54.240189 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.240164 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:54.240317 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.240171 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:54.240417 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:54.240299 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgjjb" podUID="234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae" Jun 03 22:50:54.240417 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:54.240398 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:50:54.240561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.240424 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:54.240561 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:54.240525 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xvmf" podUID="e38e8295-f82a-48d7-8c25-726eeed76404" Jun 03 22:50:54.425766 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.425694 2561 generic.go:356] "Generic (PLEG): container finished" podID="56d468f4-bdc5-4de2-b6c8-4cf46f46d744" containerID="7086a195e2934e437e9082fe5212b4d636ddd945f111e8f92d6a5e1bfdcd3994" exitCode=0 Jun 03 22:50:54.425766 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.425737 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4htsl" event={"ID":"56d468f4-bdc5-4de2-b6c8-4cf46f46d744","Type":"ContainerDied","Data":"7086a195e2934e437e9082fe5212b4d636ddd945f111e8f92d6a5e1bfdcd3994"} Jun 03 22:50:54.604174 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.604157 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-45.ec2.internal" event="NodeReady" Jun 03 22:50:54.604280 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.604274 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 22:50:54.644138 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.644114 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7rgls"] Jun 03 22:50:54.658657 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.658637 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6gdqg"] Jun 03 22:50:54.658779 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.658760 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:54.660505 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.660482 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 22:50:54.660596 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.660491 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bfmtg\"" Jun 03 22:50:54.660837 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.660820 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 22:50:54.670646 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.670626 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7rgls"] Jun 03 22:50:54.670750 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.670659 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6gdqg"] Jun 03 22:50:54.670750 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.670742 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6gdqg" Jun 03 22:50:54.672436 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.672411 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 22:50:54.672550 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.672469 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 22:50:54.672635 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.672616 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 22:50:54.672755 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.672737 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nr74v\"" Jun 03 22:50:54.846059 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.846020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4klsl\" (UniqueName: \"kubernetes.io/projected/5775370d-aa46-44ea-8fe3-77883c47feb4-kube-api-access-4klsl\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:54.846059 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.846062 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5775370d-aa46-44ea-8fe3-77883c47feb4-config-volume\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:54.846287 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.846094 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38c13ae-5d62-404a-98f7-67fa2bd677f5-cert\") pod \"ingress-canary-6gdqg\" (UID: \"d38c13ae-5d62-404a-98f7-67fa2bd677f5\") " pod="openshift-ingress-canary/ingress-canary-6gdqg" Jun 03 22:50:54.846287 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.846151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:54.846287 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.846170 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6vvt\" (UniqueName: \"kubernetes.io/projected/d38c13ae-5d62-404a-98f7-67fa2bd677f5-kube-api-access-g6vvt\") pod \"ingress-canary-6gdqg\" (UID: \"d38c13ae-5d62-404a-98f7-67fa2bd677f5\") " pod="openshift-ingress-canary/ingress-canary-6gdqg" Jun 03 22:50:54.846287 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.846196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5775370d-aa46-44ea-8fe3-77883c47feb4-tmp-dir\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:54.947416 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.947349 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38c13ae-5d62-404a-98f7-67fa2bd677f5-cert\") pod \"ingress-canary-6gdqg\" (UID: \"d38c13ae-5d62-404a-98f7-67fa2bd677f5\") " pod="openshift-ingress-canary/ingress-canary-6gdqg" Jun 03 22:50:54.947416 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.947395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:54.947871 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.947419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6vvt\" (UniqueName: \"kubernetes.io/projected/d38c13ae-5d62-404a-98f7-67fa2bd677f5-kube-api-access-g6vvt\") pod \"ingress-canary-6gdqg\" (UID: \"d38c13ae-5d62-404a-98f7-67fa2bd677f5\") " pod="openshift-ingress-canary/ingress-canary-6gdqg" Jun 03 22:50:54.947871 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.947447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5775370d-aa46-44ea-8fe3-77883c47feb4-tmp-dir\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:54.947871 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.947495 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4klsl\" (UniqueName: \"kubernetes.io/projected/5775370d-aa46-44ea-8fe3-77883c47feb4-kube-api-access-4klsl\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:54.947871 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:54.947513 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:50:54.947871 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.947533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5775370d-aa46-44ea-8fe3-77883c47feb4-config-volume\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:54.947871 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:54.947575 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls podName:5775370d-aa46-44ea-8fe3-77883c47feb4 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:55.447556986 +0000 UTC m=+35.644579833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls") pod "dns-default-7rgls" (UID: "5775370d-aa46-44ea-8fe3-77883c47feb4") : secret "dns-default-metrics-tls" not found Jun 03 22:50:54.948087 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.947875 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5775370d-aa46-44ea-8fe3-77883c47feb4-tmp-dir\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:54.948151 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.948134 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5775370d-aa46-44ea-8fe3-77883c47feb4-config-volume\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:54.951785 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.951765 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38c13ae-5d62-404a-98f7-67fa2bd677f5-cert\") pod \"ingress-canary-6gdqg\" (UID: \"d38c13ae-5d62-404a-98f7-67fa2bd677f5\") " pod="openshift-ingress-canary/ingress-canary-6gdqg" Jun 03 22:50:54.956015 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.955993 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4klsl\" (UniqueName: \"kubernetes.io/projected/5775370d-aa46-44ea-8fe3-77883c47feb4-kube-api-access-4klsl\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:54.956127 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.956110 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6vvt\" (UniqueName: \"kubernetes.io/projected/d38c13ae-5d62-404a-98f7-67fa2bd677f5-kube-api-access-g6vvt\") pod \"ingress-canary-6gdqg\" (UID: \"d38c13ae-5d62-404a-98f7-67fa2bd677f5\") " pod="openshift-ingress-canary/ingress-canary-6gdqg" Jun 03 22:50:54.996991 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:54.996970 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6gdqg" Jun 03 22:50:55.199153 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:55.199080 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6gdqg"] Jun 03 22:50:55.209893 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:50:55.209867 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38c13ae_5d62_404a_98f7_67fa2bd677f5.slice/crio-43df05e9bce5b12c00998a68cfffb163d7baa9b28a2b48960be9358e2b90dae5 WatchSource:0}: Error finding container 43df05e9bce5b12c00998a68cfffb163d7baa9b28a2b48960be9358e2b90dae5: Status 404 returned error can't find the container with id 43df05e9bce5b12c00998a68cfffb163d7baa9b28a2b48960be9358e2b90dae5 Jun 03 22:50:55.431718 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:55.431677 2561 generic.go:356] "Generic (PLEG): container finished" podID="56d468f4-bdc5-4de2-b6c8-4cf46f46d744" containerID="6aee4aa67d9bd3ada0e5078600501b05789a5b2970c5dc67b24652b688a3b52f" exitCode=0 Jun 03 22:50:55.431884 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:55.431751 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4htsl" event={"ID":"56d468f4-bdc5-4de2-b6c8-4cf46f46d744","Type":"ContainerDied","Data":"6aee4aa67d9bd3ada0e5078600501b05789a5b2970c5dc67b24652b688a3b52f"} Jun 03 22:50:55.433014 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:55.432993 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6gdqg" event={"ID":"d38c13ae-5d62-404a-98f7-67fa2bd677f5","Type":"ContainerStarted","Data":"43df05e9bce5b12c00998a68cfffb163d7baa9b28a2b48960be9358e2b90dae5"} Jun 03 22:50:55.450893 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:55.450846 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:55.450992 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:55.450980 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:50:55.451050 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:55.451031 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls podName:5775370d-aa46-44ea-8fe3-77883c47feb4 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:56.451017339 +0000 UTC m=+36.648040186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls") pod "dns-default-7rgls" (UID: "5775370d-aa46-44ea-8fe3-77883c47feb4") : secret "dns-default-metrics-tls" not found Jun 03 22:50:56.240935 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:56.240711 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:50:56.241390 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:56.240711 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:50:56.241390 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:56.240755 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:50:56.243101 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:56.243068 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 22:50:56.243101 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:56.243083 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 22:50:56.243436 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:56.243407 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zbfkl\"" Jun 03 22:50:56.243557 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:56.243432 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 22:50:56.243557 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:56.243410 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ckpr\"" Jun 03 22:50:56.243557 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:56.243407 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 22:50:56.437980 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:56.437947 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4htsl" event={"ID":"56d468f4-bdc5-4de2-b6c8-4cf46f46d744","Type":"ContainerStarted","Data":"08ea37117fbbf7dcb63f9d7e01233af743ffaa1d732f156a611cce7a412f1950"} Jun 03 22:50:56.459227 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:56.459170 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4htsl" podStartSLOduration=8.250915208 podStartE2EDuration="36.459136886s" totalImagesPullingTime="28.208221678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:56.457927288 +0000 UTC m=+36.654950166" watchObservedRunningTime="2026-06-03 22:50:56.459136886 +0000 UTC m=+36.656159757" Jun 03 22:50:56.459537 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:56.459524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:56.459668 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:56.459651 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:50:56.459734 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:56.459723 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls podName:5775370d-aa46-44ea-8fe3-77883c47feb4 nodeName:}" failed. No retries permitted until 2026-06-03 22:50:58.459704818 +0000 UTC m=+38.656727667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls") pod "dns-default-7rgls" (UID: "5775370d-aa46-44ea-8fe3-77883c47feb4") : secret "dns-default-metrics-tls" not found Jun 03 22:50:58.443903 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:58.443864 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6gdqg" event={"ID":"d38c13ae-5d62-404a-98f7-67fa2bd677f5","Type":"ContainerStarted","Data":"584c23cd7704d955d6f0e85a9753eb5d228a6f3730ec9502d5d3998a465336b4"} Jun 03 22:50:58.457753 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:58.457697 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6gdqg" podStartSLOduration=2.199037982 podStartE2EDuration="4.457680442s" totalImagesPullingTime="2.25864246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:50:58.457597059 +0000 UTC m=+38.654619926" watchObservedRunningTime="2026-06-03 22:50:58.457680442 +0000 UTC m=+38.654703312" Jun 03 22:50:58.475902 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:50:58.475878 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:50:58.476061 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:58.476039 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:50:58.476130 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:50:58.476112 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls podName:5775370d-aa46-44ea-8fe3-77883c47feb4 nodeName:}" failed. No retries permitted until 2026-06-03 22:51:02.476094121 +0000 UTC m=+42.673116969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls") pod "dns-default-7rgls" (UID: "5775370d-aa46-44ea-8fe3-77883c47feb4") : secret "dns-default-metrics-tls" not found Jun 03 22:51:02.500958 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:02.500916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:51:02.501443 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:51:02.501063 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:51:02.501443 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:51:02.501120 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls podName:5775370d-aa46-44ea-8fe3-77883c47feb4 nodeName:}" failed. No retries permitted until 2026-06-03 22:51:10.501105538 +0000 UTC m=+50.698128385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls") pod "dns-default-7rgls" (UID: "5775370d-aa46-44ea-8fe3-77883c47feb4") : secret "dns-default-metrics-tls" not found Jun 03 22:51:10.555046 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:10.555016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:51:10.555575 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:51:10.555169 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:51:10.555575 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:51:10.555277 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls podName:5775370d-aa46-44ea-8fe3-77883c47feb4 nodeName:}" failed. No retries permitted until 2026-06-03 22:51:26.555261324 +0000 UTC m=+66.752284196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls") pod "dns-default-7rgls" (UID: "5775370d-aa46-44ea-8fe3-77883c47feb4") : secret "dns-default-metrics-tls" not found Jun 03 22:51:20.426282 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:20.426254 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fwdwt" Jun 03 22:51:25.956695 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:25.956654 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:51:25.956695 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:25.956696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:51:25.958625 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:25.958601 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 22:51:25.958741 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:25.958636 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 22:51:25.967097 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:51:25.967075 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 22:51:25.967168 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:51:25.967156 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs podName:ac962794-8899-4702-8a68-43561036621a nodeName:}" failed. No retries permitted until 2026-06-03 22:52:29.967135353 +0000 UTC m=+130.164158218 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs") pod "network-metrics-daemon-gfcm7" (UID: "ac962794-8899-4702-8a68-43561036621a") : secret "metrics-daemon-secret" not found Jun 03 22:51:25.970336 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:25.970310 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e38e8295-f82a-48d7-8c25-726eeed76404-original-pull-secret\") pod \"global-pull-secret-syncer-2xvmf\" (UID: \"e38e8295-f82a-48d7-8c25-726eeed76404\") " pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:51:26.057586 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:26.057564 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqn9\" (UniqueName: \"kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9\") pod \"network-check-target-lgjjb\" (UID: \"234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae\") " pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:51:26.059436 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:26.059417 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 22:51:26.069000 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:26.068984 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 22:51:26.080491 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:26.080467 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvqn9\" (UniqueName: \"kubernetes.io/projected/234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae-kube-api-access-fvqn9\") pod \"network-check-target-lgjjb\" (UID: \"234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae\") " pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:51:26.255596 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:26.255575 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2ckpr\"" Jun 03 22:51:26.264172 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:26.264154 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:51:26.267406 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:26.267390 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xvmf" Jun 03 22:51:26.406697 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:26.406665 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2xvmf"] Jun 03 22:51:26.409918 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:51:26.409891 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38e8295_f82a_48d7_8c25_726eeed76404.slice/crio-424f820a623998a00876d52ee1b7ebf00b7f83f6eb0cb371fae495f016ceec93 WatchSource:0}: Error finding container 424f820a623998a00876d52ee1b7ebf00b7f83f6eb0cb371fae495f016ceec93: Status 404 returned error can't find the container with id 424f820a623998a00876d52ee1b7ebf00b7f83f6eb0cb371fae495f016ceec93 Jun 03 22:51:26.420655 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:26.420628 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lgjjb"] Jun 03 22:51:26.424753 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:51:26.424729 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234dc41b_fc85_4cb2_a6d2_95cb9d2b7aae.slice/crio-19faed521ce8aab0f74ffce64a6bdef61296ef5db43eebcca0f88e43828931db WatchSource:0}: Error finding container 19faed521ce8aab0f74ffce64a6bdef61296ef5db43eebcca0f88e43828931db: Status 404 returned error can't find the container with id 19faed521ce8aab0f74ffce64a6bdef61296ef5db43eebcca0f88e43828931db Jun 03 22:51:26.506188 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:26.506113 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2xvmf" event={"ID":"e38e8295-f82a-48d7-8c25-726eeed76404","Type":"ContainerStarted","Data":"424f820a623998a00876d52ee1b7ebf00b7f83f6eb0cb371fae495f016ceec93"} Jun 03 22:51:26.507179 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:26.507155 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lgjjb" event={"ID":"234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae","Type":"ContainerStarted","Data":"19faed521ce8aab0f74ffce64a6bdef61296ef5db43eebcca0f88e43828931db"} Jun 03 22:51:26.561809 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:26.561781 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:51:26.561915 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:51:26.561905 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:51:26.561971 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:51:26.561960 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls podName:5775370d-aa46-44ea-8fe3-77883c47feb4 nodeName:}" failed. No retries permitted until 2026-06-03 22:51:58.561945106 +0000 UTC m=+98.758967973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls") pod "dns-default-7rgls" (UID: "5775370d-aa46-44ea-8fe3-77883c47feb4") : secret "dns-default-metrics-tls" not found Jun 03 22:51:31.522362 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:31.522322 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2xvmf" event={"ID":"e38e8295-f82a-48d7-8c25-726eeed76404","Type":"ContainerStarted","Data":"786b75a5ba8580387383a779c43b782fbe3258608db4a5ad99781da8ce54eae4"} Jun 03 22:51:31.523860 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:31.523838 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lgjjb" event={"ID":"234dc41b-fc85-4cb2-a6d2-95cb9d2b7aae","Type":"ContainerStarted","Data":"2d266290491274bf65e3c07d04a4b1a112d054bc092851907d6b1e368cc46c0f"} Jun 03 22:51:31.523988 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:31.523958 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:51:31.547689 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:31.547644 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lgjjb" podStartSLOduration=67.268243816 podStartE2EDuration="1m11.547629792s" totalImagesPullingTime="4.279385976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:51:31.547229106 +0000 UTC m=+71.744251965" watchObservedRunningTime="2026-06-03 22:51:31.547629792 +0000 UTC m=+71.744652642" Jun 03 22:51:31.548079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:31.548046 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2xvmf" podStartSLOduration=67.248789025 podStartE2EDuration="1m11.54803865s" totalImagesPullingTime="4.299249625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:51:31.535350543 +0000 UTC m=+71.732373409" watchObservedRunningTime="2026-06-03 22:51:31.54803865 +0000 UTC m=+71.745061521" Jun 03 22:51:58.564025 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:51:58.563985 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:51:58.564472 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:51:58.564124 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:51:58.564472 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:51:58.564191 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls podName:5775370d-aa46-44ea-8fe3-77883c47feb4 nodeName:}" failed. No retries permitted until 2026-06-03 22:53:02.564174825 +0000 UTC m=+162.761197672 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls") pod "dns-default-7rgls" (UID: "5775370d-aa46-44ea-8fe3-77883c47feb4") : secret "dns-default-metrics-tls" not found Jun 03 22:52:02.528042 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:52:02.528013 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lgjjb" Jun 03 22:52:30.061533 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:52:30.061498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:52:30.062014 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:52:30.061606 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 22:52:30.062014 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:52:30.061664 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs podName:ac962794-8899-4702-8a68-43561036621a nodeName:}" failed. No retries permitted until 2026-06-03 22:54:32.061649704 +0000 UTC m=+252.258672550 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs") pod "network-metrics-daemon-gfcm7" (UID: "ac962794-8899-4702-8a68-43561036621a") : secret "metrics-daemon-secret" not found Jun 03 22:52:57.692914 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:52:57.692878 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7rgls" podUID="5775370d-aa46-44ea-8fe3-77883c47feb4" Jun 03 22:52:57.722068 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:52:57.722045 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7rgls" Jun 03 22:52:59.261447 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:52:59.261394 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gfcm7" podUID="ac962794-8899-4702-8a68-43561036621a" Jun 03 22:53:02.576111 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:02.576077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:53:02.576586 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:02.576195 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:53:02.576586 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:02.576267 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls podName:5775370d-aa46-44ea-8fe3-77883c47feb4 nodeName:}" failed. No retries permitted until 2026-06-03 22:55:04.576253881 +0000 UTC m=+284.773276727 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls") pod "dns-default-7rgls" (UID: "5775370d-aa46-44ea-8fe3-77883c47feb4") : secret "dns-default-metrics-tls" not found Jun 03 22:53:14.240466 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:14.240388 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:53:54.271922 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.271884 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm"] Jun 03 22:53:54.273654 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.273635 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-vdcxm"] Jun 03 22:53:54.273785 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.273765 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:53:54.275144 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.275131 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59f7f48d79-gp8ds"] Jun 03 22:53:54.275315 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.275296 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.276624 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.276608 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.278961 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.278934 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 22:53:54.279174 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.278936 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9d4zk\"" Jun 03 22:53:54.279869 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.279830 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 22:53:54.279869 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.279859 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 22:53:54.280077 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.279834 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 22:53:54.280077 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.279952 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zb5l7\"" Jun 03 22:53:54.280077 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.279899 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 22:53:54.280077 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.279983 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 22:53:54.280387 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.280187 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 22:53:54.280387 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.280308 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 22:53:54.280532 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.280423 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 22:53:54.280532 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.280509 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8f8tm\"" Jun 03 22:53:54.280672 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.280579 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 22:53:54.289971 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.289929 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 22:53:54.292966 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.292946 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 22:53:54.293928 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.293909 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-vdcxm"] Jun 03 22:53:54.296895 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.296873 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f7f48d79-gp8ds"] Jun 03 22:53:54.300989 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.300968 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.301077 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.300997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-8dfkm\" (UID: \"359d6d2a-6d3a-4990-9c44-c7668126269c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:53:54.301077 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301029 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/888eb6f0-3c3c-4e89-820a-989da94a35e4-ca-trust-extracted\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.301168 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpqcc\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-kube-api-access-gpqcc\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.301168 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-bound-sa-token\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.301168 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/888eb6f0-3c3c-4e89-820a-989da94a35e4-image-registry-private-configuration\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.301309 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tmlx\" (UniqueName: \"kubernetes.io/projected/6fb8e45c-40ce-4d1b-9214-87dd9fb502ca-kube-api-access-5tmlx\") pod \"console-operator-85bd8fd97d-vdcxm\" (UID: \"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca\") " pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.301309 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301195 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbn58\" (UniqueName: \"kubernetes.io/projected/359d6d2a-6d3a-4990-9c44-c7668126269c-kube-api-access-tbn58\") pod \"cluster-samples-operator-9f6f677f5-8dfkm\" (UID: \"359d6d2a-6d3a-4990-9c44-c7668126269c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:53:54.301309 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fb8e45c-40ce-4d1b-9214-87dd9fb502ca-serving-cert\") pod \"console-operator-85bd8fd97d-vdcxm\" (UID: \"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca\") " pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.301309 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/888eb6f0-3c3c-4e89-820a-989da94a35e4-trusted-ca\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.301309 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fb8e45c-40ce-4d1b-9214-87dd9fb502ca-trusted-ca\") pod \"console-operator-85bd8fd97d-vdcxm\" (UID: \"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca\") " pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.301309 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6fb8e45c-40ce-4d1b-9214-87dd9fb502ca-config\") pod \"console-operator-85bd8fd97d-vdcxm\" (UID: \"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca\") " pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.301309 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301300 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-certificates\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.301574 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301370 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/888eb6f0-3c3c-4e89-820a-989da94a35e4-installation-pull-secrets\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.301643 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.301625 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm"] Jun 03 22:53:54.401972 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.401948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.402106 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.401981 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-8dfkm\" (UID: \"359d6d2a-6d3a-4990-9c44-c7668126269c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:53:54.402106 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.402014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/888eb6f0-3c3c-4e89-820a-989da94a35e4-ca-trust-extracted\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.402106 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.402068 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqcc\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-kube-api-access-gpqcc\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.402106 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:54.402090 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 22:53:54.402106 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:54.402107 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7f48d79-gp8ds: secret "image-registry-tls" not found Jun 03 22:53:54.402400 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.402109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-bound-sa-token\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.402400 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.402141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/888eb6f0-3c3c-4e89-820a-989da94a35e4-image-registry-private-configuration\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.402400 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:54.402161 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls podName:888eb6f0-3c3c-4e89-820a-989da94a35e4 nodeName:}" failed. No retries permitted until 2026-06-03 22:53:54.902145915 +0000 UTC m=+215.099168761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls") pod "image-registry-59f7f48d79-gp8ds" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4") : secret "image-registry-tls" not found Jun 03 22:53:54.402400 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.402186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tmlx\" (UniqueName: \"kubernetes.io/projected/6fb8e45c-40ce-4d1b-9214-87dd9fb502ca-kube-api-access-5tmlx\") pod \"console-operator-85bd8fd97d-vdcxm\" (UID: \"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca\") " pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.402400 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.402232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbn58\" (UniqueName: \"kubernetes.io/projected/359d6d2a-6d3a-4990-9c44-c7668126269c-kube-api-access-tbn58\") pod \"cluster-samples-operator-9f6f677f5-8dfkm\" (UID: \"359d6d2a-6d3a-4990-9c44-c7668126269c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:53:54.402400 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.402258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fb8e45c-40ce-4d1b-9214-87dd9fb502ca-serving-cert\") pod \"console-operator-85bd8fd97d-vdcxm\" (UID: \"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca\") " pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.402400 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.402282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/888eb6f0-3c3c-4e89-820a-989da94a35e4-trusted-ca\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.402400 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.402315 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fb8e45c-40ce-4d1b-9214-87dd9fb502ca-trusted-ca\") pod \"console-operator-85bd8fd97d-vdcxm\" (UID: \"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca\") " pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.402400 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:54.402261 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 22:53:54.402400 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.402340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6fb8e45c-40ce-4d1b-9214-87dd9fb502ca-config\") pod \"console-operator-85bd8fd97d-vdcxm\" (UID: \"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca\") " pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.402400 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.402364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-certificates\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.402400 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:54.402381 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls podName:359d6d2a-6d3a-4990-9c44-c7668126269c nodeName:}" failed. No retries permitted until 2026-06-03 22:53:54.902364958 +0000 UTC m=+215.099387824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-8dfkm" (UID: "359d6d2a-6d3a-4990-9c44-c7668126269c") : secret "samples-operator-tls" not found Jun 03 22:53:54.403241 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.402411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/888eb6f0-3c3c-4e89-820a-989da94a35e4-installation-pull-secrets\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.403241 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.403143 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/888eb6f0-3c3c-4e89-820a-989da94a35e4-ca-trust-extracted\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.403396 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.403281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-certificates\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.403453 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.403418 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/888eb6f0-3c3c-4e89-820a-989da94a35e4-trusted-ca\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.403509 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.403453 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6fb8e45c-40ce-4d1b-9214-87dd9fb502ca-config\") pod \"console-operator-85bd8fd97d-vdcxm\" (UID: \"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca\") " pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.403608 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.403584 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fb8e45c-40ce-4d1b-9214-87dd9fb502ca-trusted-ca\") pod \"console-operator-85bd8fd97d-vdcxm\" (UID: \"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca\") " pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.404852 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.404822 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/888eb6f0-3c3c-4e89-820a-989da94a35e4-image-registry-private-configuration\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.404963 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.404940 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fb8e45c-40ce-4d1b-9214-87dd9fb502ca-serving-cert\") pod \"console-operator-85bd8fd97d-vdcxm\" (UID: \"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca\") " pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.405010 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.404986 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/888eb6f0-3c3c-4e89-820a-989da94a35e4-installation-pull-secrets\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.414615 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.414590 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tmlx\" (UniqueName: \"kubernetes.io/projected/6fb8e45c-40ce-4d1b-9214-87dd9fb502ca-kube-api-access-5tmlx\") pod \"console-operator-85bd8fd97d-vdcxm\" (UID: \"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca\") " pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.414807 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.414788 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbn58\" (UniqueName: \"kubernetes.io/projected/359d6d2a-6d3a-4990-9c44-c7668126269c-kube-api-access-tbn58\") pod \"cluster-samples-operator-9f6f677f5-8dfkm\" (UID: \"359d6d2a-6d3a-4990-9c44-c7668126269c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:53:54.419001 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.418976 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-bound-sa-token\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.420305 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.420280 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpqcc\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-kube-api-access-gpqcc\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.590077 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.589992 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:53:54.705289 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.705263 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-vdcxm"] Jun 03 22:53:54.708864 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:53:54.708836 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb8e45c_40ce_4d1b_9214_87dd9fb502ca.slice/crio-5b8ebe09e538da12815597e7381e5037ef72fef3f98c21637efcd7e84fd69d9a WatchSource:0}: Error finding container 5b8ebe09e538da12815597e7381e5037ef72fef3f98c21637efcd7e84fd69d9a: Status 404 returned error can't find the container with id 5b8ebe09e538da12815597e7381e5037ef72fef3f98c21637efcd7e84fd69d9a Jun 03 22:53:54.855397 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.855308 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" event={"ID":"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca","Type":"ContainerStarted","Data":"5b8ebe09e538da12815597e7381e5037ef72fef3f98c21637efcd7e84fd69d9a"} Jun 03 22:53:54.904976 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.904944 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:54.905086 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:54.904979 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-8dfkm\" (UID: \"359d6d2a-6d3a-4990-9c44-c7668126269c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:53:54.905125 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:54.905097 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 22:53:54.905125 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:54.905117 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7f48d79-gp8ds: secret "image-registry-tls" not found Jun 03 22:53:54.905186 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:54.905165 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls podName:888eb6f0-3c3c-4e89-820a-989da94a35e4 nodeName:}" failed. No retries permitted until 2026-06-03 22:53:55.905148723 +0000 UTC m=+216.102171568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls") pod "image-registry-59f7f48d79-gp8ds" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4") : secret "image-registry-tls" not found Jun 03 22:53:54.905186 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:54.905098 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 22:53:54.905287 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:54.905198 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls podName:359d6d2a-6d3a-4990-9c44-c7668126269c nodeName:}" failed. No retries permitted until 2026-06-03 22:53:55.905191776 +0000 UTC m=+216.102214623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-8dfkm" (UID: "359d6d2a-6d3a-4990-9c44-c7668126269c") : secret "samples-operator-tls" not found Jun 03 22:53:55.913080 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:55.913043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:55.913516 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:55.913084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-8dfkm\" (UID: \"359d6d2a-6d3a-4990-9c44-c7668126269c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:53:55.913516 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:55.913195 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 22:53:55.913516 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:55.913198 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 22:53:55.913516 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:55.913230 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7f48d79-gp8ds: secret "image-registry-tls" not found Jun 03 22:53:55.913516 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:55.913284 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls podName:888eb6f0-3c3c-4e89-820a-989da94a35e4 nodeName:}" failed. No retries permitted until 2026-06-03 22:53:57.913270954 +0000 UTC m=+218.110293800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls") pod "image-registry-59f7f48d79-gp8ds" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4") : secret "image-registry-tls" not found Jun 03 22:53:55.913516 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:55.913299 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls podName:359d6d2a-6d3a-4990-9c44-c7668126269c nodeName:}" failed. No retries permitted until 2026-06-03 22:53:57.91329184 +0000 UTC m=+218.110314685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-8dfkm" (UID: "359d6d2a-6d3a-4990-9c44-c7668126269c") : secret "samples-operator-tls" not found Jun 03 22:53:56.861623 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:56.861603 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/0.log" Jun 03 22:53:56.861722 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:56.861639 2561 generic.go:356] "Generic (PLEG): container finished" podID="6fb8e45c-40ce-4d1b-9214-87dd9fb502ca" containerID="264b90454c7296fc0110da76804ffeea3cd4a1b04254ef8c02718bbb4c6278c4" exitCode=255 Jun 03 22:53:56.861722 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:56.861700 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" event={"ID":"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca","Type":"ContainerDied","Data":"264b90454c7296fc0110da76804ffeea3cd4a1b04254ef8c02718bbb4c6278c4"} Jun 03 22:53:56.861879 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:56.861868 2561 scope.go:117] "RemoveContainer" containerID="264b90454c7296fc0110da76804ffeea3cd4a1b04254ef8c02718bbb4c6278c4" Jun 03 22:53:57.865989 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:57.865961 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/1.log" Jun 03 22:53:57.866426 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:57.866384 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/0.log" Jun 03 22:53:57.866467 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:57.866420 2561 generic.go:356] "Generic (PLEG): container finished" podID="6fb8e45c-40ce-4d1b-9214-87dd9fb502ca" containerID="4301db8e3ec8fd63735a404c196df1bfa877b6b537f6ccbd5781f4738c3fa1e2" exitCode=255 Jun 03 22:53:57.866506 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:57.866466 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" event={"ID":"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca","Type":"ContainerDied","Data":"4301db8e3ec8fd63735a404c196df1bfa877b6b537f6ccbd5781f4738c3fa1e2"} Jun 03 22:53:57.866538 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:57.866519 2561 scope.go:117] "RemoveContainer" containerID="264b90454c7296fc0110da76804ffeea3cd4a1b04254ef8c02718bbb4c6278c4" Jun 03 22:53:57.866689 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:57.866675 2561 scope.go:117] "RemoveContainer" containerID="4301db8e3ec8fd63735a404c196df1bfa877b6b537f6ccbd5781f4738c3fa1e2" Jun 03 22:53:57.866887 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:57.866852 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-vdcxm_openshift-console-operator(6fb8e45c-40ce-4d1b-9214-87dd9fb502ca)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" podUID="6fb8e45c-40ce-4d1b-9214-87dd9fb502ca" Jun 03 22:53:57.925708 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:57.925686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:53:57.925821 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:57.925712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-8dfkm\" (UID: \"359d6d2a-6d3a-4990-9c44-c7668126269c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:53:57.925881 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:57.925839 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 22:53:57.925881 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:57.925859 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7f48d79-gp8ds: secret "image-registry-tls" not found Jun 03 22:53:57.925967 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:57.925840 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 22:53:57.925967 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:57.925917 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls podName:888eb6f0-3c3c-4e89-820a-989da94a35e4 nodeName:}" failed. No retries permitted until 2026-06-03 22:54:01.925894594 +0000 UTC m=+222.122917461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls") pod "image-registry-59f7f48d79-gp8ds" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4") : secret "image-registry-tls" not found Jun 03 22:53:57.925967 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:57.925951 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls podName:359d6d2a-6d3a-4990-9c44-c7668126269c nodeName:}" failed. No retries permitted until 2026-06-03 22:54:01.925935102 +0000 UTC m=+222.122957951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-8dfkm" (UID: "359d6d2a-6d3a-4990-9c44-c7668126269c") : secret "samples-operator-tls" not found Jun 03 22:53:58.870533 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:58.870507 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/1.log" Jun 03 22:53:58.870939 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:58.870836 2561 scope.go:117] "RemoveContainer" containerID="4301db8e3ec8fd63735a404c196df1bfa877b6b537f6ccbd5781f4738c3fa1e2" Jun 03 22:53:58.870997 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:53:58.870976 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-vdcxm_openshift-console-operator(6fb8e45c-40ce-4d1b-9214-87dd9fb502ca)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" podUID="6fb8e45c-40ce-4d1b-9214-87dd9fb502ca" Jun 03 22:53:59.428077 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:59.428047 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-wsx4b"] Jun 03 22:53:59.430477 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:59.430462 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wsx4b" Jun 03 22:53:59.435240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:59.432442 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 22:53:59.435240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:59.432518 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kss95\"" Jun 03 22:53:59.435240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:59.433359 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 22:53:59.438600 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:59.438578 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-wsx4b"] Jun 03 22:53:59.537038 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:59.537010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d9jq\" (UniqueName: \"kubernetes.io/projected/055070ac-4422-430a-b4bf-9b770f5f9f2e-kube-api-access-9d9jq\") pod \"migrator-955ffdf5f-wsx4b\" (UID: \"055070ac-4422-430a-b4bf-9b770f5f9f2e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wsx4b" Jun 03 22:53:59.637565 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:59.637542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d9jq\" (UniqueName: \"kubernetes.io/projected/055070ac-4422-430a-b4bf-9b770f5f9f2e-kube-api-access-9d9jq\") pod \"migrator-955ffdf5f-wsx4b\" (UID: \"055070ac-4422-430a-b4bf-9b770f5f9f2e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wsx4b" Jun 03 22:53:59.645090 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:59.645068 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d9jq\" (UniqueName: \"kubernetes.io/projected/055070ac-4422-430a-b4bf-9b770f5f9f2e-kube-api-access-9d9jq\") pod \"migrator-955ffdf5f-wsx4b\" (UID: \"055070ac-4422-430a-b4bf-9b770f5f9f2e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wsx4b" Jun 03 22:53:59.743202 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:59.743182 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wsx4b" Jun 03 22:53:59.860609 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:59.860580 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-wsx4b"] Jun 03 22:53:59.863801 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:53:59.863773 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055070ac_4422_430a_b4bf_9b770f5f9f2e.slice/crio-aef08871e6a4d4807eaa0aacbc52162b5dbc1d32a09bf31422256a6f4194d539 WatchSource:0}: Error finding container aef08871e6a4d4807eaa0aacbc52162b5dbc1d32a09bf31422256a6f4194d539: Status 404 returned error can't find the container with id aef08871e6a4d4807eaa0aacbc52162b5dbc1d32a09bf31422256a6f4194d539 Jun 03 22:53:59.874320 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:53:59.874293 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wsx4b" event={"ID":"055070ac-4422-430a-b4bf-9b770f5f9f2e","Type":"ContainerStarted","Data":"aef08871e6a4d4807eaa0aacbc52162b5dbc1d32a09bf31422256a6f4194d539"} Jun 03 22:54:01.288524 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.288496 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gjk4g_f115edfc-b8cf-40d0-a424-e990f478cab3/dns-node-resolver/0.log" Jun 03 22:54:01.617331 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.617278 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-89tfj"] Jun 03 22:54:01.619049 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.619034 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" Jun 03 22:54:01.620656 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.620639 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 22:54:01.620757 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.620722 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 22:54:01.621141 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.621127 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kxhv2\"" Jun 03 22:54:01.621185 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.621138 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 22:54:01.621185 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.621159 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 22:54:01.626929 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.626910 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-89tfj"] Jun 03 22:54:01.651278 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.651255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/142f514a-fae5-45af-a557-fd416e7ae68d-signing-cabundle\") pod \"service-ca-7d74d578b8-89tfj\" (UID: \"142f514a-fae5-45af-a557-fd416e7ae68d\") " pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" Jun 03 22:54:01.651377 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.651294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/142f514a-fae5-45af-a557-fd416e7ae68d-signing-key\") pod \"service-ca-7d74d578b8-89tfj\" (UID: \"142f514a-fae5-45af-a557-fd416e7ae68d\") " pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" Jun 03 22:54:01.651377 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.651324 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvpqb\" (UniqueName: \"kubernetes.io/projected/142f514a-fae5-45af-a557-fd416e7ae68d-kube-api-access-qvpqb\") pod \"service-ca-7d74d578b8-89tfj\" (UID: \"142f514a-fae5-45af-a557-fd416e7ae68d\") " pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" Jun 03 22:54:01.752583 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.752559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/142f514a-fae5-45af-a557-fd416e7ae68d-signing-cabundle\") pod \"service-ca-7d74d578b8-89tfj\" (UID: \"142f514a-fae5-45af-a557-fd416e7ae68d\") " pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" Jun 03 22:54:01.752670 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.752598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/142f514a-fae5-45af-a557-fd416e7ae68d-signing-key\") pod \"service-ca-7d74d578b8-89tfj\" (UID: \"142f514a-fae5-45af-a557-fd416e7ae68d\") " pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" Jun 03 22:54:01.752670 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.752633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvpqb\" (UniqueName: \"kubernetes.io/projected/142f514a-fae5-45af-a557-fd416e7ae68d-kube-api-access-qvpqb\") pod \"service-ca-7d74d578b8-89tfj\" (UID: \"142f514a-fae5-45af-a557-fd416e7ae68d\") " pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" Jun 03 22:54:01.753180 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.753159 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/142f514a-fae5-45af-a557-fd416e7ae68d-signing-cabundle\") pod \"service-ca-7d74d578b8-89tfj\" (UID: \"142f514a-fae5-45af-a557-fd416e7ae68d\") " pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" Jun 03 22:54:01.755046 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.755028 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/142f514a-fae5-45af-a557-fd416e7ae68d-signing-key\") pod \"service-ca-7d74d578b8-89tfj\" (UID: \"142f514a-fae5-45af-a557-fd416e7ae68d\") " pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" Jun 03 22:54:01.760534 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.760511 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvpqb\" (UniqueName: \"kubernetes.io/projected/142f514a-fae5-45af-a557-fd416e7ae68d-kube-api-access-qvpqb\") pod \"service-ca-7d74d578b8-89tfj\" (UID: \"142f514a-fae5-45af-a557-fd416e7ae68d\") " pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" Jun 03 22:54:01.883026 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.882957 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wsx4b" event={"ID":"055070ac-4422-430a-b4bf-9b770f5f9f2e","Type":"ContainerStarted","Data":"66674a2d0cf471d36eaf70562c2669bbd9b309c9b3b746a6bf32f43a24d4443d"} Jun 03 22:54:01.883026 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.883001 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wsx4b" event={"ID":"055070ac-4422-430a-b4bf-9b770f5f9f2e","Type":"ContainerStarted","Data":"0b5ba95f12793d7ec07b04257d12d11bb2e639399190482f2ae8d3fd9b5caafa"} Jun 03 22:54:01.898559 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.898517 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wsx4b" podStartSLOduration=1.6146314670000002 podStartE2EDuration="2.898503597s" totalImagesPullingTime="1.28387213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:01.897629304 +0000 UTC m=+222.094652169" watchObservedRunningTime="2026-06-03 22:54:01.898503597 +0000 UTC m=+222.095526471" Jun 03 22:54:01.929199 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.929181 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" Jun 03 22:54:01.954465 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.954441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:54:01.954583 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:01.954480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-8dfkm\" (UID: \"359d6d2a-6d3a-4990-9c44-c7668126269c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:54:01.954583 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:54:01.954562 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 22:54:01.954583 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:54:01.954578 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7f48d79-gp8ds: secret "image-registry-tls" not found Jun 03 22:54:01.954717 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:54:01.954593 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 22:54:01.954717 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:54:01.954627 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls podName:888eb6f0-3c3c-4e89-820a-989da94a35e4 nodeName:}" failed. No retries permitted until 2026-06-03 22:54:09.954612091 +0000 UTC m=+230.151634940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls") pod "image-registry-59f7f48d79-gp8ds" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4") : secret "image-registry-tls" not found Jun 03 22:54:01.954717 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:54:01.954655 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls podName:359d6d2a-6d3a-4990-9c44-c7668126269c nodeName:}" failed. No retries permitted until 2026-06-03 22:54:09.954637149 +0000 UTC m=+230.151660008 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-8dfkm" (UID: "359d6d2a-6d3a-4990-9c44-c7668126269c") : secret "samples-operator-tls" not found Jun 03 22:54:02.048463 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:02.048425 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-89tfj"] Jun 03 22:54:02.051781 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:54:02.051760 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod142f514a_fae5_45af_a557_fd416e7ae68d.slice/crio-a57c2db2fed319d84094e5f602ed27bd438a76cdf484379b4d2ad4710ab66d38 WatchSource:0}: Error finding container a57c2db2fed319d84094e5f602ed27bd438a76cdf484379b4d2ad4710ab66d38: Status 404 returned error can't find the container with id a57c2db2fed319d84094e5f602ed27bd438a76cdf484379b4d2ad4710ab66d38 Jun 03 22:54:02.287360 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:02.287340 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xkqbx_75cdff9b-2d30-4a8e-bb7b-685011837e4b/node-ca/0.log" Jun 03 22:54:02.688840 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:02.688764 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6gdqg_d38c13ae-5d62-404a-98f7-67fa2bd677f5/serve-healthcheck-canary/0.log" Jun 03 22:54:02.887519 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:02.887478 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" event={"ID":"142f514a-fae5-45af-a557-fd416e7ae68d","Type":"ContainerStarted","Data":"a57c2db2fed319d84094e5f602ed27bd438a76cdf484379b4d2ad4710ab66d38"} Jun 03 22:54:03.891565 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:03.891532 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" event={"ID":"142f514a-fae5-45af-a557-fd416e7ae68d","Type":"ContainerStarted","Data":"6d4abbfd3136f65618be9c723dc259af77177fbf5c2e3f7edbe9a2a714eb5837"} Jun 03 22:54:03.906488 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:03.906410 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-89tfj" podStartSLOduration=1.307893742 podStartE2EDuration="2.906396407s" totalImagesPullingTime="1.598502665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:03.905611968 +0000 UTC m=+224.102634866" watchObservedRunningTime="2026-06-03 22:54:03.906396407 +0000 UTC m=+224.103419274" Jun 03 22:54:04.590919 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:04.590836 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:54:04.590919 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:04.590886 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:54:04.591176 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:04.591164 2561 scope.go:117] "RemoveContainer" containerID="4301db8e3ec8fd63735a404c196df1bfa877b6b537f6ccbd5781f4738c3fa1e2" Jun 03 22:54:04.591325 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:54:04.591305 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-vdcxm_openshift-console-operator(6fb8e45c-40ce-4d1b-9214-87dd9fb502ca)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" podUID="6fb8e45c-40ce-4d1b-9214-87dd9fb502ca" Jun 03 22:54:10.011667 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.011633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:54:10.011667 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.011669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-8dfkm\" (UID: \"359d6d2a-6d3a-4990-9c44-c7668126269c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:54:10.014219 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.014191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/359d6d2a-6d3a-4990-9c44-c7668126269c-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-8dfkm\" (UID: \"359d6d2a-6d3a-4990-9c44-c7668126269c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:54:10.014283 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.014265 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls\") pod \"image-registry-59f7f48d79-gp8ds\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:54:10.183513 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.183484 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" Jun 03 22:54:10.195433 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.195410 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:54:10.320128 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.320096 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm"] Jun 03 22:54:10.337504 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.337467 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f7f48d79-gp8ds"] Jun 03 22:54:10.340740 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:54:10.340710 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888eb6f0_3c3c_4e89_820a_989da94a35e4.slice/crio-0605e1a0961c935943abdfc3252d3ef0132c980e7fe9202337a5a8837bbc748b WatchSource:0}: Error finding container 0605e1a0961c935943abdfc3252d3ef0132c980e7fe9202337a5a8837bbc748b: Status 404 returned error can't find the container with id 0605e1a0961c935943abdfc3252d3ef0132c980e7fe9202337a5a8837bbc748b Jun 03 22:54:10.912588 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.912551 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" event={"ID":"888eb6f0-3c3c-4e89-820a-989da94a35e4","Type":"ContainerStarted","Data":"3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f"} Jun 03 22:54:10.912755 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.912596 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" event={"ID":"888eb6f0-3c3c-4e89-820a-989da94a35e4","Type":"ContainerStarted","Data":"0605e1a0961c935943abdfc3252d3ef0132c980e7fe9202337a5a8837bbc748b"} Jun 03 22:54:10.912755 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.912674 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:54:10.913769 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.913748 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" event={"ID":"359d6d2a-6d3a-4990-9c44-c7668126269c","Type":"ContainerStarted","Data":"b64ef94e49db1fc45c6fc13ba2107cb8dea0bce9c71ee558d679f0e241c1ae56"} Jun 03 22:54:10.930249 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:10.930191 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" podStartSLOduration=16.930178396 podStartE2EDuration="16.930178396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:10.928549626 +0000 UTC m=+231.125572495" watchObservedRunningTime="2026-06-03 22:54:10.930178396 +0000 UTC m=+231.127201264" Jun 03 22:54:12.922888 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:12.922853 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" event={"ID":"359d6d2a-6d3a-4990-9c44-c7668126269c","Type":"ContainerStarted","Data":"bff9b3f4ffb2752256b8fc219224ce2c5a26e85797a43844fe7c4ad60b97cf44"} Jun 03 22:54:12.923330 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:12.922911 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" event={"ID":"359d6d2a-6d3a-4990-9c44-c7668126269c","Type":"ContainerStarted","Data":"eca9aa549ab65187484d663ea6c7c57ad0e88be5c2cb9d6277a2823782eff79e"} Jun 03 22:54:12.938244 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:12.938179 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-8dfkm" podStartSLOduration=17.359471008 podStartE2EDuration="18.938166085s" totalImagesPullingTime="1.578695077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:12.936447187 +0000 UTC m=+233.133470055" watchObservedRunningTime="2026-06-03 22:54:12.938166085 +0000 UTC m=+233.135188952" Jun 03 22:54:15.241008 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:15.240976 2561 scope.go:117] "RemoveContainer" containerID="4301db8e3ec8fd63735a404c196df1bfa877b6b537f6ccbd5781f4738c3fa1e2" Jun 03 22:54:15.933682 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:15.933655 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 22:54:15.934047 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:15.934032 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/1.log" Jun 03 22:54:15.934111 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:15.934066 2561 generic.go:356] "Generic (PLEG): container finished" podID="6fb8e45c-40ce-4d1b-9214-87dd9fb502ca" containerID="109bd4822c16d7ed815e9efd34be1aa5500a69263bd4ef7af5236b48eb88ab94" exitCode=255 Jun 03 22:54:15.934111 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:15.934099 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" event={"ID":"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca","Type":"ContainerDied","Data":"109bd4822c16d7ed815e9efd34be1aa5500a69263bd4ef7af5236b48eb88ab94"} Jun 03 22:54:15.934191 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:15.934174 2561 scope.go:117] "RemoveContainer" containerID="4301db8e3ec8fd63735a404c196df1bfa877b6b537f6ccbd5781f4738c3fa1e2" Jun 03 22:54:15.934516 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:15.934495 2561 scope.go:117] "RemoveContainer" containerID="109bd4822c16d7ed815e9efd34be1aa5500a69263bd4ef7af5236b48eb88ab94" Jun 03 22:54:15.934692 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:54:15.934672 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85bd8fd97d-vdcxm_openshift-console-operator(6fb8e45c-40ce-4d1b-9214-87dd9fb502ca)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" podUID="6fb8e45c-40ce-4d1b-9214-87dd9fb502ca" Jun 03 22:54:16.938299 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:16.938273 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 22:54:24.374154 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.374110 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f7f48d79-gp8ds"] Jun 03 22:54:24.409704 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.409676 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c5b8w"] Jun 03 22:54:24.412857 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.412837 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.414578 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.414555 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 22:54:24.414664 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.414586 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 22:54:24.414721 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.414586 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 22:54:24.414721 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.414691 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 22:54:24.414835 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.414790 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gvchp\"" Jun 03 22:54:24.426329 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.426310 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c5b8w"] Jun 03 22:54:24.513720 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.513698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed5cf7ee-4768-4132-a2ee-27887e95ad26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.513863 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.513745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed5cf7ee-4768-4132-a2ee-27887e95ad26-data-volume\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.513863 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.513776 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2x8h\" (UniqueName: \"kubernetes.io/projected/ed5cf7ee-4768-4132-a2ee-27887e95ad26-kube-api-access-s2x8h\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.513863 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.513843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed5cf7ee-4768-4132-a2ee-27887e95ad26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.513999 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.513903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed5cf7ee-4768-4132-a2ee-27887e95ad26-crio-socket\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.590347 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.590325 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:54:24.590454 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.590362 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:54:24.590629 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.590615 2561 scope.go:117] "RemoveContainer" containerID="109bd4822c16d7ed815e9efd34be1aa5500a69263bd4ef7af5236b48eb88ab94" Jun 03 22:54:24.590759 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:54:24.590743 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85bd8fd97d-vdcxm_openshift-console-operator(6fb8e45c-40ce-4d1b-9214-87dd9fb502ca)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" podUID="6fb8e45c-40ce-4d1b-9214-87dd9fb502ca" Jun 03 22:54:24.615018 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.614992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed5cf7ee-4768-4132-a2ee-27887e95ad26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.615120 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.615028 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed5cf7ee-4768-4132-a2ee-27887e95ad26-crio-socket\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.615120 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.615048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed5cf7ee-4768-4132-a2ee-27887e95ad26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.615120 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.615083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed5cf7ee-4768-4132-a2ee-27887e95ad26-data-volume\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.615120 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.615107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2x8h\" (UniqueName: \"kubernetes.io/projected/ed5cf7ee-4768-4132-a2ee-27887e95ad26-kube-api-access-s2x8h\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.615340 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.615125 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed5cf7ee-4768-4132-a2ee-27887e95ad26-crio-socket\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.615406 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.615383 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed5cf7ee-4768-4132-a2ee-27887e95ad26-data-volume\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.615566 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.615546 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed5cf7ee-4768-4132-a2ee-27887e95ad26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.617493 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.617473 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed5cf7ee-4768-4132-a2ee-27887e95ad26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.624093 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.624075 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2x8h\" (UniqueName: \"kubernetes.io/projected/ed5cf7ee-4768-4132-a2ee-27887e95ad26-kube-api-access-s2x8h\") pod \"insights-runtime-extractor-c5b8w\" (UID: \"ed5cf7ee-4768-4132-a2ee-27887e95ad26\") " pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.722311 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.722203 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c5b8w" Jun 03 22:54:24.844941 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.844910 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c5b8w"] Jun 03 22:54:24.849110 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:54:24.849083 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5cf7ee_4768_4132_a2ee_27887e95ad26.slice/crio-f4013786a46c59dc220e46e960542d55e7cedf383c0f3814f82ac1f6d6ea6fb3 WatchSource:0}: Error finding container f4013786a46c59dc220e46e960542d55e7cedf383c0f3814f82ac1f6d6ea6fb3: Status 404 returned error can't find the container with id f4013786a46c59dc220e46e960542d55e7cedf383c0f3814f82ac1f6d6ea6fb3 Jun 03 22:54:24.962120 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.962087 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5b8w" event={"ID":"ed5cf7ee-4768-4132-a2ee-27887e95ad26","Type":"ContainerStarted","Data":"c3cc4db9839508da8e971c75bf73e15c3679592e8fbed1c1f041b86501b11336"} Jun 03 22:54:24.962260 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:24.962141 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5b8w" event={"ID":"ed5cf7ee-4768-4132-a2ee-27887e95ad26","Type":"ContainerStarted","Data":"f4013786a46c59dc220e46e960542d55e7cedf383c0f3814f82ac1f6d6ea6fb3"} Jun 03 22:54:25.966825 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:25.966746 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5b8w" event={"ID":"ed5cf7ee-4768-4132-a2ee-27887e95ad26","Type":"ContainerStarted","Data":"4fe6f2a160b55874cd2100997d21f43ca9f1a2e02697e216b21e6815b312035f"} Jun 03 22:54:27.976100 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:27.976063 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5b8w" event={"ID":"ed5cf7ee-4768-4132-a2ee-27887e95ad26","Type":"ContainerStarted","Data":"4d8302ccb71c793dcb1fde0b96b6103dda1509ece2ffa4c07987067314fa6869"} Jun 03 22:54:27.991685 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:27.991641 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c5b8w" podStartSLOduration=1.666264468 podStartE2EDuration="3.99162879s" totalImagesPullingTime="2.325364322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:54:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:27.990453466 +0000 UTC m=+248.187476335" watchObservedRunningTime="2026-06-03 22:54:27.99162879 +0000 UTC m=+248.188651658" Jun 03 22:54:32.162119 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:32.162086 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:54:32.164479 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:32.164456 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac962794-8899-4702-8a68-43561036621a-metrics-certs\") pod \"network-metrics-daemon-gfcm7\" (UID: \"ac962794-8899-4702-8a68-43561036621a\") " pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:54:32.242380 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:32.242359 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zbfkl\"" Jun 03 22:54:32.250697 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:32.250680 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcm7" Jun 03 22:54:32.373315 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:32.370138 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gfcm7"] Jun 03 22:54:32.375816 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:54:32.375791 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac962794_8899_4702_8a68_43561036621a.slice/crio-33cae9b0e1e9d2a424199c5e7d33cfab68cb28d76e2d59327f3129640322b77c WatchSource:0}: Error finding container 33cae9b0e1e9d2a424199c5e7d33cfab68cb28d76e2d59327f3129640322b77c: Status 404 returned error can't find the container with id 33cae9b0e1e9d2a424199c5e7d33cfab68cb28d76e2d59327f3129640322b77c Jun 03 22:54:32.993104 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:32.993055 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gfcm7" event={"ID":"ac962794-8899-4702-8a68-43561036621a","Type":"ContainerStarted","Data":"33cae9b0e1e9d2a424199c5e7d33cfab68cb28d76e2d59327f3129640322b77c"} Jun 03 22:54:33.997798 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:33.997754 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gfcm7" event={"ID":"ac962794-8899-4702-8a68-43561036621a","Type":"ContainerStarted","Data":"aa5d617a787f6acd705f1c3c17f40ce916d8dcdea77c4324b025c997dfac8420"} Jun 03 22:54:33.998142 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:33.997819 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gfcm7" event={"ID":"ac962794-8899-4702-8a68-43561036621a","Type":"ContainerStarted","Data":"534a837594854785263ba3559e8e4aa700f9b05774017b9bd8e6628d11526830"} Jun 03 22:54:34.014307 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:34.013964 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gfcm7" podStartSLOduration=253.2048453 podStartE2EDuration="4m14.013945066s" totalImagesPullingTime="809.099766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:34.012695445 +0000 UTC m=+254.209718312" watchObservedRunningTime="2026-06-03 22:54:34.013945066 +0000 UTC m=+254.210967936" Jun 03 22:54:34.379384 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:34.379303 2561 patch_prober.go:28] interesting pod/image-registry-59f7f48d79-gp8ds container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 22:54:34.379384 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:34.379351 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" podUID="888eb6f0-3c3c-4e89-820a-989da94a35e4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 22:54:37.681047 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.680963 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm"] Jun 03 22:54:37.684541 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.684517 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.686140 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.686112 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v"] Jun 03 22:54:37.687002 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.686980 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wb7hz\"" Jun 03 22:54:37.687252 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.687235 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 22:54:37.687389 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.687370 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 22:54:37.687541 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.687257 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 22:54:37.687687 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.687296 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 22:54:37.687785 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.687250 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 22:54:37.689637 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.689618 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.691388 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.691245 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 22:54:37.691388 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.691264 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 22:54:37.691388 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.691314 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 22:54:37.691612 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.691589 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5w4n6\"" Jun 03 22:54:37.704022 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.703580 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm"] Jun 03 22:54:37.704179 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.704164 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v"] Jun 03 22:54:37.705475 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.705451 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x5n9c"] Jun 03 22:54:37.708841 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.708820 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.711537 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.711520 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 22:54:37.711672 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.711644 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mxm56\"" Jun 03 22:54:37.712062 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.712045 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 22:54:37.712541 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.712525 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 22:54:37.801175 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801141 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-textfile\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.801382 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801181 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.801382 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801204 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktzng\" (UniqueName: \"kubernetes.io/projected/dc1f805e-00cb-4ccd-9560-6005c8544711-kube-api-access-ktzng\") pod \"openshift-state-metrics-65f78d5c66-75dcm\" (UID: \"dc1f805e-00cb-4ccd-9560-6005c8544711\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.801382 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801282 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9423145a-05c7-40cd-9526-7af8602dc06d-metrics-client-ca\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.801382 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-wtmp\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.801382 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4vsq\" (UniqueName: \"kubernetes.io/projected/9423145a-05c7-40cd-9526-7af8602dc06d-kube-api-access-x4vsq\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.801382 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801362 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f805e-00cb-4ccd-9560-6005c8544711-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-75dcm\" (UID: \"dc1f805e-00cb-4ccd-9560-6005c8544711\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.801687 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801385 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d697354a-1141-4b4e-9200-982ee4526c3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.801687 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d697354a-1141-4b4e-9200-982ee4526c3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.801687 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d697354a-1141-4b4e-9200-982ee4526c3c-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.801687 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.801687 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d697354a-1141-4b4e-9200-982ee4526c3c-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.801687 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9423145a-05c7-40cd-9526-7af8602dc06d-sys\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.801687 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc1f805e-00cb-4ccd-9560-6005c8544711-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-75dcm\" (UID: \"dc1f805e-00cb-4ccd-9560-6005c8544711\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.801687 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801635 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc1f805e-00cb-4ccd-9560-6005c8544711-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-75dcm\" (UID: \"dc1f805e-00cb-4ccd-9560-6005c8544711\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.801687 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801662 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frk64\" (UniqueName: \"kubernetes.io/projected/d697354a-1141-4b4e-9200-982ee4526c3c-kube-api-access-frk64\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.802008 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801767 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9423145a-05c7-40cd-9526-7af8602dc06d-root\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.802008 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d697354a-1141-4b4e-9200-982ee4526c3c-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.802008 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.801830 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-tls\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.902660 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.902633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9423145a-05c7-40cd-9526-7af8602dc06d-metrics-client-ca\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.902849 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.902671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-wtmp\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.902849 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.902694 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4vsq\" (UniqueName: \"kubernetes.io/projected/9423145a-05c7-40cd-9526-7af8602dc06d-kube-api-access-x4vsq\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.902849 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.902719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f805e-00cb-4ccd-9560-6005c8544711-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-75dcm\" (UID: \"dc1f805e-00cb-4ccd-9560-6005c8544711\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.902849 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.902835 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-wtmp\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.903075 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.902899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d697354a-1141-4b4e-9200-982ee4526c3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.903075 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.902946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d697354a-1141-4b4e-9200-982ee4526c3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.903075 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.902995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d697354a-1141-4b4e-9200-982ee4526c3c-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.903075 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.903075 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d697354a-1141-4b4e-9200-982ee4526c3c-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.903341 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9423145a-05c7-40cd-9526-7af8602dc06d-sys\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.903341 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903113 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc1f805e-00cb-4ccd-9560-6005c8544711-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-75dcm\" (UID: \"dc1f805e-00cb-4ccd-9560-6005c8544711\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.903341 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc1f805e-00cb-4ccd-9560-6005c8544711-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-75dcm\" (UID: \"dc1f805e-00cb-4ccd-9560-6005c8544711\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.903341 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903173 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frk64\" (UniqueName: \"kubernetes.io/projected/d697354a-1141-4b4e-9200-982ee4526c3c-kube-api-access-frk64\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.903341 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903230 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9423145a-05c7-40cd-9526-7af8602dc06d-root\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.903341 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d697354a-1141-4b4e-9200-982ee4526c3c-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.903341 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903281 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-tls\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.903341 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903325 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-textfile\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.903900 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903345 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9423145a-05c7-40cd-9526-7af8602dc06d-metrics-client-ca\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.903900 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.903900 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktzng\" (UniqueName: \"kubernetes.io/projected/dc1f805e-00cb-4ccd-9560-6005c8544711-kube-api-access-ktzng\") pod \"openshift-state-metrics-65f78d5c66-75dcm\" (UID: \"dc1f805e-00cb-4ccd-9560-6005c8544711\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.903900 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903651 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9423145a-05c7-40cd-9526-7af8602dc06d-sys\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.903900 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903786 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d697354a-1141-4b4e-9200-982ee4526c3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.903900 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903886 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9423145a-05c7-40cd-9526-7af8602dc06d-root\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.904194 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.903999 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d697354a-1141-4b4e-9200-982ee4526c3c-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.904194 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.904128 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.904323 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.904206 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-textfile\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.904323 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.904292 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d697354a-1141-4b4e-9200-982ee4526c3c-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.904711 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.904683 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc1f805e-00cb-4ccd-9560-6005c8544711-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-75dcm\" (UID: \"dc1f805e-00cb-4ccd-9560-6005c8544711\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.906146 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.906114 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc1f805e-00cb-4ccd-9560-6005c8544711-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-75dcm\" (UID: \"dc1f805e-00cb-4ccd-9560-6005c8544711\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.906396 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.906375 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d697354a-1141-4b4e-9200-982ee4526c3c-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.906729 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.906704 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.906849 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.906829 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc1f805e-00cb-4ccd-9560-6005c8544711-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-75dcm\" (UID: \"dc1f805e-00cb-4ccd-9560-6005c8544711\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.906950 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.906935 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9423145a-05c7-40cd-9526-7af8602dc06d-node-exporter-tls\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.906985 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.906947 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d697354a-1141-4b4e-9200-982ee4526c3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.911045 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.910978 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frk64\" (UniqueName: \"kubernetes.io/projected/d697354a-1141-4b4e-9200-982ee4526c3c-kube-api-access-frk64\") pod \"kube-state-metrics-79fb7d47d4-jlx8v\" (UID: \"d697354a-1141-4b4e-9200-982ee4526c3c\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:37.911392 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.911371 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4vsq\" (UniqueName: \"kubernetes.io/projected/9423145a-05c7-40cd-9526-7af8602dc06d-kube-api-access-x4vsq\") pod \"node-exporter-x5n9c\" (UID: \"9423145a-05c7-40cd-9526-7af8602dc06d\") " pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:37.911614 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.911585 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktzng\" (UniqueName: \"kubernetes.io/projected/dc1f805e-00cb-4ccd-9560-6005c8544711-kube-api-access-ktzng\") pod \"openshift-state-metrics-65f78d5c66-75dcm\" (UID: \"dc1f805e-00cb-4ccd-9560-6005c8544711\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:37.998636 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:37.998604 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" Jun 03 22:54:38.007567 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:38.007546 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" Jun 03 22:54:38.021501 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:38.021479 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5n9c" Jun 03 22:54:38.032920 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:54:38.032888 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9423145a_05c7_40cd_9526_7af8602dc06d.slice/crio-3ccf9bc318afe9bda6376df905e2e9fae8c6a1ac8ad351b6cb31e292c8779992 WatchSource:0}: Error finding container 3ccf9bc318afe9bda6376df905e2e9fae8c6a1ac8ad351b6cb31e292c8779992: Status 404 returned error can't find the container with id 3ccf9bc318afe9bda6376df905e2e9fae8c6a1ac8ad351b6cb31e292c8779992 Jun 03 22:54:38.144123 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:38.144069 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm"] Jun 03 22:54:38.147748 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:54:38.147724 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1f805e_00cb_4ccd_9560_6005c8544711.slice/crio-7cac71bbc6b44768cfdbcc1f5c63cc97ac92b6ad8fc7346805710c547828af3d WatchSource:0}: Error finding container 7cac71bbc6b44768cfdbcc1f5c63cc97ac92b6ad8fc7346805710c547828af3d: Status 404 returned error can't find the container with id 7cac71bbc6b44768cfdbcc1f5c63cc97ac92b6ad8fc7346805710c547828af3d Jun 03 22:54:38.160832 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:38.160792 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v"] Jun 03 22:54:38.163098 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:54:38.163070 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd697354a_1141_4b4e_9200_982ee4526c3c.slice/crio-8d19c148fc988a7200ece977dfc09b95a49fc7a5cc461e89cad4087448792ee0 WatchSource:0}: Error finding container 8d19c148fc988a7200ece977dfc09b95a49fc7a5cc461e89cad4087448792ee0: Status 404 returned error can't find the container with id 8d19c148fc988a7200ece977dfc09b95a49fc7a5cc461e89cad4087448792ee0 Jun 03 22:54:38.241366 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:38.241084 2561 scope.go:117] "RemoveContainer" containerID="109bd4822c16d7ed815e9efd34be1aa5500a69263bd4ef7af5236b48eb88ab94" Jun 03 22:54:39.011938 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.011471 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-56b467f5ff-x2jnw"] Jun 03 22:54:39.014890 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.014865 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-x2jnw" Jun 03 22:54:39.016679 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.016656 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-khpmt\"" Jun 03 22:54:39.016955 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.016915 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 22:54:39.017022 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.016971 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 22:54:39.017278 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.017255 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 22:54:39.017396 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.017376 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" event={"ID":"6fb8e45c-40ce-4d1b-9214-87dd9fb502ca","Type":"ContainerStarted","Data":"3767da74489b050b54d8a7247998206a1797428ac4ee7a691a72223d3793703b"} Jun 03 22:54:39.017868 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.017834 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:54:39.020532 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.020511 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5n9c" event={"ID":"9423145a-05c7-40cd-9526-7af8602dc06d","Type":"ContainerStarted","Data":"3ccf9bc318afe9bda6376df905e2e9fae8c6a1ac8ad351b6cb31e292c8779992"} Jun 03 22:54:39.022043 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.021935 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" event={"ID":"d697354a-1141-4b4e-9200-982ee4526c3c","Type":"ContainerStarted","Data":"8d19c148fc988a7200ece977dfc09b95a49fc7a5cc461e89cad4087448792ee0"} Jun 03 22:54:39.025398 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.024518 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" Jun 03 22:54:39.025398 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.024595 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-x2jnw"] Jun 03 22:54:39.026865 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.026842 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" event={"ID":"dc1f805e-00cb-4ccd-9560-6005c8544711","Type":"ContainerStarted","Data":"90da9e302989849f0cba5b8e14c400c1523787876bf2cc291e7ab3130a5ee58e"} Jun 03 22:54:39.026964 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.026893 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" event={"ID":"dc1f805e-00cb-4ccd-9560-6005c8544711","Type":"ContainerStarted","Data":"b5876cf1c41c7c91002366cd412ddd07fc8b8734a6a527e7ccd41929011f6646"} Jun 03 22:54:39.026964 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.026923 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" event={"ID":"dc1f805e-00cb-4ccd-9560-6005c8544711","Type":"ContainerStarted","Data":"7cac71bbc6b44768cfdbcc1f5c63cc97ac92b6ad8fc7346805710c547828af3d"} Jun 03 22:54:39.055536 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.055488 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85bd8fd97d-vdcxm" podStartSLOduration=43.02231166 podStartE2EDuration="45.055470829s" totalImagesPullingTime="2.033159169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:39.054627488 +0000 UTC m=+259.251650358" watchObservedRunningTime="2026-06-03 22:54:39.055470829 +0000 UTC m=+259.252493696" Jun 03 22:54:39.113097 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.112661 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvc6g\" (UniqueName: \"kubernetes.io/projected/ead0ab21-f636-48eb-a500-6e29e20cb53b-kube-api-access-pvc6g\") pod \"downloads-56b467f5ff-x2jnw\" (UID: \"ead0ab21-f636-48eb-a500-6e29e20cb53b\") " pod="openshift-console/downloads-56b467f5ff-x2jnw" Jun 03 22:54:39.213388 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.213355 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvc6g\" (UniqueName: \"kubernetes.io/projected/ead0ab21-f636-48eb-a500-6e29e20cb53b-kube-api-access-pvc6g\") pod \"downloads-56b467f5ff-x2jnw\" (UID: \"ead0ab21-f636-48eb-a500-6e29e20cb53b\") " pod="openshift-console/downloads-56b467f5ff-x2jnw" Jun 03 22:54:39.221639 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.221568 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvc6g\" (UniqueName: \"kubernetes.io/projected/ead0ab21-f636-48eb-a500-6e29e20cb53b-kube-api-access-pvc6g\") pod \"downloads-56b467f5ff-x2jnw\" (UID: \"ead0ab21-f636-48eb-a500-6e29e20cb53b\") " pod="openshift-console/downloads-56b467f5ff-x2jnw" Jun 03 22:54:39.328695 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.328614 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-x2jnw" Jun 03 22:54:39.922772 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:39.922712 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-x2jnw"] Jun 03 22:54:40.034625 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.034533 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-x2jnw" event={"ID":"ead0ab21-f636-48eb-a500-6e29e20cb53b","Type":"ContainerStarted","Data":"565efd29878d01a7efd1b43a76b4003c92f3d01b90674c251fe80e51eeeb818d"} Jun 03 22:54:40.036183 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.036156 2561 generic.go:356] "Generic (PLEG): container finished" podID="9423145a-05c7-40cd-9526-7af8602dc06d" containerID="eb1d0e4148568622cfe5de0a29e95e7859392a7c61a57958fa40f9700df22fa0" exitCode=0 Jun 03 22:54:40.036323 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.036243 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5n9c" event={"ID":"9423145a-05c7-40cd-9526-7af8602dc06d","Type":"ContainerDied","Data":"eb1d0e4148568622cfe5de0a29e95e7859392a7c61a57958fa40f9700df22fa0"} Jun 03 22:54:40.038414 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.038392 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" event={"ID":"d697354a-1141-4b4e-9200-982ee4526c3c","Type":"ContainerStarted","Data":"a1dd492eb59a9e9c2063d8fc78b4c407cd93cb5879b3b8110a7316dcea04cbf7"} Jun 03 22:54:40.038527 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.038444 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" event={"ID":"d697354a-1141-4b4e-9200-982ee4526c3c","Type":"ContainerStarted","Data":"a2f9dea943b2d841f522487751366142941d5d9c264fd4564bafdcda7a7059eb"} Jun 03 22:54:40.038527 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.038475 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" event={"ID":"d697354a-1141-4b4e-9200-982ee4526c3c","Type":"ContainerStarted","Data":"b5e5ca50c0e530c819588c5229fa85edd48980baf25f8672dde2cd39ae920850"} Jun 03 22:54:40.040532 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.040515 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" event={"ID":"dc1f805e-00cb-4ccd-9560-6005c8544711","Type":"ContainerStarted","Data":"2c064d74db80858f002d8cee57201f4cdea7fb6a3f534715501054694f471d98"} Jun 03 22:54:40.072511 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.072461 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-jlx8v" podStartSLOduration=1.464739636 podStartE2EDuration="3.072443651s" totalImagesPullingTime="1.607704015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:40.07213238 +0000 UTC m=+260.269155261" watchObservedRunningTime="2026-06-03 22:54:40.072443651 +0000 UTC m=+260.269466520" Jun 03 22:54:40.091994 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.091940 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-75dcm" podStartSLOduration=1.588024196 podStartE2EDuration="3.091924197s" totalImagesPullingTime="1.503900001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:40.090570864 +0000 UTC m=+260.287593731" watchObservedRunningTime="2026-06-03 22:54:40.091924197 +0000 UTC m=+260.288947068" Jun 03 22:54:40.779327 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.779291 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-88b68f7c8-ttxgq"] Jun 03 22:54:40.783541 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.783523 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:40.788006 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.787472 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cf8s2uj6gvbrb\"" Jun 03 22:54:40.788006 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.787481 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 22:54:40.788006 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.787610 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 22:54:40.788006 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.787716 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 22:54:40.788006 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.787830 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 22:54:40.788006 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.787878 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-whbrm\"" Jun 03 22:54:40.788465 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.788445 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 22:54:40.798070 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.798047 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-88b68f7c8-ttxgq"] Jun 03 22:54:40.929560 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.929527 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:40.929560 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.929571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-grpc-tls\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:40.929791 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.929599 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:40.929791 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.929637 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:40.929791 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.929699 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:40.929791 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.929723 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ab23b79-f5f3-4ca3-83be-6f614b518013-metrics-client-ca\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:40.929791 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.929746 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ngvm\" (UniqueName: \"kubernetes.io/projected/0ab23b79-f5f3-4ca3-83be-6f614b518013-kube-api-access-4ngvm\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:40.929791 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:40.929784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-tls\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.030231 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.030138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-tls\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.030231 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.030186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.030419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.030233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-grpc-tls\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.030419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.030259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.030419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.030295 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.030419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.030354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.030419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.030377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ab23b79-f5f3-4ca3-83be-6f614b518013-metrics-client-ca\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.030419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.030400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ngvm\" (UniqueName: \"kubernetes.io/projected/0ab23b79-f5f3-4ca3-83be-6f614b518013-kube-api-access-4ngvm\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.032196 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.032166 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ab23b79-f5f3-4ca3-83be-6f614b518013-metrics-client-ca\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.034837 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.034793 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.035191 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.035040 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-tls\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.035522 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.035500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.035991 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.035959 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-grpc-tls\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.037935 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.037900 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.038523 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.038480 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ab23b79-f5f3-4ca3-83be-6f614b518013-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.039576 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.039554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ngvm\" (UniqueName: \"kubernetes.io/projected/0ab23b79-f5f3-4ca3-83be-6f614b518013-kube-api-access-4ngvm\") pod \"thanos-querier-88b68f7c8-ttxgq\" (UID: \"0ab23b79-f5f3-4ca3-83be-6f614b518013\") " pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.048286 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.048155 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5n9c" event={"ID":"9423145a-05c7-40cd-9526-7af8602dc06d","Type":"ContainerStarted","Data":"9ecabe042a7c66ce7ba0caa724935a558639b6bba8123b717f662c4d830d8493"} Jun 03 22:54:41.048286 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.048199 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5n9c" event={"ID":"9423145a-05c7-40cd-9526-7af8602dc06d","Type":"ContainerStarted","Data":"7e4732b458546e882a742d4ebd05a68c4009e4ff4b836a5c1f247c1411dc4d17"} Jun 03 22:54:41.072293 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.072245 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x5n9c" podStartSLOduration=3.010085024 podStartE2EDuration="4.072206631s" totalImagesPullingTime="975.723816ms" totalInitContainerRuntime="86.397791ms" isStatefulPod=true podCreationTimestamp="2026-06-03 22:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:41.067732272 +0000 UTC m=+261.264755141" watchObservedRunningTime="2026-06-03 22:54:41.072206631 +0000 UTC m=+261.269229502" Jun 03 22:54:41.097265 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.097244 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:41.252821 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.252716 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-88b68f7c8-ttxgq"] Jun 03 22:54:41.255300 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:54:41.255271 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab23b79_f5f3_4ca3_83be_6f614b518013.slice/crio-303e7dd659faaf8a6e08a2035086f34f70083aaa6bd30c8608992e845714a70d WatchSource:0}: Error finding container 303e7dd659faaf8a6e08a2035086f34f70083aaa6bd30c8608992e845714a70d: Status 404 returned error can't find the container with id 303e7dd659faaf8a6e08a2035086f34f70083aaa6bd30c8608992e845714a70d Jun 03 22:54:41.996131 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.996084 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-768dd4474d-hf2qj"] Jun 03 22:54:41.999631 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:41.999606 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.001888 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.001854 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 22:54:42.002366 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.002346 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 22:54:42.002442 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.002424 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ci6csfhlkg27q\"" Jun 03 22:54:42.002495 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.002468 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 22:54:42.002495 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.002356 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jf2rv\"" Jun 03 22:54:42.002587 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.002427 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 22:54:42.010041 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.009983 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-768dd4474d-hf2qj"] Jun 03 22:54:42.056069 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.055940 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" event={"ID":"0ab23b79-f5f3-4ca3-83be-6f614b518013","Type":"ContainerStarted","Data":"303e7dd659faaf8a6e08a2035086f34f70083aaa6bd30c8608992e845714a70d"} Jun 03 22:54:42.139922 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.139887 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/103c9055-5f30-4f69-a95a-689505185b61-secret-metrics-server-tls\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.140082 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.139940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/103c9055-5f30-4f69-a95a-689505185b61-audit-log\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.140082 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.140004 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103c9055-5f30-4f69-a95a-689505185b61-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.140082 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.140055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/103c9055-5f30-4f69-a95a-689505185b61-client-ca-bundle\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.140306 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.140086 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6622\" (UniqueName: \"kubernetes.io/projected/103c9055-5f30-4f69-a95a-689505185b61-kube-api-access-n6622\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.140306 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.140136 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/103c9055-5f30-4f69-a95a-689505185b61-secret-metrics-server-client-certs\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.140306 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.140200 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/103c9055-5f30-4f69-a95a-689505185b61-metrics-server-audit-profiles\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.240958 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.240680 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/103c9055-5f30-4f69-a95a-689505185b61-secret-metrics-server-tls\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.240958 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.240797 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/103c9055-5f30-4f69-a95a-689505185b61-audit-log\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.240958 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.240835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103c9055-5f30-4f69-a95a-689505185b61-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.241276 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.241191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/103c9055-5f30-4f69-a95a-689505185b61-client-ca-bundle\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.241276 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.241257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6622\" (UniqueName: \"kubernetes.io/projected/103c9055-5f30-4f69-a95a-689505185b61-kube-api-access-n6622\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.241395 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.241293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/103c9055-5f30-4f69-a95a-689505185b61-secret-metrics-server-client-certs\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.241395 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.241334 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/103c9055-5f30-4f69-a95a-689505185b61-metrics-server-audit-profiles\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.241736 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.241680 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/103c9055-5f30-4f69-a95a-689505185b61-audit-log\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.242014 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.241989 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103c9055-5f30-4f69-a95a-689505185b61-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.242408 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.242370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/103c9055-5f30-4f69-a95a-689505185b61-metrics-server-audit-profiles\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.245527 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.245483 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/103c9055-5f30-4f69-a95a-689505185b61-client-ca-bundle\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.246688 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.246630 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/103c9055-5f30-4f69-a95a-689505185b61-secret-metrics-server-tls\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.248633 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.248607 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/103c9055-5f30-4f69-a95a-689505185b61-secret-metrics-server-client-certs\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.250166 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.250144 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6622\" (UniqueName: \"kubernetes.io/projected/103c9055-5f30-4f69-a95a-689505185b61-kube-api-access-n6622\") pod \"metrics-server-768dd4474d-hf2qj\" (UID: \"103c9055-5f30-4f69-a95a-689505185b61\") " pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.313064 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.313016 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:54:42.467267 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.467233 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-768dd4474d-hf2qj"] Jun 03 22:54:42.512025 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.511902 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-pml2w"] Jun 03 22:54:42.532672 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.532647 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-pml2w"] Jun 03 22:54:42.532801 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.532759 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" Jun 03 22:54:42.535393 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.535195 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xb5fv\"" Jun 03 22:54:42.535558 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.535532 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 22:54:42.644470 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.644379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-968k5\" (UniqueName: \"kubernetes.io/projected/3ea2a325-6ef7-46f7-af21-74f9fc6774a7-kube-api-access-968k5\") pod \"monitoring-plugin-9b9fc658-pml2w\" (UID: \"3ea2a325-6ef7-46f7-af21-74f9fc6774a7\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" Jun 03 22:54:42.644470 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.644454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ea2a325-6ef7-46f7-af21-74f9fc6774a7-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-pml2w\" (UID: \"3ea2a325-6ef7-46f7-af21-74f9fc6774a7\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" Jun 03 22:54:42.745187 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.745093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ea2a325-6ef7-46f7-af21-74f9fc6774a7-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-pml2w\" (UID: \"3ea2a325-6ef7-46f7-af21-74f9fc6774a7\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" Jun 03 22:54:42.745187 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.745187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-968k5\" (UniqueName: \"kubernetes.io/projected/3ea2a325-6ef7-46f7-af21-74f9fc6774a7-kube-api-access-968k5\") pod \"monitoring-plugin-9b9fc658-pml2w\" (UID: \"3ea2a325-6ef7-46f7-af21-74f9fc6774a7\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" Jun 03 22:54:42.745425 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:54:42.745271 2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 03 22:54:42.745425 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:54:42.745352 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea2a325-6ef7-46f7-af21-74f9fc6774a7-monitoring-plugin-cert podName:3ea2a325-6ef7-46f7-af21-74f9fc6774a7 nodeName:}" failed. No retries permitted until 2026-06-03 22:54:43.245330748 +0000 UTC m=+263.442353611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3ea2a325-6ef7-46f7-af21-74f9fc6774a7-monitoring-plugin-cert") pod "monitoring-plugin-9b9fc658-pml2w" (UID: "3ea2a325-6ef7-46f7-af21-74f9fc6774a7") : secret "monitoring-plugin-cert" not found Jun 03 22:54:42.755056 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:42.755032 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-968k5\" (UniqueName: \"kubernetes.io/projected/3ea2a325-6ef7-46f7-af21-74f9fc6774a7-kube-api-access-968k5\") pod \"monitoring-plugin-9b9fc658-pml2w\" (UID: \"3ea2a325-6ef7-46f7-af21-74f9fc6774a7\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" Jun 03 22:54:43.061570 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.061536 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" event={"ID":"103c9055-5f30-4f69-a95a-689505185b61","Type":"ContainerStarted","Data":"bb3d23cf8a1a75268d27562cafe66cb2fa25b243f11b543669c15ae5d54c65f0"} Jun 03 22:54:43.250893 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.250858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ea2a325-6ef7-46f7-af21-74f9fc6774a7-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-pml2w\" (UID: \"3ea2a325-6ef7-46f7-af21-74f9fc6774a7\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" Jun 03 22:54:43.254091 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.254064 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ea2a325-6ef7-46f7-af21-74f9fc6774a7-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-pml2w\" (UID: \"3ea2a325-6ef7-46f7-af21-74f9fc6774a7\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" Jun 03 22:54:43.447685 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.447495 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" Jun 03 22:54:43.601885 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.601840 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-pml2w"] Jun 03 22:54:43.604276 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:54:43.604237 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea2a325_6ef7_46f7_af21_74f9fc6774a7.slice/crio-695a83ce8e1679307c408d9e8377c753aa6e251302f429b692fb7fdc73cb12f1 WatchSource:0}: Error finding container 695a83ce8e1679307c408d9e8377c753aa6e251302f429b692fb7fdc73cb12f1: Status 404 returned error can't find the container with id 695a83ce8e1679307c408d9e8377c753aa6e251302f429b692fb7fdc73cb12f1 Jun 03 22:54:43.943312 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.943227 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:54:43.947546 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.947525 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:43.950058 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.950035 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 22:54:43.950168 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.950073 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 22:54:43.950715 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.950509 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 22:54:43.950794 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.950770 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 22:54:43.950851 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.950817 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 22:54:43.953084 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.952346 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d4d0qd1ivjbum\"" Jun 03 22:54:43.953084 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.952352 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qs8pb\"" Jun 03 22:54:43.953084 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.952517 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 22:54:43.953084 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.952809 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 22:54:43.953084 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.952815 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 22:54:43.953084 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.952862 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 22:54:43.953084 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.952822 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 22:54:43.953084 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.952953 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 22:54:43.953084 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.953065 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 22:54:43.953594 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.953132 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 22:54:43.955114 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.954890 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 22:54:43.967181 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:43.967142 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:54:44.059572 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.059534 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.059745 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.059581 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.059745 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.059632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.059745 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.059675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.059745 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.059718 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.059959 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.059759 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e40a94de-6ee2-42ea-bb4f-390a946368c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.059959 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.059816 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmhk5\" (UniqueName: \"kubernetes.io/projected/e40a94de-6ee2-42ea-bb4f-390a946368c4-kube-api-access-wmhk5\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.059959 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.059873 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.059959 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.059903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.059959 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.059930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.060180 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.059998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.060180 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.060025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.060180 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.060042 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-config\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.060180 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.060081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.060180 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.060106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.060180 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.060132 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.060180 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.060155 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e40a94de-6ee2-42ea-bb4f-390a946368c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.060538 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.060241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.060538 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.060275 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.060538 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.060305 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.072780 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.072748 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" event={"ID":"0ab23b79-f5f3-4ca3-83be-6f614b518013","Type":"ContainerStarted","Data":"9fb29311b5d52c1069cf3da0777c21ebe8bbf4ef8aacb798322f5ac7f06c106a"} Jun 03 22:54:44.073321 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.073294 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" event={"ID":"0ab23b79-f5f3-4ca3-83be-6f614b518013","Type":"ContainerStarted","Data":"2a1b491d67be4790d359d55f10efb724c0cd9b224a73bbabcc19806000025dc0"} Jun 03 22:54:44.073459 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.073350 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" event={"ID":"0ab23b79-f5f3-4ca3-83be-6f614b518013","Type":"ContainerStarted","Data":"c83056318ebab614192aa2b2a0f9456fcac1b036a36ce45adbd67137f0ebf598"} Jun 03 22:54:44.074108 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.074076 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" event={"ID":"3ea2a325-6ef7-46f7-af21-74f9fc6774a7","Type":"ContainerStarted","Data":"695a83ce8e1679307c408d9e8377c753aa6e251302f429b692fb7fdc73cb12f1"} Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161241 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161278 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161334 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e40a94de-6ee2-42ea-bb4f-390a946368c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmhk5\" (UniqueName: \"kubernetes.io/projected/e40a94de-6ee2-42ea-bb4f-390a946368c4-kube-api-access-wmhk5\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161451 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161523 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-config\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e40a94de-6ee2-42ea-bb4f-390a946368c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.163515 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.161901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.164631 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.162833 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.164631 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.164226 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.164631 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.164372 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.164881 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.164854 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.165536 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.165445 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.166039 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.165999 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.170561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.166164 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.170561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.166226 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.170561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.166261 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.170561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.166402 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.170561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.167877 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.170561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.168142 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.170561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.168602 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.170561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.169054 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e40a94de-6ee2-42ea-bb4f-390a946368c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.170561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.169915 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.170561 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.170522 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-config\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.171422 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.171398 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.171938 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.171917 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e40a94de-6ee2-42ea-bb4f-390a946368c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.172646 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.172604 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.172646 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.172624 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.173486 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.173371 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmhk5\" (UniqueName: \"kubernetes.io/projected/e40a94de-6ee2-42ea-bb4f-390a946368c4-kube-api-access-wmhk5\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.174049 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.174008 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.174289 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.174251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.260235 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.259975 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:44.381255 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.381205 2561 patch_prober.go:28] interesting pod/image-registry-59f7f48d79-gp8ds container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 22:54:44.381399 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.381280 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" podUID="888eb6f0-3c3c-4e89-820a-989da94a35e4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 22:54:44.561605 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:44.561572 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:54:44.602293 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:54:44.602247 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40a94de_6ee2_42ea_bb4f_390a946368c4.slice/crio-f02e70a57cffaa92ae4e76c72bdd797e9cb0f858d896e4a2008ccdcebcd7e9b0 WatchSource:0}: Error finding container f02e70a57cffaa92ae4e76c72bdd797e9cb0f858d896e4a2008ccdcebcd7e9b0: Status 404 returned error can't find the container with id f02e70a57cffaa92ae4e76c72bdd797e9cb0f858d896e4a2008ccdcebcd7e9b0 Jun 03 22:54:45.081587 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:45.081487 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerStarted","Data":"f02e70a57cffaa92ae4e76c72bdd797e9cb0f858d896e4a2008ccdcebcd7e9b0"} Jun 03 22:54:45.084624 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:45.084591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" event={"ID":"103c9055-5f30-4f69-a95a-689505185b61","Type":"ContainerStarted","Data":"86cd5de5840e1703dd64af654c697e921ddbb03245c30e66f9546f9ae0678f44"} Jun 03 22:54:45.089729 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:45.089703 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" event={"ID":"0ab23b79-f5f3-4ca3-83be-6f614b518013","Type":"ContainerStarted","Data":"17a4c3ebc253007f86aabca7169d806b7f301294b91d71783571044731836f23"} Jun 03 22:54:45.089842 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:45.089775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" event={"ID":"0ab23b79-f5f3-4ca3-83be-6f614b518013","Type":"ContainerStarted","Data":"4d1301d6de8003d2b285a860ed428275931ba6da4ff55fbbbb9ac4cbf82c1e4b"} Jun 03 22:54:45.089842 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:45.089821 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" event={"ID":"0ab23b79-f5f3-4ca3-83be-6f614b518013","Type":"ContainerStarted","Data":"a5b32b2079a3c1af4a6f6edae32823df20eca7dfe34be15690ef4b375c65a93c"} Jun 03 22:54:45.089951 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:45.089892 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:45.103818 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:45.103775 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" podStartSLOduration=1.965580853 podStartE2EDuration="4.103760076s" totalImagesPullingTime="2.138179223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:45.102067881 +0000 UTC m=+265.299090751" watchObservedRunningTime="2026-06-03 22:54:45.103760076 +0000 UTC m=+265.300782924" Jun 03 22:54:46.096045 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:46.096012 2561 generic.go:356] "Generic (PLEG): container finished" podID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerID="e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8" exitCode=0 Jun 03 22:54:46.096470 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:46.096100 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerDied","Data":"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8"} Jun 03 22:54:46.098073 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:46.098019 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" event={"ID":"3ea2a325-6ef7-46f7-af21-74f9fc6774a7","Type":"ContainerStarted","Data":"1f4d7a137f68c07dd76fe55ebaaaa5e2b62f3edfee27dcd31f4af7277d7f1b22"} Jun 03 22:54:46.099281 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:46.098480 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" Jun 03 22:54:46.103585 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:46.103564 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" Jun 03 22:54:46.125201 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:46.125136 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" podStartSLOduration=2.957282362 podStartE2EDuration="6.125116776s" totalImagesPullingTime="3.167834414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:45.128435228 +0000 UTC m=+265.325458099" watchObservedRunningTime="2026-06-03 22:54:46.125116776 +0000 UTC m=+266.322139648" Jun 03 22:54:46.141445 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:46.141383 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-9b9fc658-pml2w" podStartSLOduration=1.819891756 podStartE2EDuration="4.141369576s" totalImagesPullingTime="2.32147782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:46.140532764 +0000 UTC m=+266.337555633" watchObservedRunningTime="2026-06-03 22:54:46.141369576 +0000 UTC m=+266.338392445" Jun 03 22:54:49.393337 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.393253 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" podUID="888eb6f0-3c3c-4e89-820a-989da94a35e4" containerName="registry" containerID="cri-o://3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f" gracePeriod=30 Jun 03 22:54:49.645855 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.645760 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:54:49.821264 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.821199 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls\") pod \"888eb6f0-3c3c-4e89-820a-989da94a35e4\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " Jun 03 22:54:49.821405 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.821285 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/888eb6f0-3c3c-4e89-820a-989da94a35e4-image-registry-private-configuration\") pod \"888eb6f0-3c3c-4e89-820a-989da94a35e4\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " Jun 03 22:54:49.821405 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.821328 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpqcc\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-kube-api-access-gpqcc\") pod \"888eb6f0-3c3c-4e89-820a-989da94a35e4\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " Jun 03 22:54:49.821405 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.821357 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/888eb6f0-3c3c-4e89-820a-989da94a35e4-trusted-ca\") pod \"888eb6f0-3c3c-4e89-820a-989da94a35e4\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " Jun 03 22:54:49.821571 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.821408 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-certificates\") pod \"888eb6f0-3c3c-4e89-820a-989da94a35e4\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " Jun 03 22:54:49.821571 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.821443 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/888eb6f0-3c3c-4e89-820a-989da94a35e4-ca-trust-extracted\") pod \"888eb6f0-3c3c-4e89-820a-989da94a35e4\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " Jun 03 22:54:49.821571 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.821468 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/888eb6f0-3c3c-4e89-820a-989da94a35e4-installation-pull-secrets\") pod \"888eb6f0-3c3c-4e89-820a-989da94a35e4\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " Jun 03 22:54:49.821571 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.821511 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-bound-sa-token\") pod \"888eb6f0-3c3c-4e89-820a-989da94a35e4\" (UID: \"888eb6f0-3c3c-4e89-820a-989da94a35e4\") " Jun 03 22:54:49.823039 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.822805 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "888eb6f0-3c3c-4e89-820a-989da94a35e4" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:54:49.823039 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.822977 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/888eb6f0-3c3c-4e89-820a-989da94a35e4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "888eb6f0-3c3c-4e89-820a-989da94a35e4" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:54:49.828487 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.828351 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/888eb6f0-3c3c-4e89-820a-989da94a35e4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "888eb6f0-3c3c-4e89-820a-989da94a35e4" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:54:49.828487 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.828383 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "888eb6f0-3c3c-4e89-820a-989da94a35e4" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:54:49.828487 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.828438 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-kube-api-access-gpqcc" (OuterVolumeSpecName: "kube-api-access-gpqcc") pod "888eb6f0-3c3c-4e89-820a-989da94a35e4" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4"). InnerVolumeSpecName "kube-api-access-gpqcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:54:49.828487 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.828455 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "888eb6f0-3c3c-4e89-820a-989da94a35e4" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:54:49.828688 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.828525 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/888eb6f0-3c3c-4e89-820a-989da94a35e4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "888eb6f0-3c3c-4e89-820a-989da94a35e4" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:54:49.833829 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.833798 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/888eb6f0-3c3c-4e89-820a-989da94a35e4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "888eb6f0-3c3c-4e89-820a-989da94a35e4" (UID: "888eb6f0-3c3c-4e89-820a-989da94a35e4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:54:49.922537 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.922513 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-certificates\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:54:49.922649 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.922542 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/888eb6f0-3c3c-4e89-820a-989da94a35e4-ca-trust-extracted\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:54:49.922649 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.922556 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/888eb6f0-3c3c-4e89-820a-989da94a35e4-installation-pull-secrets\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:54:49.922649 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.922568 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-bound-sa-token\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:54:49.922649 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.922581 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-registry-tls\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:54:49.922649 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.922594 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/888eb6f0-3c3c-4e89-820a-989da94a35e4-image-registry-private-configuration\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:54:49.922649 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.922606 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpqcc\" (UniqueName: \"kubernetes.io/projected/888eb6f0-3c3c-4e89-820a-989da94a35e4-kube-api-access-gpqcc\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:54:49.922649 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:49.922619 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/888eb6f0-3c3c-4e89-820a-989da94a35e4-trusted-ca\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:54:50.121836 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.121799 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerStarted","Data":"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf"} Jun 03 22:54:50.121996 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.121886 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerStarted","Data":"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f"} Jun 03 22:54:50.121996 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.121927 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerStarted","Data":"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0"} Jun 03 22:54:50.121996 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.121969 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerStarted","Data":"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09"} Jun 03 22:54:50.122156 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.122008 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerStarted","Data":"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d"} Jun 03 22:54:50.122156 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.122060 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerStarted","Data":"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2"} Jun 03 22:54:50.123237 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.123189 2561 generic.go:356] "Generic (PLEG): container finished" podID="888eb6f0-3c3c-4e89-820a-989da94a35e4" containerID="3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f" exitCode=0 Jun 03 22:54:50.123346 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.123257 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" Jun 03 22:54:50.123346 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.123252 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" event={"ID":"888eb6f0-3c3c-4e89-820a-989da94a35e4","Type":"ContainerDied","Data":"3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f"} Jun 03 22:54:50.123453 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.123374 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f7f48d79-gp8ds" event={"ID":"888eb6f0-3c3c-4e89-820a-989da94a35e4","Type":"ContainerDied","Data":"0605e1a0961c935943abdfc3252d3ef0132c980e7fe9202337a5a8837bbc748b"} Jun 03 22:54:50.123453 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.123396 2561 scope.go:117] "RemoveContainer" containerID="3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f" Jun 03 22:54:50.133843 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.133805 2561 scope.go:117] "RemoveContainer" containerID="3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f" Jun 03 22:54:50.134086 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:54:50.134062 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f\": container with ID starting with 3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f not found: ID does not exist" containerID="3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f" Jun 03 22:54:50.134150 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.134097 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f"} err="failed to get container status \"3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f\": rpc error: code = NotFound desc = could not find container \"3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f\": container with ID starting with 3b140aaec14c1297df37423112c6f1345d660a64e14f045cfedf6329ff733c2f not found: ID does not exist" Jun 03 22:54:50.168292 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.168191 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.399965753 podStartE2EDuration="7.16816614s" totalImagesPullingTime="4.742583732s" totalInitContainerRuntime="25.616655ms" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:50.164502045 +0000 UTC m=+270.361524925" watchObservedRunningTime="2026-06-03 22:54:50.16816614 +0000 UTC m=+270.365189008" Jun 03 22:54:50.181601 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.181569 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f7f48d79-gp8ds"] Jun 03 22:54:50.188007 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.187982 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59f7f48d79-gp8ds"] Jun 03 22:54:50.246429 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:50.246396 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="888eb6f0-3c3c-4e89-820a-989da94a35e4" path="/var/lib/kubelet/pods/888eb6f0-3c3c-4e89-820a-989da94a35e4/volumes" Jun 03 22:54:51.104938 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:51.104907 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-88b68f7c8-ttxgq" Jun 03 22:54:54.260623 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:54.260587 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:54:58.166111 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:58.166070 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-x2jnw" event={"ID":"ead0ab21-f636-48eb-a500-6e29e20cb53b","Type":"ContainerStarted","Data":"31890b62c973e3103d2236a647ccf4d1300a12efb2cd9ae0f43224edf2010c8d"} Jun 03 22:54:58.166657 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:58.166397 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-56b467f5ff-x2jnw" Jun 03 22:54:58.179835 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:58.179808 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-56b467f5ff-x2jnw" Jun 03 22:54:58.185270 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:54:58.184972 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-56b467f5ff-x2jnw" podStartSLOduration=2.4683168589999998 podStartE2EDuration="20.184951866s" totalImagesPullingTime="17.716635007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:54:58.183605484 +0000 UTC m=+278.380628354" watchObservedRunningTime="2026-06-03 22:54:58.184951866 +0000 UTC m=+278.381974736" Jun 03 22:55:00.723270 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:55:00.723192 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7rgls" podUID="5775370d-aa46-44ea-8fe3-77883c47feb4" Jun 03 22:55:01.180373 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:01.180342 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7rgls" Jun 03 22:55:02.314116 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:02.314074 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:55:02.314572 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:02.314168 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:55:04.655173 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:04.655101 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:55:04.657807 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:04.657772 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5775370d-aa46-44ea-8fe3-77883c47feb4-metrics-tls\") pod \"dns-default-7rgls\" (UID: \"5775370d-aa46-44ea-8fe3-77883c47feb4\") " pod="openshift-dns/dns-default-7rgls" Jun 03 22:55:04.783386 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:04.783356 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bfmtg\"" Jun 03 22:55:04.791900 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:04.791867 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7rgls" Jun 03 22:55:05.010539 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:05.010508 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7rgls"] Jun 03 22:55:05.015065 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:55:05.015018 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5775370d_aa46_44ea_8fe3_77883c47feb4.slice/crio-ea8f601dc3d8902920a1ae922dcf33afcce0160f69ef6c9158147e736a919c8c WatchSource:0}: Error finding container ea8f601dc3d8902920a1ae922dcf33afcce0160f69ef6c9158147e736a919c8c: Status 404 returned error can't find the container with id ea8f601dc3d8902920a1ae922dcf33afcce0160f69ef6c9158147e736a919c8c Jun 03 22:55:05.198993 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:05.198902 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7rgls" event={"ID":"5775370d-aa46-44ea-8fe3-77883c47feb4","Type":"ContainerStarted","Data":"ea8f601dc3d8902920a1ae922dcf33afcce0160f69ef6c9158147e736a919c8c"} Jun 03 22:55:08.214202 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:08.214172 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7rgls" event={"ID":"5775370d-aa46-44ea-8fe3-77883c47feb4","Type":"ContainerStarted","Data":"e17be7292c1018099f1d6e923c6d9141cde525cc2b237ee0e2b8793bb149b30e"} Jun 03 22:55:08.214599 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:08.214239 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7rgls" event={"ID":"5775370d-aa46-44ea-8fe3-77883c47feb4","Type":"ContainerStarted","Data":"1107622de78886286599c4b637b42387c6b47713225d89b7d70862a0dec082f8"} Jun 03 22:55:08.214599 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:08.214289 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7rgls" Jun 03 22:55:08.238626 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:08.238579 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7rgls" podStartSLOduration=252.082507385 podStartE2EDuration="4m14.238562625s" totalImagesPullingTime="2.15605524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:55:08.236497743 +0000 UTC m=+288.433520611" watchObservedRunningTime="2026-06-03 22:55:08.238562625 +0000 UTC m=+288.435585496" Jun 03 22:55:09.380758 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:09.380686 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7rgls_5775370d-aa46-44ea-8fe3-77883c47feb4/dns/0.log" Jun 03 22:55:09.390456 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:09.390436 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7rgls_5775370d-aa46-44ea-8fe3-77883c47feb4/kube-rbac-proxy/0.log" Jun 03 22:55:10.336628 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:10.336599 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gjk4g_f115edfc-b8cf-40d0-a424-e990f478cab3/dns-node-resolver/0.log" Jun 03 22:55:11.337842 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:11.337774 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xkqbx_75cdff9b-2d30-4a8e-bb7b-685011837e4b/node-ca/0.log" Jun 03 22:55:18.221647 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:18.221618 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7rgls" Jun 03 22:55:20.186954 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:20.186925 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 22:55:20.191322 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:20.191303 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 22:55:20.192988 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:20.192948 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 22:55:20.197365 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:20.197343 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 22:55:20.201056 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:20.201037 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 22:55:22.319836 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:22.319804 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:55:22.323914 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:22.323892 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-768dd4474d-hf2qj" Jun 03 22:55:44.260149 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:44.260111 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:55:44.279540 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:44.279518 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:55:44.366920 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:55:44.366896 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:02.753015 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:02.752980 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:56:02.753630 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:02.753303 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="prometheus" containerID="cri-o://03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2" gracePeriod=600 Jun 03 22:56:02.753630 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:02.753365 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="config-reloader" containerID="cri-o://d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d" gracePeriod=600 Jun 03 22:56:02.753630 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:02.753373 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="kube-rbac-proxy-web" containerID="cri-o://a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0" gracePeriod=600 Jun 03 22:56:02.753630 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:02.753415 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf" gracePeriod=600 Jun 03 22:56:02.753630 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:02.753380 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="kube-rbac-proxy" containerID="cri-o://f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f" gracePeriod=600 Jun 03 22:56:02.753630 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:02.753362 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="thanos-sidecar" containerID="cri-o://d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09" gracePeriod=600 Jun 03 22:56:02.987777 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:02.987755 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.012397 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012347 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-metrics-client-ca\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.012397 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012379 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.012562 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012407 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e40a94de-6ee2-42ea-bb4f-390a946368c4-config-out\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.012562 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012425 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-db\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.012562 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012550 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.012717 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012593 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-2\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.012717 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012621 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-1\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.012717 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012643 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-grpc-tls\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.012717 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012673 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-kube-rbac-proxy\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.012717 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012702 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-web-config\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.013079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012724 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:56:03.013079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012735 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-serving-certs-ca-bundle\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.013079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012797 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-kubelet-serving-ca-bundle\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.013079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012923 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-config\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.013079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012951 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-0\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.013079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.012994 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-metrics-client-certs\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.013079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013021 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e40a94de-6ee2-42ea-bb4f-390a946368c4-tls-assets\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.013079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013048 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmhk5\" (UniqueName: \"kubernetes.io/projected/e40a94de-6ee2-42ea-bb4f-390a946368c4-kube-api-access-wmhk5\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.013079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013070 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-thanos-prometheus-http-client-file\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.013079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013102 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-tls\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.013079 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013143 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-trusted-ca-bundle\") pod \"e40a94de-6ee2-42ea-bb4f-390a946368c4\" (UID: \"e40a94de-6ee2-42ea-bb4f-390a946368c4\") " Jun 03 22:56:03.013745 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013199 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:56:03.013745 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013147 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:56:03.013745 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013529 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:56:03.013745 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013540 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:56:03.013745 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013542 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-metrics-client-ca\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.013745 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013572 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.013745 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013589 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.014081 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.013859 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:56:03.015236 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.015189 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:56:03.015459 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.015410 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:56:03.015846 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.015820 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40a94de-6ee2-42ea-bb4f-390a946368c4-config-out" (OuterVolumeSpecName: "config-out") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:56:03.016255 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.016200 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:56:03.016374 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.016349 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:56:03.016374 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.016363 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40a94de-6ee2-42ea-bb4f-390a946368c4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:56:03.016738 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.016719 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:56:03.016812 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.016746 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:56:03.017276 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.017250 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:56:03.017835 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.017807 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:56:03.017925 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.017899 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-config" (OuterVolumeSpecName: "config") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:56:03.018512 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.018487 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:56:03.018650 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.018586 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40a94de-6ee2-42ea-bb4f-390a946368c4-kube-api-access-wmhk5" (OuterVolumeSpecName: "kube-api-access-wmhk5") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "kube-api-access-wmhk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:56:03.029240 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.029197 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-web-config" (OuterVolumeSpecName: "web-config") pod "e40a94de-6ee2-42ea-bb4f-390a946368c4" (UID: "e40a94de-6ee2-42ea-bb4f-390a946368c4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:56:03.114908 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.114880 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.114908 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.114905 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e40a94de-6ee2-42ea-bb4f-390a946368c4-config-out\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.114918 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-db\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.114931 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.114944 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.114957 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-grpc-tls\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.114969 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-kube-rbac-proxy\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.114981 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-web-config\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.114993 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.115005 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-config\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.115019 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.115032 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-metrics-client-certs\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.115047 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e40a94de-6ee2-42ea-bb4f-390a946368c4-tls-assets\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.115059 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmhk5\" (UniqueName: \"kubernetes.io/projected/e40a94de-6ee2-42ea-bb4f-390a946368c4-kube-api-access-wmhk5\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115078 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.115073 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115633 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.115086 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e40a94de-6ee2-42ea-bb4f-390a946368c4-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.115633 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.115100 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40a94de-6ee2-42ea-bb4f-390a946368c4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 22:56:03.426697 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426613 2561 generic.go:356] "Generic (PLEG): container finished" podID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerID="9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf" exitCode=0 Jun 03 22:56:03.426697 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426637 2561 generic.go:356] "Generic (PLEG): container finished" podID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerID="f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f" exitCode=0 Jun 03 22:56:03.426697 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426647 2561 generic.go:356] "Generic (PLEG): container finished" podID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerID="a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0" exitCode=0 Jun 03 22:56:03.426697 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426655 2561 generic.go:356] "Generic (PLEG): container finished" podID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerID="d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09" exitCode=0 Jun 03 22:56:03.426697 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426662 2561 generic.go:356] "Generic (PLEG): container finished" podID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerID="d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d" exitCode=0 Jun 03 22:56:03.426697 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426669 2561 generic.go:356] "Generic (PLEG): container finished" podID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerID="03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2" exitCode=0 Jun 03 22:56:03.426697 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426670 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerDied","Data":"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf"} Jun 03 22:56:03.427096 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426742 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerDied","Data":"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f"} Jun 03 22:56:03.427096 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426684 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.427096 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426770 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerDied","Data":"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0"} Jun 03 22:56:03.427096 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426796 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerDied","Data":"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09"} Jun 03 22:56:03.427096 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426819 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerDied","Data":"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d"} Jun 03 22:56:03.427096 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426844 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerDied","Data":"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2"} Jun 03 22:56:03.427096 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426855 2561 scope.go:117] "RemoveContainer" containerID="9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf" Jun 03 22:56:03.427096 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.426868 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e40a94de-6ee2-42ea-bb4f-390a946368c4","Type":"ContainerDied","Data":"f02e70a57cffaa92ae4e76c72bdd797e9cb0f858d896e4a2008ccdcebcd7e9b0"} Jun 03 22:56:03.435043 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.435029 2561 scope.go:117] "RemoveContainer" containerID="f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f" Jun 03 22:56:03.441934 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.441917 2561 scope.go:117] "RemoveContainer" containerID="a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0" Jun 03 22:56:03.452067 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.452046 2561 scope.go:117] "RemoveContainer" containerID="d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09" Jun 03 22:56:03.460710 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.460693 2561 scope.go:117] "RemoveContainer" containerID="d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d" Jun 03 22:56:03.463597 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.463576 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:56:03.468181 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.468160 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:56:03.468466 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.468451 2561 scope.go:117] "RemoveContainer" containerID="03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2" Jun 03 22:56:03.475715 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.475699 2561 scope.go:117] "RemoveContainer" containerID="e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8" Jun 03 22:56:03.482154 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.482139 2561 scope.go:117] "RemoveContainer" containerID="9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf" Jun 03 22:56:03.482447 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:56:03.482424 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": container with ID starting with 9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf not found: ID does not exist" containerID="9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf" Jun 03 22:56:03.482539 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.482455 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf"} err="failed to get container status \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": rpc error: code = NotFound desc = could not find container \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": container with ID starting with 9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf not found: ID does not exist" Jun 03 22:56:03.482539 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.482472 2561 scope.go:117] "RemoveContainer" containerID="f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f" Jun 03 22:56:03.482690 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:56:03.482673 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": container with ID starting with f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f not found: ID does not exist" containerID="f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f" Jun 03 22:56:03.482729 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.482696 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f"} err="failed to get container status \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": rpc error: code = NotFound desc = could not find container \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": container with ID starting with f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f not found: ID does not exist" Jun 03 22:56:03.482729 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.482712 2561 scope.go:117] "RemoveContainer" containerID="a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0" Jun 03 22:56:03.482928 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:56:03.482912 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": container with ID starting with a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0 not found: ID does not exist" containerID="a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0" Jun 03 22:56:03.482972 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.482934 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0"} err="failed to get container status \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": rpc error: code = NotFound desc = could not find container \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": container with ID starting with a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0 not found: ID does not exist" Jun 03 22:56:03.482972 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.482948 2561 scope.go:117] "RemoveContainer" containerID="d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09" Jun 03 22:56:03.483184 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:56:03.483170 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": container with ID starting with d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09 not found: ID does not exist" containerID="d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09" Jun 03 22:56:03.483245 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.483188 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09"} err="failed to get container status \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": rpc error: code = NotFound desc = could not find container \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": container with ID starting with d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09 not found: ID does not exist" Jun 03 22:56:03.483245 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.483201 2561 scope.go:117] "RemoveContainer" containerID="d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d" Jun 03 22:56:03.483440 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:56:03.483425 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": container with ID starting with d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d not found: ID does not exist" containerID="d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d" Jun 03 22:56:03.483479 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.483443 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d"} err="failed to get container status \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": rpc error: code = NotFound desc = could not find container \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": container with ID starting with d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d not found: ID does not exist" Jun 03 22:56:03.483479 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.483455 2561 scope.go:117] "RemoveContainer" containerID="03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2" Jun 03 22:56:03.483687 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:56:03.483672 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": container with ID starting with 03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2 not found: ID does not exist" containerID="03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2" Jun 03 22:56:03.483724 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.483692 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2"} err="failed to get container status \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": rpc error: code = NotFound desc = could not find container \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": container with ID starting with 03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2 not found: ID does not exist" Jun 03 22:56:03.483724 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.483706 2561 scope.go:117] "RemoveContainer" containerID="e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8" Jun 03 22:56:03.483913 ip-10-0-143-45 kubenswrapper[2561]: E0603 22:56:03.483898 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": container with ID starting with e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8 not found: ID does not exist" containerID="e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8" Jun 03 22:56:03.483954 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.483916 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8"} err="failed to get container status \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": rpc error: code = NotFound desc = could not find container \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": container with ID starting with e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8 not found: ID does not exist" Jun 03 22:56:03.483954 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.483930 2561 scope.go:117] "RemoveContainer" containerID="9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf" Jun 03 22:56:03.484136 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.484116 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf"} err="failed to get container status \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": rpc error: code = NotFound desc = could not find container \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": container with ID starting with 9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf not found: ID does not exist" Jun 03 22:56:03.484243 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.484138 2561 scope.go:117] "RemoveContainer" containerID="f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f" Jun 03 22:56:03.484417 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.484402 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f"} err="failed to get container status \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": rpc error: code = NotFound desc = could not find container \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": container with ID starting with f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f not found: ID does not exist" Jun 03 22:56:03.484466 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.484417 2561 scope.go:117] "RemoveContainer" containerID="a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0" Jun 03 22:56:03.484617 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.484603 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0"} err="failed to get container status \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": rpc error: code = NotFound desc = could not find container \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": container with ID starting with a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0 not found: ID does not exist" Jun 03 22:56:03.484654 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.484617 2561 scope.go:117] "RemoveContainer" containerID="d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09" Jun 03 22:56:03.484840 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.484823 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09"} err="failed to get container status \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": rpc error: code = NotFound desc = could not find container \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": container with ID starting with d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09 not found: ID does not exist" Jun 03 22:56:03.484891 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.484841 2561 scope.go:117] "RemoveContainer" containerID="d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d" Jun 03 22:56:03.485076 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.485059 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d"} err="failed to get container status \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": rpc error: code = NotFound desc = could not find container \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": container with ID starting with d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d not found: ID does not exist" Jun 03 22:56:03.485125 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.485076 2561 scope.go:117] "RemoveContainer" containerID="03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2" Jun 03 22:56:03.485310 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.485295 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2"} err="failed to get container status \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": rpc error: code = NotFound desc = could not find container \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": container with ID starting with 03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2 not found: ID does not exist" Jun 03 22:56:03.485310 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.485309 2561 scope.go:117] "RemoveContainer" containerID="e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8" Jun 03 22:56:03.485514 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.485497 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8"} err="failed to get container status \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": rpc error: code = NotFound desc = could not find container \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": container with ID starting with e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8 not found: ID does not exist" Jun 03 22:56:03.485556 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.485516 2561 scope.go:117] "RemoveContainer" containerID="9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf" Jun 03 22:56:03.485718 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.485703 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf"} err="failed to get container status \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": rpc error: code = NotFound desc = could not find container \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": container with ID starting with 9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf not found: ID does not exist" Jun 03 22:56:03.485760 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.485719 2561 scope.go:117] "RemoveContainer" containerID="f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f" Jun 03 22:56:03.485902 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.485887 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f"} err="failed to get container status \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": rpc error: code = NotFound desc = could not find container \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": container with ID starting with f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f not found: ID does not exist" Jun 03 22:56:03.485944 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.485902 2561 scope.go:117] "RemoveContainer" containerID="a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0" Jun 03 22:56:03.486085 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.486071 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0"} err="failed to get container status \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": rpc error: code = NotFound desc = could not find container \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": container with ID starting with a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0 not found: ID does not exist" Jun 03 22:56:03.486130 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.486085 2561 scope.go:117] "RemoveContainer" containerID="d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09" Jun 03 22:56:03.486305 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.486288 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09"} err="failed to get container status \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": rpc error: code = NotFound desc = could not find container \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": container with ID starting with d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09 not found: ID does not exist" Jun 03 22:56:03.486305 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.486305 2561 scope.go:117] "RemoveContainer" containerID="d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d" Jun 03 22:56:03.486519 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.486498 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d"} err="failed to get container status \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": rpc error: code = NotFound desc = could not find container \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": container with ID starting with d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d not found: ID does not exist" Jun 03 22:56:03.486626 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.486519 2561 scope.go:117] "RemoveContainer" containerID="03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2" Jun 03 22:56:03.486771 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.486741 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2"} err="failed to get container status \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": rpc error: code = NotFound desc = could not find container \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": container with ID starting with 03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2 not found: ID does not exist" Jun 03 22:56:03.486771 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.486764 2561 scope.go:117] "RemoveContainer" containerID="e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8" Jun 03 22:56:03.486998 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.486975 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8"} err="failed to get container status \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": rpc error: code = NotFound desc = could not find container \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": container with ID starting with e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8 not found: ID does not exist" Jun 03 22:56:03.487101 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.486999 2561 scope.go:117] "RemoveContainer" containerID="9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf" Jun 03 22:56:03.487261 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.487240 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf"} err="failed to get container status \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": rpc error: code = NotFound desc = could not find container \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": container with ID starting with 9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf not found: ID does not exist" Jun 03 22:56:03.487338 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.487262 2561 scope.go:117] "RemoveContainer" containerID="f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f" Jun 03 22:56:03.487459 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.487442 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f"} err="failed to get container status \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": rpc error: code = NotFound desc = could not find container \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": container with ID starting with f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f not found: ID does not exist" Jun 03 22:56:03.487459 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.487457 2561 scope.go:117] "RemoveContainer" containerID="a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0" Jun 03 22:56:03.487676 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.487659 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0"} err="failed to get container status \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": rpc error: code = NotFound desc = could not find container \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": container with ID starting with a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0 not found: ID does not exist" Jun 03 22:56:03.487676 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.487676 2561 scope.go:117] "RemoveContainer" containerID="d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09" Jun 03 22:56:03.487872 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.487856 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09"} err="failed to get container status \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": rpc error: code = NotFound desc = could not find container \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": container with ID starting with d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09 not found: ID does not exist" Jun 03 22:56:03.487911 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.487873 2561 scope.go:117] "RemoveContainer" containerID="d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d" Jun 03 22:56:03.488062 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.488048 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d"} err="failed to get container status \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": rpc error: code = NotFound desc = could not find container \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": container with ID starting with d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d not found: ID does not exist" Jun 03 22:56:03.488114 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.488062 2561 scope.go:117] "RemoveContainer" containerID="03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2" Jun 03 22:56:03.488263 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.488249 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2"} err="failed to get container status \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": rpc error: code = NotFound desc = could not find container \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": container with ID starting with 03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2 not found: ID does not exist" Jun 03 22:56:03.488311 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.488264 2561 scope.go:117] "RemoveContainer" containerID="e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8" Jun 03 22:56:03.488456 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.488441 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8"} err="failed to get container status \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": rpc error: code = NotFound desc = could not find container \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": container with ID starting with e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8 not found: ID does not exist" Jun 03 22:56:03.488493 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.488457 2561 scope.go:117] "RemoveContainer" containerID="9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf" Jun 03 22:56:03.488661 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.488640 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf"} err="failed to get container status \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": rpc error: code = NotFound desc = could not find container \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": container with ID starting with 9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf not found: ID does not exist" Jun 03 22:56:03.488698 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.488662 2561 scope.go:117] "RemoveContainer" containerID="f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f" Jun 03 22:56:03.488871 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.488857 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f"} err="failed to get container status \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": rpc error: code = NotFound desc = could not find container \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": container with ID starting with f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f not found: ID does not exist" Jun 03 22:56:03.488909 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.488871 2561 scope.go:117] "RemoveContainer" containerID="a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0" Jun 03 22:56:03.489077 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.489060 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0"} err="failed to get container status \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": rpc error: code = NotFound desc = could not find container \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": container with ID starting with a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0 not found: ID does not exist" Jun 03 22:56:03.489113 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.489078 2561 scope.go:117] "RemoveContainer" containerID="d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09" Jun 03 22:56:03.489339 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.489321 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09"} err="failed to get container status \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": rpc error: code = NotFound desc = could not find container \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": container with ID starting with d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09 not found: ID does not exist" Jun 03 22:56:03.489377 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.489340 2561 scope.go:117] "RemoveContainer" containerID="d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d" Jun 03 22:56:03.489528 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.489509 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d"} err="failed to get container status \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": rpc error: code = NotFound desc = could not find container \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": container with ID starting with d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d not found: ID does not exist" Jun 03 22:56:03.489599 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.489530 2561 scope.go:117] "RemoveContainer" containerID="03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2" Jun 03 22:56:03.489743 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.489723 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2"} err="failed to get container status \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": rpc error: code = NotFound desc = could not find container \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": container with ID starting with 03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2 not found: ID does not exist" Jun 03 22:56:03.489783 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.489744 2561 scope.go:117] "RemoveContainer" containerID="e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8" Jun 03 22:56:03.489925 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.489909 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8"} err="failed to get container status \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": rpc error: code = NotFound desc = could not find container \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": container with ID starting with e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8 not found: ID does not exist" Jun 03 22:56:03.489966 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.489925 2561 scope.go:117] "RemoveContainer" containerID="9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf" Jun 03 22:56:03.490107 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.490091 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf"} err="failed to get container status \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": rpc error: code = NotFound desc = could not find container \"9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf\": container with ID starting with 9e46832bcc2d7a8ced52a5031a4a4b3675b071a7eb2052415e7e1ba81d5d20cf not found: ID does not exist" Jun 03 22:56:03.490147 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.490106 2561 scope.go:117] "RemoveContainer" containerID="f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f" Jun 03 22:56:03.490296 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.490279 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f"} err="failed to get container status \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": rpc error: code = NotFound desc = could not find container \"f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f\": container with ID starting with f37f63b5c7222c007a141fbac23f3d2e9f8dbf88ada693cd0952689d9477554f not found: ID does not exist" Jun 03 22:56:03.490343 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.490295 2561 scope.go:117] "RemoveContainer" containerID="a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0" Jun 03 22:56:03.490477 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.490453 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0"} err="failed to get container status \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": rpc error: code = NotFound desc = could not find container \"a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0\": container with ID starting with a820682dbd04ab27f0f060ec5f62572245ee0960ddd9677e53d190e9c8a573c0 not found: ID does not exist" Jun 03 22:56:03.490528 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.490481 2561 scope.go:117] "RemoveContainer" containerID="d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09" Jun 03 22:56:03.490699 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.490683 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09"} err="failed to get container status \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": rpc error: code = NotFound desc = could not find container \"d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09\": container with ID starting with d08b6a2684d910d6e82586f617732e0e2a2a09b38dc4cb08f67828c4a2967b09 not found: ID does not exist" Jun 03 22:56:03.490742 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.490699 2561 scope.go:117] "RemoveContainer" containerID="d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d" Jun 03 22:56:03.490889 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.490875 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d"} err="failed to get container status \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": rpc error: code = NotFound desc = could not find container \"d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d\": container with ID starting with d055910b539b7d15593c8e767d73b1e9e34371a3690ab536458e64373b18453d not found: ID does not exist" Jun 03 22:56:03.490931 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.490889 2561 scope.go:117] "RemoveContainer" containerID="03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2" Jun 03 22:56:03.491090 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.491071 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2"} err="failed to get container status \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": rpc error: code = NotFound desc = could not find container \"03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2\": container with ID starting with 03e398ae09243626cbf93b64901339eed841b1f2cffaf421ac4a73025b9b80a2 not found: ID does not exist" Jun 03 22:56:03.491130 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.491090 2561 scope.go:117] "RemoveContainer" containerID="e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8" Jun 03 22:56:03.491290 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.491273 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8"} err="failed to get container status \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": rpc error: code = NotFound desc = could not find container \"e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8\": container with ID starting with e2554033441b506d5b9a6ec611aec60d59a709ed15d8896a51d9cad7160737a8 not found: ID does not exist" Jun 03 22:56:03.541869 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.541846 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:56:03.542154 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542142 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="888eb6f0-3c3c-4e89-820a-989da94a35e4" containerName="registry" Jun 03 22:56:03.542195 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542156 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="888eb6f0-3c3c-4e89-820a-989da94a35e4" containerName="registry" Jun 03 22:56:03.542195 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542166 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="thanos-sidecar" Jun 03 22:56:03.542195 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542171 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="thanos-sidecar" Jun 03 22:56:03.542195 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542178 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="config-reloader" Jun 03 22:56:03.542195 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542184 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="config-reloader" Jun 03 22:56:03.542195 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542191 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="kube-rbac-proxy-web" Jun 03 22:56:03.542195 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542196 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="kube-rbac-proxy-web" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542204 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="prometheus" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542222 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="prometheus" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542233 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="kube-rbac-proxy-thanos" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542242 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="kube-rbac-proxy-thanos" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542257 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="kube-rbac-proxy" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542262 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="kube-rbac-proxy" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542270 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="init-config-reloader" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542274 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="init-config-reloader" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542322 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="kube-rbac-proxy" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542329 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="prometheus" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542336 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="thanos-sidecar" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542342 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="kube-rbac-proxy-thanos" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542348 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="888eb6f0-3c3c-4e89-820a-989da94a35e4" containerName="registry" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542352 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="config-reloader" Jun 03 22:56:03.542419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.542358 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" containerName="kube-rbac-proxy-web" Jun 03 22:56:03.545736 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.545721 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.555322 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.555302 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 22:56:03.555401 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.555311 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 22:56:03.555757 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.555735 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 22:56:03.555886 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.555734 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 22:56:03.555886 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.555735 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 22:56:03.555886 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.555853 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 22:56:03.556068 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.555942 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 22:56:03.556144 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.556132 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 22:56:03.556196 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.556171 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qs8pb\"" Jun 03 22:56:03.556382 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.556365 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 22:56:03.556468 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.556440 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 22:56:03.556468 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.556455 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d4d0qd1ivjbum\"" Jun 03 22:56:03.556661 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.556646 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 22:56:03.558023 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.558010 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 22:56:03.560044 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.560030 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 22:56:03.564645 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.564628 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 22:56:03.588455 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.588429 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:56:03.618878 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.618859 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.618967 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.618885 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.618967 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.618901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-config\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.618967 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.618916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619089 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.618961 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619089 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619013 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619089 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619089 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619069 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619243 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619243 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619243 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6bec3036-33ac-435d-90dd-0acc4c3c9581-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619243 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619243 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6bec3036-33ac-435d-90dd-0acc4c3c9581-config-out\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-web-config\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619265 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwzbn\" (UniqueName: \"kubernetes.io/projected/6bec3036-33ac-435d-90dd-0acc4c3c9581-kube-api-access-hwzbn\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619282 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619303 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619354 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.619419 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.619391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.720582 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.720519 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.720582 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.720544 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.720582 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.720561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.720582 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.720583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.720891 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.720869 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.720952 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.720910 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-config\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.720952 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.720941 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.721057 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.720979 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.721057 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.721057 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.721237 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721068 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.721237 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.721237 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721116 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.721237 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6bec3036-33ac-435d-90dd-0acc4c3c9581-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.721237 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.721237 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6bec3036-33ac-435d-90dd-0acc4c3c9581-config-out\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.722150 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-web-config\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.722150 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.722150 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721276 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwzbn\" (UniqueName: \"kubernetes.io/projected/6bec3036-33ac-435d-90dd-0acc4c3c9581-kube-api-access-hwzbn\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.722150 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.722150 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.722150 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.721594 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.722477 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.722327 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.722730 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.722701 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.722809 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.722754 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.725822 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.723626 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.725822 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.723865 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.725822 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.723872 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.725822 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.725487 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-config\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.725822 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.725542 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.725822 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.725693 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.725822 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.725753 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.725822 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.725758 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.726319 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.726015 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6bec3036-33ac-435d-90dd-0acc4c3c9581-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.726378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.726348 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.726437 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.726389 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-web-config\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.726683 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.726659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6bec3036-33ac-435d-90dd-0acc4c3c9581-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.726873 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.726856 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6bec3036-33ac-435d-90dd-0acc4c3c9581-config-out\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.727115 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.727100 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6bec3036-33ac-435d-90dd-0acc4c3c9581-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.737506 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.737484 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwzbn\" (UniqueName: \"kubernetes.io/projected/6bec3036-33ac-435d-90dd-0acc4c3c9581-kube-api-access-hwzbn\") pod \"prometheus-k8s-0\" (UID: \"6bec3036-33ac-435d-90dd-0acc4c3c9581\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:03.854682 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:03.854664 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:56:04.014621 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:56:04.014590 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bec3036_33ac_435d_90dd_0acc4c3c9581.slice/crio-e132d3a7260332c17d73bfbc2c517c67e2f8ea7edd7053a49141cda7e7d0869a WatchSource:0}: Error finding container e132d3a7260332c17d73bfbc2c517c67e2f8ea7edd7053a49141cda7e7d0869a: Status 404 returned error can't find the container with id e132d3a7260332c17d73bfbc2c517c67e2f8ea7edd7053a49141cda7e7d0869a Jun 03 22:56:04.015802 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:04.015779 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:56:04.245088 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:04.245061 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e40a94de-6ee2-42ea-bb4f-390a946368c4" path="/var/lib/kubelet/pods/e40a94de-6ee2-42ea-bb4f-390a946368c4/volumes" Jun 03 22:56:04.432593 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:04.432566 2561 generic.go:356] "Generic (PLEG): container finished" podID="6bec3036-33ac-435d-90dd-0acc4c3c9581" containerID="9e35a4c8a46723dc7e932fc11c7b9ce0403427a4a7174e508993378333094f92" exitCode=0 Jun 03 22:56:04.432724 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:04.432649 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6bec3036-33ac-435d-90dd-0acc4c3c9581","Type":"ContainerDied","Data":"9e35a4c8a46723dc7e932fc11c7b9ce0403427a4a7174e508993378333094f92"} Jun 03 22:56:04.432813 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:04.432731 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6bec3036-33ac-435d-90dd-0acc4c3c9581","Type":"ContainerStarted","Data":"e132d3a7260332c17d73bfbc2c517c67e2f8ea7edd7053a49141cda7e7d0869a"} Jun 03 22:56:05.441417 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:05.441377 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6bec3036-33ac-435d-90dd-0acc4c3c9581","Type":"ContainerStarted","Data":"f7897f9e2c5f19d43036a9f82c6d78db5e0a74702ef614ffae5be7ee3de1a52f"} Jun 03 22:56:05.441862 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:05.441496 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6bec3036-33ac-435d-90dd-0acc4c3c9581","Type":"ContainerStarted","Data":"8f265f50f9b7d315ae6f428aa7fb1139d7c8722012bcdf44ab02931dbc9d84fa"} Jun 03 22:56:05.441862 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:05.441542 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6bec3036-33ac-435d-90dd-0acc4c3c9581","Type":"ContainerStarted","Data":"c37fdc3c2408277835ccd92e0ad0114ed0604bf6fa9273f17187f0a3263e4a7e"} Jun 03 22:56:05.441862 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:05.441584 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6bec3036-33ac-435d-90dd-0acc4c3c9581","Type":"ContainerStarted","Data":"e878765ac9ba4dcda98f5d2462767c1f77c1de6add09b361689bc76efb18653d"} Jun 03 22:56:05.441862 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:05.441622 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6bec3036-33ac-435d-90dd-0acc4c3c9581","Type":"ContainerStarted","Data":"9a7d5cc221658c2336acf4237bbeb20d5e542d7e1d73276776c8c966803c34bd"} Jun 03 22:56:05.441862 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:05.441677 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6bec3036-33ac-435d-90dd-0acc4c3c9581","Type":"ContainerStarted","Data":"4e3a6fb1b80d12525314a8734943598e283f8aa933e0989cbbbfb0c87c8508e0"} Jun 03 22:56:08.855596 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:56:08.855518 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:57:03.854968 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:57:03.854925 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:57:03.870738 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:57:03.870710 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:57:03.911427 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:57:03.911377 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=60.893429702 podStartE2EDuration="1m0.911363111s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.933409ms" isStatefulPod=false podCreationTimestamp="2026-06-03 22:56:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:56:05.55201088 +0000 UTC m=+345.749033761" watchObservedRunningTime="2026-06-03 22:57:03.911363111 +0000 UTC m=+404.108386008" Jun 03 22:57:04.687684 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:57:04.687607 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:58:33.965596 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:33.965564 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk"] Jun 03 22:58:33.967713 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:33.967685 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk" Jun 03 22:58:33.971696 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:33.971679 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 22:58:33.972022 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:33.972008 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 22:58:33.972082 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:33.972044 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-scknn\"" Jun 03 22:58:33.981384 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:33.981359 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk"] Jun 03 22:58:34.068455 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:34.068421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c9bba1c-d336-45ab-9fa7-a5fe005cfaba-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zqrqk\" (UID: \"2c9bba1c-d336-45ab-9fa7-a5fe005cfaba\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk" Jun 03 22:58:34.068589 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:34.068480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb9mr\" (UniqueName: \"kubernetes.io/projected/2c9bba1c-d336-45ab-9fa7-a5fe005cfaba-kube-api-access-sb9mr\") pod \"cert-manager-cainjector-5d99449ffd-zqrqk\" (UID: \"2c9bba1c-d336-45ab-9fa7-a5fe005cfaba\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk" Jun 03 22:58:34.168951 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:34.168926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb9mr\" (UniqueName: \"kubernetes.io/projected/2c9bba1c-d336-45ab-9fa7-a5fe005cfaba-kube-api-access-sb9mr\") pod \"cert-manager-cainjector-5d99449ffd-zqrqk\" (UID: \"2c9bba1c-d336-45ab-9fa7-a5fe005cfaba\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk" Jun 03 22:58:34.169048 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:34.168977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c9bba1c-d336-45ab-9fa7-a5fe005cfaba-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zqrqk\" (UID: \"2c9bba1c-d336-45ab-9fa7-a5fe005cfaba\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk" Jun 03 22:58:34.180675 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:34.180646 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c9bba1c-d336-45ab-9fa7-a5fe005cfaba-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zqrqk\" (UID: \"2c9bba1c-d336-45ab-9fa7-a5fe005cfaba\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk" Jun 03 22:58:34.181760 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:34.181742 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb9mr\" (UniqueName: \"kubernetes.io/projected/2c9bba1c-d336-45ab-9fa7-a5fe005cfaba-kube-api-access-sb9mr\") pod \"cert-manager-cainjector-5d99449ffd-zqrqk\" (UID: \"2c9bba1c-d336-45ab-9fa7-a5fe005cfaba\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk" Jun 03 22:58:34.288857 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:34.288831 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk" Jun 03 22:58:34.412540 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:34.412515 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk"] Jun 03 22:58:34.415097 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:58:34.415070 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c9bba1c_d336_45ab_9fa7_a5fe005cfaba.slice/crio-d5725522bb5ae73e0aba7f6a11349f4c305a2d6b49ab410ad5c28c93a0fbd8c0 WatchSource:0}: Error finding container d5725522bb5ae73e0aba7f6a11349f4c305a2d6b49ab410ad5c28c93a0fbd8c0: Status 404 returned error can't find the container with id d5725522bb5ae73e0aba7f6a11349f4c305a2d6b49ab410ad5c28c93a0fbd8c0 Jun 03 22:58:34.417071 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:34.417054 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 22:58:35.036129 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:35.036088 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk" event={"ID":"2c9bba1c-d336-45ab-9fa7-a5fe005cfaba","Type":"ContainerStarted","Data":"d5725522bb5ae73e0aba7f6a11349f4c305a2d6b49ab410ad5c28c93a0fbd8c0"} Jun 03 22:58:38.051267 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:38.051182 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk" event={"ID":"2c9bba1c-d336-45ab-9fa7-a5fe005cfaba","Type":"ContainerStarted","Data":"d8a2321a8ea1d40b1f0b407d8b916857e670c19b477c271a488bf3961612beb4"} Jun 03 22:58:38.067670 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:38.067620 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zqrqk" podStartSLOduration=1.740615826 podStartE2EDuration="5.067603931s" totalImagesPullingTime="3.326988105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:58:38.067036511 +0000 UTC m=+498.264059373" watchObservedRunningTime="2026-06-03 22:58:38.067603931 +0000 UTC m=+498.264626803" Jun 03 22:58:57.441724 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.441693 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp"] Jun 03 22:58:57.448352 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.448331 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.450476 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.450451 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 22:58:57.450595 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.450577 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 22:58:57.450905 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.450888 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x5fz4\"" Jun 03 22:58:57.450905 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.450902 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 22:58:57.451031 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.450917 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 22:58:57.451031 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.450920 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 22:58:57.459023 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.459005 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp"] Jun 03 22:58:57.546225 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.546187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5583a325-1335-48bc-b51e-077aae784b8c-metrics-cert\") pod \"lws-controller-manager-747dfb677c-ffdcp\" (UID: \"5583a325-1335-48bc-b51e-077aae784b8c\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.546401 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.546310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5583a325-1335-48bc-b51e-077aae784b8c-manager-config\") pod \"lws-controller-manager-747dfb677c-ffdcp\" (UID: \"5583a325-1335-48bc-b51e-077aae784b8c\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.546401 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.546374 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5583a325-1335-48bc-b51e-077aae784b8c-cert\") pod \"lws-controller-manager-747dfb677c-ffdcp\" (UID: \"5583a325-1335-48bc-b51e-077aae784b8c\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.546487 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.546425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4qnq\" (UniqueName: \"kubernetes.io/projected/5583a325-1335-48bc-b51e-077aae784b8c-kube-api-access-m4qnq\") pod \"lws-controller-manager-747dfb677c-ffdcp\" (UID: \"5583a325-1335-48bc-b51e-077aae784b8c\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.647734 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.647704 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qnq\" (UniqueName: \"kubernetes.io/projected/5583a325-1335-48bc-b51e-077aae784b8c-kube-api-access-m4qnq\") pod \"lws-controller-manager-747dfb677c-ffdcp\" (UID: \"5583a325-1335-48bc-b51e-077aae784b8c\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.647875 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.647747 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5583a325-1335-48bc-b51e-077aae784b8c-metrics-cert\") pod \"lws-controller-manager-747dfb677c-ffdcp\" (UID: \"5583a325-1335-48bc-b51e-077aae784b8c\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.647875 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.647785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5583a325-1335-48bc-b51e-077aae784b8c-manager-config\") pod \"lws-controller-manager-747dfb677c-ffdcp\" (UID: \"5583a325-1335-48bc-b51e-077aae784b8c\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.647875 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.647804 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5583a325-1335-48bc-b51e-077aae784b8c-cert\") pod \"lws-controller-manager-747dfb677c-ffdcp\" (UID: \"5583a325-1335-48bc-b51e-077aae784b8c\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.648535 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.648515 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5583a325-1335-48bc-b51e-077aae784b8c-manager-config\") pod \"lws-controller-manager-747dfb677c-ffdcp\" (UID: \"5583a325-1335-48bc-b51e-077aae784b8c\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.650493 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.650462 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5583a325-1335-48bc-b51e-077aae784b8c-metrics-cert\") pod \"lws-controller-manager-747dfb677c-ffdcp\" (UID: \"5583a325-1335-48bc-b51e-077aae784b8c\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.650579 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.650509 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5583a325-1335-48bc-b51e-077aae784b8c-cert\") pod \"lws-controller-manager-747dfb677c-ffdcp\" (UID: \"5583a325-1335-48bc-b51e-077aae784b8c\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.655972 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.655950 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4qnq\" (UniqueName: \"kubernetes.io/projected/5583a325-1335-48bc-b51e-077aae784b8c-kube-api-access-m4qnq\") pod \"lws-controller-manager-747dfb677c-ffdcp\" (UID: \"5583a325-1335-48bc-b51e-077aae784b8c\") " pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.757087 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.757060 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:58:57.893645 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:57.893529 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp"] Jun 03 22:58:57.895785 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:58:57.895756 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5583a325_1335_48bc_b51e_077aae784b8c.slice/crio-87cc4b01ce5554c0d04664dee6fdd1e149d3fb800579f98f6fa4f56585bc1ccd WatchSource:0}: Error finding container 87cc4b01ce5554c0d04664dee6fdd1e149d3fb800579f98f6fa4f56585bc1ccd: Status 404 returned error can't find the container with id 87cc4b01ce5554c0d04664dee6fdd1e149d3fb800579f98f6fa4f56585bc1ccd Jun 03 22:58:58.134870 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:58:58.134778 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" event={"ID":"5583a325-1335-48bc-b51e-077aae784b8c","Type":"ContainerStarted","Data":"87cc4b01ce5554c0d04664dee6fdd1e149d3fb800579f98f6fa4f56585bc1ccd"} Jun 03 22:59:01.151193 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:01.151157 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" event={"ID":"5583a325-1335-48bc-b51e-077aae784b8c","Type":"ContainerStarted","Data":"01b8d6d4f4b98391c53b05b874de246821f2c50140b008204894818369f7cba1"} Jun 03 22:59:01.151631 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:01.151352 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:59:01.167827 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:01.167781 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" podStartSLOduration=1.495183076 podStartE2EDuration="4.167766703s" totalImagesPullingTime="2.672583627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:59:01.166062976 +0000 UTC m=+521.363085843" watchObservedRunningTime="2026-06-03 22:59:01.167766703 +0000 UTC m=+521.364789624" Jun 03 22:59:08.160982 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.160907 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb"] Jun 03 22:59:08.164485 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.164466 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.166657 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.166633 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 22:59:08.166878 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.166850 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cq2pv\"" Jun 03 22:59:08.166998 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.166908 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 22:59:08.166998 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.166908 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 22:59:08.167105 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.167055 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 22:59:08.228602 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.228569 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb"] Jun 03 22:59:08.235600 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.235575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26fde37d-7c3f-47c9-a669-384a5b0fd498-webhook-cert\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.235735 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.235620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnjjt\" (UniqueName: \"kubernetes.io/projected/26fde37d-7c3f-47c9-a669-384a5b0fd498-kube-api-access-xnjjt\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.235735 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.235648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26fde37d-7c3f-47c9-a669-384a5b0fd498-tmp\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.235735 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.235720 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26fde37d-7c3f-47c9-a669-384a5b0fd498-manifests\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.235844 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.235759 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26fde37d-7c3f-47c9-a669-384a5b0fd498-apiservice-cert\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.337020 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.336990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26fde37d-7c3f-47c9-a669-384a5b0fd498-webhook-cert\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.337167 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.337043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnjjt\" (UniqueName: \"kubernetes.io/projected/26fde37d-7c3f-47c9-a669-384a5b0fd498-kube-api-access-xnjjt\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.337167 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.337083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26fde37d-7c3f-47c9-a669-384a5b0fd498-tmp\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.337167 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.337110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26fde37d-7c3f-47c9-a669-384a5b0fd498-manifests\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.337324 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.337256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26fde37d-7c3f-47c9-a669-384a5b0fd498-apiservice-cert\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.337584 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.337561 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26fde37d-7c3f-47c9-a669-384a5b0fd498-manifests\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.339656 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.339635 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26fde37d-7c3f-47c9-a669-384a5b0fd498-tmp\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.339730 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.339712 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26fde37d-7c3f-47c9-a669-384a5b0fd498-apiservice-cert\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.339769 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.339747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26fde37d-7c3f-47c9-a669-384a5b0fd498-webhook-cert\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.350108 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.350074 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnjjt\" (UniqueName: \"kubernetes.io/projected/26fde37d-7c3f-47c9-a669-384a5b0fd498-kube-api-access-xnjjt\") pod \"opendatahub-operator-controller-manager-967f449d5-lgkjb\" (UID: \"26fde37d-7c3f-47c9-a669-384a5b0fd498\") " pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.475279 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.475197 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:08.612304 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:08.612271 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb"] Jun 03 22:59:08.616108 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:59:08.616079 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fde37d_7c3f_47c9_a669_384a5b0fd498.slice/crio-55cbba6ab745d31a0c12011e3650741eaa78c1d24272fbbfd678b7aa45d4b0ed WatchSource:0}: Error finding container 55cbba6ab745d31a0c12011e3650741eaa78c1d24272fbbfd678b7aa45d4b0ed: Status 404 returned error can't find the container with id 55cbba6ab745d31a0c12011e3650741eaa78c1d24272fbbfd678b7aa45d4b0ed Jun 03 22:59:09.184892 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:09.184848 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" event={"ID":"26fde37d-7c3f-47c9-a669-384a5b0fd498","Type":"ContainerStarted","Data":"55cbba6ab745d31a0c12011e3650741eaa78c1d24272fbbfd678b7aa45d4b0ed"} Jun 03 22:59:12.157996 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:12.157969 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-747dfb677c-ffdcp" Jun 03 22:59:12.202424 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:12.202389 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" event={"ID":"26fde37d-7c3f-47c9-a669-384a5b0fd498","Type":"ContainerStarted","Data":"af88c50efeb1ee38579198e7c902e434ef519a8dcd2460987f8f44492fe5e54e"} Jun 03 22:59:13.208528 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:13.208491 2561 generic.go:356] "Generic (PLEG): container finished" podID="26fde37d-7c3f-47c9-a669-384a5b0fd498" containerID="af88c50efeb1ee38579198e7c902e434ef519a8dcd2460987f8f44492fe5e54e" exitCode=0 Jun 03 22:59:13.208935 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:13.208579 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" event={"ID":"26fde37d-7c3f-47c9-a669-384a5b0fd498","Type":"ContainerDied","Data":"af88c50efeb1ee38579198e7c902e434ef519a8dcd2460987f8f44492fe5e54e"} Jun 03 22:59:14.214949 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:14.214915 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" event={"ID":"26fde37d-7c3f-47c9-a669-384a5b0fd498","Type":"ContainerStarted","Data":"e3f1d005a187c245780f3d8feed62773e97e339c07e285170b56bff5e2e60b32"} Jun 03 22:59:14.215378 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:14.215066 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:14.234580 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:14.234534 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" podStartSLOduration=2.082705602 podStartE2EDuration="6.234520757s" totalImagesPullingTime="3.198894234s" totalInitContainerRuntime="952.920921ms" isStatefulPod=false podCreationTimestamp="2026-06-03 22:59:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:59:14.234148127 +0000 UTC m=+534.431171017" watchObservedRunningTime="2026-06-03 22:59:14.234520757 +0000 UTC m=+534.431543647" Jun 03 22:59:25.221076 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:25.221046 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-967f449d5-lgkjb" Jun 03 22:59:27.495997 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.495957 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f59d86b67-2f857"] Jun 03 22:59:27.505371 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.505346 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" Jun 03 22:59:27.508888 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.508844 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 22:59:27.509156 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.509136 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 22:59:27.509488 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.509459 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 22:59:27.510432 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.510272 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-n2sjq\"" Jun 03 22:59:27.510589 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.510469 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 22:59:27.511996 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.511976 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f59d86b67-2f857"] Jun 03 22:59:27.599465 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.599431 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z84v8\" (UniqueName: \"kubernetes.io/projected/29540219-0f24-41c0-9b11-815539a1a4e7-kube-api-access-z84v8\") pod \"kube-auth-proxy-7f59d86b67-2f857\" (UID: \"29540219-0f24-41c0-9b11-815539a1a4e7\") " pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" Jun 03 22:59:27.599643 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.599521 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29540219-0f24-41c0-9b11-815539a1a4e7-tmp\") pod \"kube-auth-proxy-7f59d86b67-2f857\" (UID: \"29540219-0f24-41c0-9b11-815539a1a4e7\") " pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" Jun 03 22:59:27.599643 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.599545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29540219-0f24-41c0-9b11-815539a1a4e7-tls-certs\") pod \"kube-auth-proxy-7f59d86b67-2f857\" (UID: \"29540219-0f24-41c0-9b11-815539a1a4e7\") " pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" Jun 03 22:59:27.700099 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.700055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z84v8\" (UniqueName: \"kubernetes.io/projected/29540219-0f24-41c0-9b11-815539a1a4e7-kube-api-access-z84v8\") pod \"kube-auth-proxy-7f59d86b67-2f857\" (UID: \"29540219-0f24-41c0-9b11-815539a1a4e7\") " pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" Jun 03 22:59:27.700350 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.700298 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29540219-0f24-41c0-9b11-815539a1a4e7-tmp\") pod \"kube-auth-proxy-7f59d86b67-2f857\" (UID: \"29540219-0f24-41c0-9b11-815539a1a4e7\") " pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" Jun 03 22:59:27.700350 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.700333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29540219-0f24-41c0-9b11-815539a1a4e7-tls-certs\") pod \"kube-auth-proxy-7f59d86b67-2f857\" (UID: \"29540219-0f24-41c0-9b11-815539a1a4e7\") " pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" Jun 03 22:59:27.702828 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.702801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29540219-0f24-41c0-9b11-815539a1a4e7-tmp\") pod \"kube-auth-proxy-7f59d86b67-2f857\" (UID: \"29540219-0f24-41c0-9b11-815539a1a4e7\") " pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" Jun 03 22:59:27.702960 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.702940 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29540219-0f24-41c0-9b11-815539a1a4e7-tls-certs\") pod \"kube-auth-proxy-7f59d86b67-2f857\" (UID: \"29540219-0f24-41c0-9b11-815539a1a4e7\") " pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" Jun 03 22:59:27.712059 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.712032 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z84v8\" (UniqueName: \"kubernetes.io/projected/29540219-0f24-41c0-9b11-815539a1a4e7-kube-api-access-z84v8\") pod \"kube-auth-proxy-7f59d86b67-2f857\" (UID: \"29540219-0f24-41c0-9b11-815539a1a4e7\") " pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" Jun 03 22:59:27.818625 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.818540 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" Jun 03 22:59:27.975290 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:27.975245 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f59d86b67-2f857"] Jun 03 22:59:27.977842 ip-10-0-143-45 kubenswrapper[2561]: W0603 22:59:27.977815 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29540219_0f24_41c0_9b11_815539a1a4e7.slice/crio-0c5009c89eda546f7d17ca79b453fd0034bd6450b3bdebac965303de468b88c2 WatchSource:0}: Error finding container 0c5009c89eda546f7d17ca79b453fd0034bd6450b3bdebac965303de468b88c2: Status 404 returned error can't find the container with id 0c5009c89eda546f7d17ca79b453fd0034bd6450b3bdebac965303de468b88c2 Jun 03 22:59:28.274504 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:28.274468 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" event={"ID":"29540219-0f24-41c0-9b11-815539a1a4e7","Type":"ContainerStarted","Data":"0c5009c89eda546f7d17ca79b453fd0034bd6450b3bdebac965303de468b88c2"} Jun 03 22:59:31.290571 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:31.290536 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" event={"ID":"29540219-0f24-41c0-9b11-815539a1a4e7","Type":"ContainerStarted","Data":"758ac205abb2154940dd95bd31052611c1e47854ffd048684b63f8ba746b9031"} Jun 03 22:59:31.306622 ip-10-0-143-45 kubenswrapper[2561]: I0603 22:59:31.306578 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f59d86b67-2f857" podStartSLOduration=1.6234044650000001 podStartE2EDuration="4.306562433s" totalImagesPullingTime="2.683157968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:59:31.305038622 +0000 UTC m=+551.502061492" watchObservedRunningTime="2026-06-03 22:59:31.306562433 +0000 UTC m=+551.503585301" Jun 03 23:00:20.220621 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:00:20.220588 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:00:20.222199 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:00:20.222180 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:00:20.223637 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:00:20.223620 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:00:20.224987 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:00:20.224967 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:01:02.951818 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:02.951734 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z"] Jun 03 23:01:02.955357 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:02.955341 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" Jun 03 23:01:02.957538 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:02.957519 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 23:01:02.957782 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:02.957761 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 23:01:02.957782 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:02.957769 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7cn94\"" Jun 03 23:01:02.971982 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:02.971961 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z"] Jun 03 23:01:03.089478 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:03.089446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtrrn\" (UniqueName: \"kubernetes.io/projected/8b0a611f-cb44-4017-b265-ed26e8696c94-kube-api-access-dtrrn\") pod \"limitador-operator-controller-manager-859d7b78bd-j2s5z\" (UID: \"8b0a611f-cb44-4017-b265-ed26e8696c94\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" Jun 03 23:01:03.190600 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:03.190570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrrn\" (UniqueName: \"kubernetes.io/projected/8b0a611f-cb44-4017-b265-ed26e8696c94-kube-api-access-dtrrn\") pod \"limitador-operator-controller-manager-859d7b78bd-j2s5z\" (UID: \"8b0a611f-cb44-4017-b265-ed26e8696c94\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" Jun 03 23:01:03.204937 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:03.204864 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtrrn\" (UniqueName: \"kubernetes.io/projected/8b0a611f-cb44-4017-b265-ed26e8696c94-kube-api-access-dtrrn\") pod \"limitador-operator-controller-manager-859d7b78bd-j2s5z\" (UID: \"8b0a611f-cb44-4017-b265-ed26e8696c94\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" Jun 03 23:01:03.265906 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:03.265879 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" Jun 03 23:01:03.407438 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:03.407417 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z"] Jun 03 23:01:03.409488 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:01:03.409457 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0a611f_cb44_4017_b265_ed26e8696c94.slice/crio-e5d71640e8b455acef1a76f680ef37d249d00f4d2dd70bc2a51b7916bd3d8eb2 WatchSource:0}: Error finding container e5d71640e8b455acef1a76f680ef37d249d00f4d2dd70bc2a51b7916bd3d8eb2: Status 404 returned error can't find the container with id e5d71640e8b455acef1a76f680ef37d249d00f4d2dd70bc2a51b7916bd3d8eb2 Jun 03 23:01:03.684539 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:03.684509 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" event={"ID":"8b0a611f-cb44-4017-b265-ed26e8696c94","Type":"ContainerStarted","Data":"e5d71640e8b455acef1a76f680ef37d249d00f4d2dd70bc2a51b7916bd3d8eb2"} Jun 03 23:01:05.697144 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:05.697056 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" event={"ID":"8b0a611f-cb44-4017-b265-ed26e8696c94","Type":"ContainerStarted","Data":"f595314f8ed6d43d9030ca78e82b5c59f0359daf9f5df2f0cc962376682db0cd"} Jun 03 23:01:05.697518 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:05.697187 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" Jun 03 23:01:05.724398 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:05.724357 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" podStartSLOduration=1.8859356489999999 podStartE2EDuration="3.724344136s" totalImagesPullingTime="1.838408487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:01:05.723832395 +0000 UTC m=+645.920855263" watchObservedRunningTime="2026-06-03 23:01:05.724344136 +0000 UTC m=+645.921367078" Jun 03 23:01:16.704289 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:16.704255 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" Jun 03 23:01:17.969938 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:17.969905 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z"] Jun 03 23:01:17.970362 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:17.970110 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" podUID="8b0a611f-cb44-4017-b265-ed26e8696c94" containerName="manager" containerID="cri-o://f595314f8ed6d43d9030ca78e82b5c59f0359daf9f5df2f0cc962376682db0cd" gracePeriod=2 Jun 03 23:01:17.975358 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:17.975335 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z"] Jun 03 23:01:17.986504 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:17.986484 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5"] Jun 03 23:01:17.986877 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:17.986864 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0a611f-cb44-4017-b265-ed26e8696c94" containerName="manager" Jun 03 23:01:17.986922 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:17.986878 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0a611f-cb44-4017-b265-ed26e8696c94" containerName="manager" Jun 03 23:01:17.986958 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:17.986933 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b0a611f-cb44-4017-b265-ed26e8696c94" containerName="manager" Jun 03 23:01:17.989902 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:17.989885 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" Jun 03 23:01:17.991994 ip-10-0-143-45 kubenswrapper[2561]: E0603 23:01:17.991960 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j2s5z\" is forbidden: User \"system:node:ip-10-0-143-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-45.ec2.internal' and this object" podUID="8b0a611f-cb44-4017-b265-ed26e8696c94" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" Jun 03 23:01:17.992789 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:17.992771 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nckxq\"" Jun 03 23:01:18.016573 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.016536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f12413f-3c36-4d17-a0f3-ee5b5239d640-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lzzs5\" (UID: \"0f12413f-3c36-4d17-a0f3-ee5b5239d640\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" Jun 03 23:01:18.016711 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.016576 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtntv\" (UniqueName: \"kubernetes.io/projected/0f12413f-3c36-4d17-a0f3-ee5b5239d640-kube-api-access-rtntv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lzzs5\" (UID: \"0f12413f-3c36-4d17-a0f3-ee5b5239d640\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" Jun 03 23:01:18.025280 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.025174 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5"] Jun 03 23:01:18.117490 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.117458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f12413f-3c36-4d17-a0f3-ee5b5239d640-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lzzs5\" (UID: \"0f12413f-3c36-4d17-a0f3-ee5b5239d640\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" Jun 03 23:01:18.117644 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.117499 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtntv\" (UniqueName: \"kubernetes.io/projected/0f12413f-3c36-4d17-a0f3-ee5b5239d640-kube-api-access-rtntv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lzzs5\" (UID: \"0f12413f-3c36-4d17-a0f3-ee5b5239d640\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" Jun 03 23:01:18.117826 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.117800 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f12413f-3c36-4d17-a0f3-ee5b5239d640-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lzzs5\" (UID: \"0f12413f-3c36-4d17-a0f3-ee5b5239d640\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" Jun 03 23:01:18.136311 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.136280 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtntv\" (UniqueName: \"kubernetes.io/projected/0f12413f-3c36-4d17-a0f3-ee5b5239d640-kube-api-access-rtntv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lzzs5\" (UID: \"0f12413f-3c36-4d17-a0f3-ee5b5239d640\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" Jun 03 23:01:18.215102 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.215077 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" Jun 03 23:01:18.216868 ip-10-0-143-45 kubenswrapper[2561]: E0603 23:01:18.216844 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j2s5z\" is forbidden: User \"system:node:ip-10-0-143-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-45.ec2.internal' and this object" podUID="8b0a611f-cb44-4017-b265-ed26e8696c94" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" Jun 03 23:01:18.218088 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.218072 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtrrn\" (UniqueName: \"kubernetes.io/projected/8b0a611f-cb44-4017-b265-ed26e8696c94-kube-api-access-dtrrn\") pod \"8b0a611f-cb44-4017-b265-ed26e8696c94\" (UID: \"8b0a611f-cb44-4017-b265-ed26e8696c94\") " Jun 03 23:01:18.220238 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.220164 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b0a611f-cb44-4017-b265-ed26e8696c94-kube-api-access-dtrrn" (OuterVolumeSpecName: "kube-api-access-dtrrn") pod "8b0a611f-cb44-4017-b265-ed26e8696c94" (UID: "8b0a611f-cb44-4017-b265-ed26e8696c94"). InnerVolumeSpecName "kube-api-access-dtrrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:01:18.245623 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.245603 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b0a611f-cb44-4017-b265-ed26e8696c94" path="/var/lib/kubelet/pods/8b0a611f-cb44-4017-b265-ed26e8696c94/volumes" Jun 03 23:01:18.319262 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.319241 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtrrn\" (UniqueName: \"kubernetes.io/projected/8b0a611f-cb44-4017-b265-ed26e8696c94-kube-api-access-dtrrn\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 23:01:18.358184 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.358160 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" Jun 03 23:01:18.503175 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.503150 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5"] Jun 03 23:01:18.505820 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:01:18.505794 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f12413f_3c36_4d17_a0f3_ee5b5239d640.slice/crio-41f208e10ee0417dcf878fc91de2f5bdb258a888c455fc9bcd567f97812a59a0 WatchSource:0}: Error finding container 41f208e10ee0417dcf878fc91de2f5bdb258a888c455fc9bcd567f97812a59a0: Status 404 returned error can't find the container with id 41f208e10ee0417dcf878fc91de2f5bdb258a888c455fc9bcd567f97812a59a0 Jun 03 23:01:18.755718 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.755619 2561 generic.go:356] "Generic (PLEG): container finished" podID="8b0a611f-cb44-4017-b265-ed26e8696c94" containerID="f595314f8ed6d43d9030ca78e82b5c59f0359daf9f5df2f0cc962376682db0cd" exitCode=0 Jun 03 23:01:18.755718 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.755665 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2s5z" Jun 03 23:01:18.755718 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.755711 2561 scope.go:117] "RemoveContainer" containerID="f595314f8ed6d43d9030ca78e82b5c59f0359daf9f5df2f0cc962376682db0cd" Jun 03 23:01:18.757256 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.757190 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" event={"ID":"0f12413f-3c36-4d17-a0f3-ee5b5239d640","Type":"ContainerStarted","Data":"41f208e10ee0417dcf878fc91de2f5bdb258a888c455fc9bcd567f97812a59a0"} Jun 03 23:01:18.764125 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.764105 2561 scope.go:117] "RemoveContainer" containerID="f595314f8ed6d43d9030ca78e82b5c59f0359daf9f5df2f0cc962376682db0cd" Jun 03 23:01:18.764405 ip-10-0-143-45 kubenswrapper[2561]: E0603 23:01:18.764384 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f595314f8ed6d43d9030ca78e82b5c59f0359daf9f5df2f0cc962376682db0cd\": container with ID starting with f595314f8ed6d43d9030ca78e82b5c59f0359daf9f5df2f0cc962376682db0cd not found: ID does not exist" containerID="f595314f8ed6d43d9030ca78e82b5c59f0359daf9f5df2f0cc962376682db0cd" Jun 03 23:01:18.764462 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:18.764413 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f595314f8ed6d43d9030ca78e82b5c59f0359daf9f5df2f0cc962376682db0cd"} err="failed to get container status \"f595314f8ed6d43d9030ca78e82b5c59f0359daf9f5df2f0cc962376682db0cd\": rpc error: code = NotFound desc = could not find container \"f595314f8ed6d43d9030ca78e82b5c59f0359daf9f5df2f0cc962376682db0cd\": container with ID starting with f595314f8ed6d43d9030ca78e82b5c59f0359daf9f5df2f0cc962376682db0cd not found: ID does not exist" Jun 03 23:01:22.778404 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:22.778367 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" event={"ID":"0f12413f-3c36-4d17-a0f3-ee5b5239d640","Type":"ContainerStarted","Data":"4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9"} Jun 03 23:01:22.778749 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:22.778488 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" Jun 03 23:01:22.798003 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:22.797959 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" podStartSLOduration=2.380291492 podStartE2EDuration="5.797946153s" totalImagesPullingTime="3.417654661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:01:22.796241931 +0000 UTC m=+662.993264790" watchObservedRunningTime="2026-06-03 23:01:22.797946153 +0000 UTC m=+662.994969020" Jun 03 23:01:33.785272 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:33.785242 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" Jun 03 23:01:43.139500 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.139461 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5"] Jun 03 23:01:43.139931 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.139655 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" podUID="0f12413f-3c36-4d17-a0f3-ee5b5239d640" containerName="manager" containerID="cri-o://4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9" gracePeriod=10 Jun 03 23:01:43.379421 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.379397 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" Jun 03 23:01:43.540147 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.540122 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f12413f-3c36-4d17-a0f3-ee5b5239d640-extensions-socket-volume\") pod \"0f12413f-3c36-4d17-a0f3-ee5b5239d640\" (UID: \"0f12413f-3c36-4d17-a0f3-ee5b5239d640\") " Jun 03 23:01:43.540354 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.540198 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtntv\" (UniqueName: \"kubernetes.io/projected/0f12413f-3c36-4d17-a0f3-ee5b5239d640-kube-api-access-rtntv\") pod \"0f12413f-3c36-4d17-a0f3-ee5b5239d640\" (UID: \"0f12413f-3c36-4d17-a0f3-ee5b5239d640\") " Jun 03 23:01:43.540684 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.540660 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f12413f-3c36-4d17-a0f3-ee5b5239d640-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0f12413f-3c36-4d17-a0f3-ee5b5239d640" (UID: "0f12413f-3c36-4d17-a0f3-ee5b5239d640"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:01:43.542374 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.542347 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f12413f-3c36-4d17-a0f3-ee5b5239d640-kube-api-access-rtntv" (OuterVolumeSpecName: "kube-api-access-rtntv") pod "0f12413f-3c36-4d17-a0f3-ee5b5239d640" (UID: "0f12413f-3c36-4d17-a0f3-ee5b5239d640"). InnerVolumeSpecName "kube-api-access-rtntv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:01:43.641206 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.641183 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f12413f-3c36-4d17-a0f3-ee5b5239d640-extensions-socket-volume\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 23:01:43.641206 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.641204 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtntv\" (UniqueName: \"kubernetes.io/projected/0f12413f-3c36-4d17-a0f3-ee5b5239d640-kube-api-access-rtntv\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 23:01:43.874226 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.874131 2561 generic.go:356] "Generic (PLEG): container finished" podID="0f12413f-3c36-4d17-a0f3-ee5b5239d640" containerID="4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9" exitCode=0 Jun 03 23:01:43.874226 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.874174 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" Jun 03 23:01:43.874413 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.874235 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" event={"ID":"0f12413f-3c36-4d17-a0f3-ee5b5239d640","Type":"ContainerDied","Data":"4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9"} Jun 03 23:01:43.874413 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.874293 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5" event={"ID":"0f12413f-3c36-4d17-a0f3-ee5b5239d640","Type":"ContainerDied","Data":"41f208e10ee0417dcf878fc91de2f5bdb258a888c455fc9bcd567f97812a59a0"} Jun 03 23:01:43.874413 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.874321 2561 scope.go:117] "RemoveContainer" containerID="4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9" Jun 03 23:01:43.883406 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.883390 2561 scope.go:117] "RemoveContainer" containerID="4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9" Jun 03 23:01:43.883650 ip-10-0-143-45 kubenswrapper[2561]: E0603 23:01:43.883632 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9\": container with ID starting with 4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9 not found: ID does not exist" containerID="4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9" Jun 03 23:01:43.883703 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.883657 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9"} err="failed to get container status \"4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9\": rpc error: code = NotFound desc = could not find container \"4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9\": container with ID starting with 4d18267e6dd8a6656e273afd1dafe656ef6e63aade5462c413ef81fe6e4535f9 not found: ID does not exist" Jun 03 23:01:43.907155 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.907132 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5"] Jun 03 23:01:43.912663 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:43.912644 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lzzs5"] Jun 03 23:01:44.246304 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:44.246269 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f12413f-3c36-4d17-a0f3-ee5b5239d640" path="/var/lib/kubelet/pods/0f12413f-3c36-4d17-a0f3-ee5b5239d640/volumes" Jun 03 23:01:59.449574 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.449540 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz"] Jun 03 23:01:59.450093 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.450077 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f12413f-3c36-4d17-a0f3-ee5b5239d640" containerName="manager" Jun 03 23:01:59.450143 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.450098 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f12413f-3c36-4d17-a0f3-ee5b5239d640" containerName="manager" Jun 03 23:01:59.450204 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.450193 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f12413f-3c36-4d17-a0f3-ee5b5239d640" containerName="manager" Jun 03 23:01:59.453266 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.453246 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.455683 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.455660 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 23:01:59.455798 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.455660 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-nphf4\"" Jun 03 23:01:59.467963 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.467940 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz"] Jun 03 23:01:59.564462 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.564436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.564573 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.564471 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a543b8e-2187-4935-b1f9-5186ab492232-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.564573 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.564497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a543b8e-2187-4935-b1f9-5186ab492232-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.564573 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.564520 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a543b8e-2187-4935-b1f9-5186ab492232-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.564684 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.564575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.564684 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.564600 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.564684 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.564620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.564684 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.564636 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hl8z\" (UniqueName: \"kubernetes.io/projected/3a543b8e-2187-4935-b1f9-5186ab492232-kube-api-access-2hl8z\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.564797 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.564690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.665279 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.665253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.665376 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.665297 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.665376 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.665335 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a543b8e-2187-4935-b1f9-5186ab492232-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.665376 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.665370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a543b8e-2187-4935-b1f9-5186ab492232-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.665527 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.665398 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a543b8e-2187-4935-b1f9-5186ab492232-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.665527 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.665441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.665661 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.665644 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.665723 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.665677 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.665965 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.665946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.666077 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.665975 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.666077 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.666000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hl8z\" (UniqueName: \"kubernetes.io/projected/3a543b8e-2187-4935-b1f9-5186ab492232-kube-api-access-2hl8z\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.666272 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.666246 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.666465 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.666443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.666714 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.666666 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a543b8e-2187-4935-b1f9-5186ab492232-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.668334 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.668313 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a543b8e-2187-4935-b1f9-5186ab492232-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.668604 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.668585 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a543b8e-2187-4935-b1f9-5186ab492232-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.674371 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.674343 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a543b8e-2187-4935-b1f9-5186ab492232-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.674516 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.674497 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hl8z\" (UniqueName: \"kubernetes.io/projected/3a543b8e-2187-4935-b1f9-5186ab492232-kube-api-access-2hl8z\") pod \"maas-default-gateway-openshift-default-8559cd5744-wz7gz\" (UID: \"3a543b8e-2187-4935-b1f9-5186ab492232\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.764665 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.764640 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:01:59.895613 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.895587 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz"] Jun 03 23:01:59.897959 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:01:59.897920 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a543b8e_2187_4935_b1f9_5186ab492232.slice/crio-9c901742d4dd8c3f288886f8ce769bef9e7e319dd5d7c28027cc51c884d5e32c WatchSource:0}: Error finding container 9c901742d4dd8c3f288886f8ce769bef9e7e319dd5d7c28027cc51c884d5e32c: Status 404 returned error can't find the container with id 9c901742d4dd8c3f288886f8ce769bef9e7e319dd5d7c28027cc51c884d5e32c Jun 03 23:01:59.946849 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:01:59.946821 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" event={"ID":"3a543b8e-2187-4935-b1f9-5186ab492232","Type":"ContainerStarted","Data":"9c901742d4dd8c3f288886f8ce769bef9e7e319dd5d7c28027cc51c884d5e32c"} Jun 03 23:02:04.467780 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:04.467066 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:02:04.467780 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:04.467162 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:02:04.467780 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:04.467206 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:02:04.972146 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:04.972109 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" event={"ID":"3a543b8e-2187-4935-b1f9-5186ab492232","Type":"ContainerStarted","Data":"b4b57aab5c2687987e26239a9c9fd32d307a2296cc8dd3d0238b17b33cdbfeb5"} Jun 03 23:02:04.993342 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:04.993291 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" podStartSLOduration=1.426425896 podStartE2EDuration="5.993275981s" totalImagesPullingTime="4.566850085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:04.991061397 +0000 UTC m=+705.188084255" watchObservedRunningTime="2026-06-03 23:02:04.993275981 +0000 UTC m=+705.190298849" Jun 03 23:02:05.504515 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.504483 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-77dlm"] Jun 03 23:02:05.506949 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.506923 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" Jun 03 23:02:05.508767 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.508746 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 23:02:05.508888 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.508834 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 23:02:05.509155 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.509141 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 23:02:05.509224 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.509142 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-r9xr4\"" Jun 03 23:02:05.514874 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.514855 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-77dlm"] Jun 03 23:02:05.521667 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.521645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ae4a3879-6aa6-4687-85d0-6198c95aa62f-config-file\") pod \"limitador-limitador-64c94fd64f-77dlm\" (UID: \"ae4a3879-6aa6-4687-85d0-6198c95aa62f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" Jun 03 23:02:05.521771 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.521683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qps4v\" (UniqueName: \"kubernetes.io/projected/ae4a3879-6aa6-4687-85d0-6198c95aa62f-kube-api-access-qps4v\") pod \"limitador-limitador-64c94fd64f-77dlm\" (UID: \"ae4a3879-6aa6-4687-85d0-6198c95aa62f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" Jun 03 23:02:05.608443 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.608416 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-77dlm"] Jun 03 23:02:05.623014 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.622985 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ae4a3879-6aa6-4687-85d0-6198c95aa62f-config-file\") pod \"limitador-limitador-64c94fd64f-77dlm\" (UID: \"ae4a3879-6aa6-4687-85d0-6198c95aa62f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" Jun 03 23:02:05.623163 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.623031 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qps4v\" (UniqueName: \"kubernetes.io/projected/ae4a3879-6aa6-4687-85d0-6198c95aa62f-kube-api-access-qps4v\") pod \"limitador-limitador-64c94fd64f-77dlm\" (UID: \"ae4a3879-6aa6-4687-85d0-6198c95aa62f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" Jun 03 23:02:05.623598 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.623578 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ae4a3879-6aa6-4687-85d0-6198c95aa62f-config-file\") pod \"limitador-limitador-64c94fd64f-77dlm\" (UID: \"ae4a3879-6aa6-4687-85d0-6198c95aa62f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" Jun 03 23:02:05.631204 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.631180 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qps4v\" (UniqueName: \"kubernetes.io/projected/ae4a3879-6aa6-4687-85d0-6198c95aa62f-kube-api-access-qps4v\") pod \"limitador-limitador-64c94fd64f-77dlm\" (UID: \"ae4a3879-6aa6-4687-85d0-6198c95aa62f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" Jun 03 23:02:05.764970 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.764892 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:02:05.769569 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.769545 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:02:05.817332 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.817310 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" Jun 03 23:02:05.941143 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.941120 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-77dlm"] Jun 03 23:02:05.943090 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:02:05.943058 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4a3879_6aa6_4687_85d0_6198c95aa62f.slice/crio-30f446845482a1c88cb9907678ade61426398f7d2bc57289341689aac7fa6c9f WatchSource:0}: Error finding container 30f446845482a1c88cb9907678ade61426398f7d2bc57289341689aac7fa6c9f: Status 404 returned error can't find the container with id 30f446845482a1c88cb9907678ade61426398f7d2bc57289341689aac7fa6c9f Jun 03 23:02:05.977960 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.977925 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" event={"ID":"ae4a3879-6aa6-4687-85d0-6198c95aa62f","Type":"ContainerStarted","Data":"30f446845482a1c88cb9907678ade61426398f7d2bc57289341689aac7fa6c9f"} Jun 03 23:02:05.978330 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.978309 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:02:05.979270 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:05.979253 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:02:06.551951 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:06.551914 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dggqc"] Jun 03 23:02:06.554075 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:06.554060 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dggqc" Jun 03 23:02:06.555896 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:06.555876 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bn7pk\"" Jun 03 23:02:06.562405 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:06.562386 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dggqc"] Jun 03 23:02:06.632332 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:06.632302 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff46m\" (UniqueName: \"kubernetes.io/projected/2e959724-df32-44b8-8319-87a873da10a5-kube-api-access-ff46m\") pod \"authorino-75d556bd77-dggqc\" (UID: \"2e959724-df32-44b8-8319-87a873da10a5\") " pod="kuadrant-system/authorino-75d556bd77-dggqc" Jun 03 23:02:06.734225 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:06.733808 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff46m\" (UniqueName: \"kubernetes.io/projected/2e959724-df32-44b8-8319-87a873da10a5-kube-api-access-ff46m\") pod \"authorino-75d556bd77-dggqc\" (UID: \"2e959724-df32-44b8-8319-87a873da10a5\") " pod="kuadrant-system/authorino-75d556bd77-dggqc" Jun 03 23:02:06.753126 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:06.753097 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff46m\" (UniqueName: \"kubernetes.io/projected/2e959724-df32-44b8-8319-87a873da10a5-kube-api-access-ff46m\") pod \"authorino-75d556bd77-dggqc\" (UID: \"2e959724-df32-44b8-8319-87a873da10a5\") " pod="kuadrant-system/authorino-75d556bd77-dggqc" Jun 03 23:02:06.864180 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:06.864100 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dggqc" Jun 03 23:02:07.023028 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:07.022846 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dggqc"] Jun 03 23:02:07.026658 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:02:07.026627 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e959724_df32_44b8_8319_87a873da10a5.slice/crio-bb01c43ebd9915f59680d7999378268af60de5e31f00968b1263e07985467960 WatchSource:0}: Error finding container bb01c43ebd9915f59680d7999378268af60de5e31f00968b1263e07985467960: Status 404 returned error can't find the container with id bb01c43ebd9915f59680d7999378268af60de5e31f00968b1263e07985467960 Jun 03 23:02:07.993688 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:07.993598 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dggqc" event={"ID":"2e959724-df32-44b8-8319-87a873da10a5","Type":"ContainerStarted","Data":"bb01c43ebd9915f59680d7999378268af60de5e31f00968b1263e07985467960"} Jun 03 23:02:09.001486 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:09.001439 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" event={"ID":"ae4a3879-6aa6-4687-85d0-6198c95aa62f","Type":"ContainerStarted","Data":"30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c"} Jun 03 23:02:09.001887 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:09.001662 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" Jun 03 23:02:09.019914 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:09.019685 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" podStartSLOduration=1.156806272 podStartE2EDuration="4.019668114s" totalImagesPullingTime="2.862861842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:09.018069426 +0000 UTC m=+709.215092295" watchObservedRunningTime="2026-06-03 23:02:09.019668114 +0000 UTC m=+709.216690983" Jun 03 23:02:11.013450 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:11.013411 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dggqc" event={"ID":"2e959724-df32-44b8-8319-87a873da10a5","Type":"ContainerStarted","Data":"667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd"} Jun 03 23:02:11.027755 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:11.027685 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dggqc" podStartSLOduration=1.361852971 podStartE2EDuration="5.027671602s" totalImagesPullingTime="3.665818631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:11.026087886 +0000 UTC m=+711.223110760" watchObservedRunningTime="2026-06-03 23:02:11.027671602 +0000 UTC m=+711.224694469" Jun 03 23:02:19.886541 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:19.886507 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-77dlm"] Jun 03 23:02:19.886953 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:19.886695 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" podUID="ae4a3879-6aa6-4687-85d0-6198c95aa62f" containerName="limitador" containerID="cri-o://30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c" gracePeriod=30 Jun 03 23:02:19.887400 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:19.887378 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" Jun 03 23:02:20.443249 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:20.443204 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" Jun 03 23:02:20.552881 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:20.552855 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ae4a3879-6aa6-4687-85d0-6198c95aa62f-config-file\") pod \"ae4a3879-6aa6-4687-85d0-6198c95aa62f\" (UID: \"ae4a3879-6aa6-4687-85d0-6198c95aa62f\") " Jun 03 23:02:20.553008 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:20.552948 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qps4v\" (UniqueName: \"kubernetes.io/projected/ae4a3879-6aa6-4687-85d0-6198c95aa62f-kube-api-access-qps4v\") pod \"ae4a3879-6aa6-4687-85d0-6198c95aa62f\" (UID: \"ae4a3879-6aa6-4687-85d0-6198c95aa62f\") " Jun 03 23:02:20.553186 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:20.553165 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4a3879-6aa6-4687-85d0-6198c95aa62f-config-file" (OuterVolumeSpecName: "config-file") pod "ae4a3879-6aa6-4687-85d0-6198c95aa62f" (UID: "ae4a3879-6aa6-4687-85d0-6198c95aa62f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:02:20.554981 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:20.554954 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4a3879-6aa6-4687-85d0-6198c95aa62f-kube-api-access-qps4v" (OuterVolumeSpecName: "kube-api-access-qps4v") pod "ae4a3879-6aa6-4687-85d0-6198c95aa62f" (UID: "ae4a3879-6aa6-4687-85d0-6198c95aa62f"). InnerVolumeSpecName "kube-api-access-qps4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:02:20.654066 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:20.654042 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qps4v\" (UniqueName: \"kubernetes.io/projected/ae4a3879-6aa6-4687-85d0-6198c95aa62f-kube-api-access-qps4v\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 23:02:20.654066 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:20.654066 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ae4a3879-6aa6-4687-85d0-6198c95aa62f-config-file\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 23:02:21.059393 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.059361 2561 generic.go:356] "Generic (PLEG): container finished" podID="ae4a3879-6aa6-4687-85d0-6198c95aa62f" containerID="30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c" exitCode=0 Jun 03 23:02:21.059775 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.059409 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" Jun 03 23:02:21.059775 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.059469 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" event={"ID":"ae4a3879-6aa6-4687-85d0-6198c95aa62f","Type":"ContainerDied","Data":"30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c"} Jun 03 23:02:21.059775 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.059515 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-77dlm" event={"ID":"ae4a3879-6aa6-4687-85d0-6198c95aa62f","Type":"ContainerDied","Data":"30f446845482a1c88cb9907678ade61426398f7d2bc57289341689aac7fa6c9f"} Jun 03 23:02:21.059775 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.059538 2561 scope.go:117] "RemoveContainer" containerID="30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c" Jun 03 23:02:21.069033 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.069018 2561 scope.go:117] "RemoveContainer" containerID="30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c" Jun 03 23:02:21.069311 ip-10-0-143-45 kubenswrapper[2561]: E0603 23:02:21.069292 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c\": container with ID starting with 30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c not found: ID does not exist" containerID="30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c" Jun 03 23:02:21.069393 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.069317 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c"} err="failed to get container status \"30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c\": rpc error: code = NotFound desc = could not find container \"30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c\": container with ID starting with 30cf064b2d2427536069ed08f8a6a1ffd8651fb3c8a7f7335a0dcfdd7ed3042c not found: ID does not exist" Jun 03 23:02:21.083250 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.083231 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-77dlm"] Jun 03 23:02:21.087457 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.087439 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-77dlm"] Jun 03 23:02:21.481243 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.481149 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-nzn7j"] Jun 03 23:02:21.481686 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.481657 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4a3879-6aa6-4687-85d0-6198c95aa62f" containerName="limitador" Jun 03 23:02:21.481686 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.481677 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4a3879-6aa6-4687-85d0-6198c95aa62f" containerName="limitador" Jun 03 23:02:21.481793 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.481780 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4a3879-6aa6-4687-85d0-6198c95aa62f" containerName="limitador" Jun 03 23:02:21.484577 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.484559 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-nzn7j" Jun 03 23:02:21.486856 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.486837 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vxt97\"" Jun 03 23:02:21.486971 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.486839 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 23:02:21.492287 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.492263 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-nzn7j"] Jun 03 23:02:21.562398 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.562370 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/30dd9aba-691d-4c6c-a543-950ea1e9a4e3-data\") pod \"postgres-69fb4594cf-nzn7j\" (UID: \"30dd9aba-691d-4c6c-a543-950ea1e9a4e3\") " pod="opendatahub/postgres-69fb4594cf-nzn7j" Jun 03 23:02:21.562479 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.562421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4n7d\" (UniqueName: \"kubernetes.io/projected/30dd9aba-691d-4c6c-a543-950ea1e9a4e3-kube-api-access-l4n7d\") pod \"postgres-69fb4594cf-nzn7j\" (UID: \"30dd9aba-691d-4c6c-a543-950ea1e9a4e3\") " pod="opendatahub/postgres-69fb4594cf-nzn7j" Jun 03 23:02:21.663334 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.663294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/30dd9aba-691d-4c6c-a543-950ea1e9a4e3-data\") pod \"postgres-69fb4594cf-nzn7j\" (UID: \"30dd9aba-691d-4c6c-a543-950ea1e9a4e3\") " pod="opendatahub/postgres-69fb4594cf-nzn7j" Jun 03 23:02:21.663466 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.663369 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4n7d\" (UniqueName: \"kubernetes.io/projected/30dd9aba-691d-4c6c-a543-950ea1e9a4e3-kube-api-access-l4n7d\") pod \"postgres-69fb4594cf-nzn7j\" (UID: \"30dd9aba-691d-4c6c-a543-950ea1e9a4e3\") " pod="opendatahub/postgres-69fb4594cf-nzn7j" Jun 03 23:02:21.669011 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.663860 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/30dd9aba-691d-4c6c-a543-950ea1e9a4e3-data\") pod \"postgres-69fb4594cf-nzn7j\" (UID: \"30dd9aba-691d-4c6c-a543-950ea1e9a4e3\") " pod="opendatahub/postgres-69fb4594cf-nzn7j" Jun 03 23:02:21.672745 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.672720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4n7d\" (UniqueName: \"kubernetes.io/projected/30dd9aba-691d-4c6c-a543-950ea1e9a4e3-kube-api-access-l4n7d\") pod \"postgres-69fb4594cf-nzn7j\" (UID: \"30dd9aba-691d-4c6c-a543-950ea1e9a4e3\") " pod="opendatahub/postgres-69fb4594cf-nzn7j" Jun 03 23:02:21.796312 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.796292 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-nzn7j" Jun 03 23:02:21.943335 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:21.943307 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-nzn7j"] Jun 03 23:02:21.945101 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:02:21.945068 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30dd9aba_691d_4c6c_a543_950ea1e9a4e3.slice/crio-0173ae72ced9349e017ec96a8c85c436c1f1c2ec00994c7f3e10c5ce92c8b6c5 WatchSource:0}: Error finding container 0173ae72ced9349e017ec96a8c85c436c1f1c2ec00994c7f3e10c5ce92c8b6c5: Status 404 returned error can't find the container with id 0173ae72ced9349e017ec96a8c85c436c1f1c2ec00994c7f3e10c5ce92c8b6c5 Jun 03 23:02:22.065442 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:22.065367 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-nzn7j" event={"ID":"30dd9aba-691d-4c6c-a543-950ea1e9a4e3","Type":"ContainerStarted","Data":"0173ae72ced9349e017ec96a8c85c436c1f1c2ec00994c7f3e10c5ce92c8b6c5"} Jun 03 23:02:22.245786 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:22.245753 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae4a3879-6aa6-4687-85d0-6198c95aa62f" path="/var/lib/kubelet/pods/ae4a3879-6aa6-4687-85d0-6198c95aa62f/volumes" Jun 03 23:02:27.096525 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:27.096482 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-nzn7j" event={"ID":"30dd9aba-691d-4c6c-a543-950ea1e9a4e3","Type":"ContainerStarted","Data":"6e93f4bc6bca14f9d7e75de037cd29d311c306ea179e67f679c98444d480e86d"} Jun 03 23:02:27.096930 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:27.096680 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-nzn7j" Jun 03 23:02:27.113463 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:27.113419 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-nzn7j" podStartSLOduration=1.5054431510000001 podStartE2EDuration="6.113405782s" totalImagesPullingTime="4.607962631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:27.111479107 +0000 UTC m=+727.308501976" watchObservedRunningTime="2026-06-03 23:02:27.113405782 +0000 UTC m=+727.310428694" Jun 03 23:02:33.131659 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:33.131632 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-nzn7j" Jun 03 23:02:43.139896 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:43.139861 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-zdllg"] Jun 03 23:02:43.236627 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:43.236593 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-zdllg"] Jun 03 23:02:43.236786 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:43.236686 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-zdllg" Jun 03 23:02:43.242118 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:43.242096 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-gt2q8\"" Jun 03 23:02:43.247759 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:43.247737 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 23:02:43.248039 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:43.248023 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 23:02:43.354585 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:43.354557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6rbr\" (UniqueName: \"kubernetes.io/projected/71ec1c62-7c9b-45fe-865d-c8f65c599d98-kube-api-access-c6rbr\") pod \"keycloak-operator-dd84cbf46-zdllg\" (UID: \"71ec1c62-7c9b-45fe-865d-c8f65c599d98\") " pod="keycloak-system/keycloak-operator-dd84cbf46-zdllg" Jun 03 23:02:43.455994 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:43.455927 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6rbr\" (UniqueName: \"kubernetes.io/projected/71ec1c62-7c9b-45fe-865d-c8f65c599d98-kube-api-access-c6rbr\") pod \"keycloak-operator-dd84cbf46-zdllg\" (UID: \"71ec1c62-7c9b-45fe-865d-c8f65c599d98\") " pod="keycloak-system/keycloak-operator-dd84cbf46-zdllg" Jun 03 23:02:43.464809 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:43.464790 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6rbr\" (UniqueName: \"kubernetes.io/projected/71ec1c62-7c9b-45fe-865d-c8f65c599d98-kube-api-access-c6rbr\") pod \"keycloak-operator-dd84cbf46-zdllg\" (UID: \"71ec1c62-7c9b-45fe-865d-c8f65c599d98\") " pod="keycloak-system/keycloak-operator-dd84cbf46-zdllg" Jun 03 23:02:43.547576 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:43.547555 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-zdllg" Jun 03 23:02:43.677073 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:43.677043 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-zdllg"] Jun 03 23:02:43.679734 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:02:43.679708 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ec1c62_7c9b_45fe_865d_c8f65c599d98.slice/crio-0310070436e115dd2c43170e7d817dd81c3abfb6eece2d18261ab911adf653d9 WatchSource:0}: Error finding container 0310070436e115dd2c43170e7d817dd81c3abfb6eece2d18261ab911adf653d9: Status 404 returned error can't find the container with id 0310070436e115dd2c43170e7d817dd81c3abfb6eece2d18261ab911adf653d9 Jun 03 23:02:44.174901 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:44.174864 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-zdllg" event={"ID":"71ec1c62-7c9b-45fe-865d-c8f65c599d98","Type":"ContainerStarted","Data":"0310070436e115dd2c43170e7d817dd81c3abfb6eece2d18261ab911adf653d9"} Jun 03 23:02:50.212258 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:50.212198 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-zdllg" event={"ID":"71ec1c62-7c9b-45fe-865d-c8f65c599d98","Type":"ContainerStarted","Data":"b504964f8727f46996610505d6cb334f73ce882800666fd63cd11eea2e0e3121"} Jun 03 23:02:50.247729 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:02:50.247680 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-zdllg" podStartSLOduration=1.660615484 podStartE2EDuration="7.247663822s" totalImagesPullingTime="5.587048338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:50.246971463 +0000 UTC m=+750.443994331" watchObservedRunningTime="2026-06-03 23:02:50.247663822 +0000 UTC m=+750.444686690" Jun 03 23:03:27.291392 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.291355 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cdvqf"] Jun 03 23:03:27.299386 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.299362 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cdvqf" Jun 03 23:03:27.305170 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.305143 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cdvqf"] Jun 03 23:03:27.446988 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.446959 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8t9r\" (UniqueName: \"kubernetes.io/projected/b549b284-07f4-4231-9410-886291402d36-kube-api-access-k8t9r\") pod \"authorino-5d4b67c446-cdvqf\" (UID: \"b549b284-07f4-4231-9410-886291402d36\") " pod="kuadrant-system/authorino-5d4b67c446-cdvqf" Jun 03 23:03:27.529674 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.529643 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cdvqf"] Jun 03 23:03:27.529885 ip-10-0-143-45 kubenswrapper[2561]: E0603 23:03:27.529864 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-k8t9r], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-cdvqf" podUID="b549b284-07f4-4231-9410-886291402d36" Jun 03 23:03:27.547616 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.547556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8t9r\" (UniqueName: \"kubernetes.io/projected/b549b284-07f4-4231-9410-886291402d36-kube-api-access-k8t9r\") pod \"authorino-5d4b67c446-cdvqf\" (UID: \"b549b284-07f4-4231-9410-886291402d36\") " pod="kuadrant-system/authorino-5d4b67c446-cdvqf" Jun 03 23:03:27.556659 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.556636 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8t9r\" (UniqueName: \"kubernetes.io/projected/b549b284-07f4-4231-9410-886291402d36-kube-api-access-k8t9r\") pod \"authorino-5d4b67c446-cdvqf\" (UID: \"b549b284-07f4-4231-9410-886291402d36\") " pod="kuadrant-system/authorino-5d4b67c446-cdvqf" Jun 03 23:03:27.559348 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.559328 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b489897b7-kg4hw"] Jun 03 23:03:27.562166 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.562149 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b489897b7-kg4hw" Jun 03 23:03:27.568923 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.568902 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b489897b7-kg4hw"] Jun 03 23:03:27.642194 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.642163 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b489897b7-kg4hw"] Jun 03 23:03:27.642431 ip-10-0-143-45 kubenswrapper[2561]: E0603 23:03:27.642412 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kccm7], unattached volumes=[], failed to process volumes=[kube-api-access-kccm7]: context canceled" pod="kuadrant-system/authorino-6b489897b7-kg4hw" podUID="33a122e8-5541-4c07-b217-9f569675a8b2" Jun 03 23:03:27.748831 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.748804 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kccm7\" (UniqueName: \"kubernetes.io/projected/33a122e8-5541-4c07-b217-9f569675a8b2-kube-api-access-kccm7\") pod \"authorino-6b489897b7-kg4hw\" (UID: \"33a122e8-5541-4c07-b217-9f569675a8b2\") " pod="kuadrant-system/authorino-6b489897b7-kg4hw" Jun 03 23:03:27.849706 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.849636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kccm7\" (UniqueName: \"kubernetes.io/projected/33a122e8-5541-4c07-b217-9f569675a8b2-kube-api-access-kccm7\") pod \"authorino-6b489897b7-kg4hw\" (UID: \"33a122e8-5541-4c07-b217-9f569675a8b2\") " pod="kuadrant-system/authorino-6b489897b7-kg4hw" Jun 03 23:03:27.857750 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:27.857723 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kccm7\" (UniqueName: \"kubernetes.io/projected/33a122e8-5541-4c07-b217-9f569675a8b2-kube-api-access-kccm7\") pod \"authorino-6b489897b7-kg4hw\" (UID: \"33a122e8-5541-4c07-b217-9f569675a8b2\") " pod="kuadrant-system/authorino-6b489897b7-kg4hw" Jun 03 23:03:28.383995 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:28.383968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b489897b7-kg4hw" Jun 03 23:03:28.384371 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:28.383974 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cdvqf" Jun 03 23:03:28.390354 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:28.390335 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b489897b7-kg4hw" Jun 03 23:03:28.393834 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:28.393816 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cdvqf" Jun 03 23:03:28.555915 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:28.555889 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kccm7\" (UniqueName: \"kubernetes.io/projected/33a122e8-5541-4c07-b217-9f569675a8b2-kube-api-access-kccm7\") pod \"33a122e8-5541-4c07-b217-9f569675a8b2\" (UID: \"33a122e8-5541-4c07-b217-9f569675a8b2\") " Jun 03 23:03:28.556073 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:28.555960 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8t9r\" (UniqueName: \"kubernetes.io/projected/b549b284-07f4-4231-9410-886291402d36-kube-api-access-k8t9r\") pod \"b549b284-07f4-4231-9410-886291402d36\" (UID: \"b549b284-07f4-4231-9410-886291402d36\") " Jun 03 23:03:28.557950 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:28.557922 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33a122e8-5541-4c07-b217-9f569675a8b2-kube-api-access-kccm7" (OuterVolumeSpecName: "kube-api-access-kccm7") pod "33a122e8-5541-4c07-b217-9f569675a8b2" (UID: "33a122e8-5541-4c07-b217-9f569675a8b2"). InnerVolumeSpecName "kube-api-access-kccm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:03:28.558057 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:28.558007 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b549b284-07f4-4231-9410-886291402d36-kube-api-access-k8t9r" (OuterVolumeSpecName: "kube-api-access-k8t9r") pod "b549b284-07f4-4231-9410-886291402d36" (UID: "b549b284-07f4-4231-9410-886291402d36"). InnerVolumeSpecName "kube-api-access-k8t9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:03:28.657231 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:28.657161 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8t9r\" (UniqueName: \"kubernetes.io/projected/b549b284-07f4-4231-9410-886291402d36-kube-api-access-k8t9r\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 23:03:28.657231 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:28.657182 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kccm7\" (UniqueName: \"kubernetes.io/projected/33a122e8-5541-4c07-b217-9f569675a8b2-kube-api-access-kccm7\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 23:03:28.845708 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:28.845669 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dggqc"] Jun 03 23:03:28.845889 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:28.845849 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dggqc" podUID="2e959724-df32-44b8-8319-87a873da10a5" containerName="authorino" containerID="cri-o://667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd" gracePeriod=30 Jun 03 23:03:29.091761 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.091737 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dggqc" Jun 03 23:03:29.262668 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.262643 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff46m\" (UniqueName: \"kubernetes.io/projected/2e959724-df32-44b8-8319-87a873da10a5-kube-api-access-ff46m\") pod \"2e959724-df32-44b8-8319-87a873da10a5\" (UID: \"2e959724-df32-44b8-8319-87a873da10a5\") " Jun 03 23:03:29.264738 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.264716 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e959724-df32-44b8-8319-87a873da10a5-kube-api-access-ff46m" (OuterVolumeSpecName: "kube-api-access-ff46m") pod "2e959724-df32-44b8-8319-87a873da10a5" (UID: "2e959724-df32-44b8-8319-87a873da10a5"). InnerVolumeSpecName "kube-api-access-ff46m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:03:29.364205 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.364168 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff46m\" (UniqueName: \"kubernetes.io/projected/2e959724-df32-44b8-8319-87a873da10a5-kube-api-access-ff46m\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 23:03:29.389193 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.389169 2561 generic.go:356] "Generic (PLEG): container finished" podID="2e959724-df32-44b8-8319-87a873da10a5" containerID="667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd" exitCode=0 Jun 03 23:03:29.389584 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.389204 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dggqc" Jun 03 23:03:29.389584 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.389262 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dggqc" event={"ID":"2e959724-df32-44b8-8319-87a873da10a5","Type":"ContainerDied","Data":"667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd"} Jun 03 23:03:29.389584 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.389311 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dggqc" event={"ID":"2e959724-df32-44b8-8319-87a873da10a5","Type":"ContainerDied","Data":"bb01c43ebd9915f59680d7999378268af60de5e31f00968b1263e07985467960"} Jun 03 23:03:29.389584 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.389337 2561 scope.go:117] "RemoveContainer" containerID="667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd" Jun 03 23:03:29.389584 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.389406 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cdvqf" Jun 03 23:03:29.389584 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.389477 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b489897b7-kg4hw" Jun 03 23:03:29.398924 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.398906 2561 scope.go:117] "RemoveContainer" containerID="667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd" Jun 03 23:03:29.399172 ip-10-0-143-45 kubenswrapper[2561]: E0603 23:03:29.399148 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd\": container with ID starting with 667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd not found: ID does not exist" containerID="667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd" Jun 03 23:03:29.399257 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.399187 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd"} err="failed to get container status \"667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd\": rpc error: code = NotFound desc = could not find container \"667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd\": container with ID starting with 667184ab6038cacc7c77e4c3b7b11868966c94486ffca9097613c459f72792bd not found: ID does not exist" Jun 03 23:03:29.425206 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.425184 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cdvqf"] Jun 03 23:03:29.432640 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.432621 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cdvqf"] Jun 03 23:03:29.442318 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.442295 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dggqc"] Jun 03 23:03:29.448596 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.448577 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dggqc"] Jun 03 23:03:29.474442 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.474417 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b489897b7-kg4hw"] Jun 03 23:03:29.479079 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:29.479060 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6b489897b7-kg4hw"] Jun 03 23:03:30.245774 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:30.245744 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e959724-df32-44b8-8319-87a873da10a5" path="/var/lib/kubelet/pods/2e959724-df32-44b8-8319-87a873da10a5/volumes" Jun 03 23:03:30.246050 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:30.246038 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33a122e8-5541-4c07-b217-9f569675a8b2" path="/var/lib/kubelet/pods/33a122e8-5541-4c07-b217-9f569675a8b2/volumes" Jun 03 23:03:30.246269 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:03:30.246254 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b549b284-07f4-4231-9410-886291402d36" path="/var/lib/kubelet/pods/b549b284-07f4-4231-9410-886291402d36/volumes" Jun 03 23:04:15.606789 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:15.606754 2561 generic.go:356] "Generic (PLEG): container finished" podID="3a543b8e-2187-4935-b1f9-5186ab492232" containerID="b4b57aab5c2687987e26239a9c9fd32d307a2296cc8dd3d0238b17b33cdbfeb5" exitCode=0 Jun 03 23:04:15.607261 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:15.606793 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" event={"ID":"3a543b8e-2187-4935-b1f9-5186ab492232","Type":"ContainerDied","Data":"b4b57aab5c2687987e26239a9c9fd32d307a2296cc8dd3d0238b17b33cdbfeb5"} Jun 03 23:04:15.607261 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:15.607145 2561 scope.go:117] "RemoveContainer" containerID="b4b57aab5c2687987e26239a9c9fd32d307a2296cc8dd3d0238b17b33cdbfeb5" Jun 03 23:04:15.608269 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:15.608235 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:04:15.608344 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:15.608330 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:04:15.608380 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:15.608363 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:04:16.613098 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:16.613061 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" event={"ID":"3a543b8e-2187-4935-b1f9-5186ab492232","Type":"ContainerStarted","Data":"7e9a3341073a603833ecdfacd402468e1b002e91d43f4d69ba83aba5bdf0f611"} Jun 03 23:04:16.765528 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:16.765069 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:04:16.766387 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:16.766343 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-wz7gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jun 03 23:04:16.766561 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:16.766414 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" podUID="3a543b8e-2187-4935-b1f9-5186ab492232" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jun 03 23:04:17.765459 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:17.765402 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-wz7gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jun 03 23:04:17.766075 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:17.766025 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" podUID="3a543b8e-2187-4935-b1f9-5186ab492232" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jun 03 23:04:18.766567 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:18.766089 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-wz7gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jun 03 23:04:18.766567 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:18.766153 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" podUID="3a543b8e-2187-4935-b1f9-5186ab492232" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jun 03 23:04:19.766346 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:19.765873 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-wz7gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jun 03 23:04:19.766346 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:19.765936 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" podUID="3a543b8e-2187-4935-b1f9-5186ab492232" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jun 03 23:04:20.765851 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:20.765812 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-wz7gz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jun 03 23:04:20.766355 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:20.765883 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" podUID="3a543b8e-2187-4935-b1f9-5186ab492232" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jun 03 23:04:20.979284 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:20.979245 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:04:21.768986 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:21.768958 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:04:21.769973 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:21.769950 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-wz7gz" Jun 03 23:04:55.334937 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.334908 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76df8c799f-tz68p"] Jun 03 23:04:55.335433 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.335269 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e959724-df32-44b8-8319-87a873da10a5" containerName="authorino" Jun 03 23:04:55.335433 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.335280 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e959724-df32-44b8-8319-87a873da10a5" containerName="authorino" Jun 03 23:04:55.335433 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.335338 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e959724-df32-44b8-8319-87a873da10a5" containerName="authorino" Jun 03 23:04:55.337301 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.337284 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:04:55.339519 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.339495 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 23:04:55.339652 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.339618 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 23:04:55.340251 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.340229 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bn7pk\"" Jun 03 23:04:55.340376 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.340272 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 23:04:55.340376 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.340277 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 23:04:55.347520 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.347499 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76df8c799f-tz68p"] Jun 03 23:04:55.415467 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.415445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b71d44b5-bbbe-4373-8135-85f7f993f426-tls-cert\") pod \"authorino-76df8c799f-tz68p\" (UID: \"b71d44b5-bbbe-4373-8135-85f7f993f426\") " pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:04:55.415580 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.415482 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b71d44b5-bbbe-4373-8135-85f7f993f426-oidc-ca\") pod \"authorino-76df8c799f-tz68p\" (UID: \"b71d44b5-bbbe-4373-8135-85f7f993f426\") " pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:04:55.415580 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.415499 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dqzs\" (UniqueName: \"kubernetes.io/projected/b71d44b5-bbbe-4373-8135-85f7f993f426-kube-api-access-7dqzs\") pod \"authorino-76df8c799f-tz68p\" (UID: \"b71d44b5-bbbe-4373-8135-85f7f993f426\") " pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:04:55.516020 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.515999 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b71d44b5-bbbe-4373-8135-85f7f993f426-tls-cert\") pod \"authorino-76df8c799f-tz68p\" (UID: \"b71d44b5-bbbe-4373-8135-85f7f993f426\") " pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:04:55.516132 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.516040 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b71d44b5-bbbe-4373-8135-85f7f993f426-oidc-ca\") pod \"authorino-76df8c799f-tz68p\" (UID: \"b71d44b5-bbbe-4373-8135-85f7f993f426\") " pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:04:55.516132 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.516058 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dqzs\" (UniqueName: \"kubernetes.io/projected/b71d44b5-bbbe-4373-8135-85f7f993f426-kube-api-access-7dqzs\") pod \"authorino-76df8c799f-tz68p\" (UID: \"b71d44b5-bbbe-4373-8135-85f7f993f426\") " pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:04:55.516736 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.516717 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b71d44b5-bbbe-4373-8135-85f7f993f426-oidc-ca\") pod \"authorino-76df8c799f-tz68p\" (UID: \"b71d44b5-bbbe-4373-8135-85f7f993f426\") " pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:04:55.518525 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.518506 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b71d44b5-bbbe-4373-8135-85f7f993f426-tls-cert\") pod \"authorino-76df8c799f-tz68p\" (UID: \"b71d44b5-bbbe-4373-8135-85f7f993f426\") " pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:04:55.523080 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.523061 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dqzs\" (UniqueName: \"kubernetes.io/projected/b71d44b5-bbbe-4373-8135-85f7f993f426-kube-api-access-7dqzs\") pod \"authorino-76df8c799f-tz68p\" (UID: \"b71d44b5-bbbe-4373-8135-85f7f993f426\") " pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:04:55.646250 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.646158 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:04:55.770030 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.770005 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76df8c799f-tz68p"] Jun 03 23:04:55.772568 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:04:55.772526 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb71d44b5_bbbe_4373_8135_85f7f993f426.slice/crio-d63c5aebe77f62619077da6042a613a5a143bd6adec6ee0f3f70b6a827f7fbe6 WatchSource:0}: Error finding container d63c5aebe77f62619077da6042a613a5a143bd6adec6ee0f3f70b6a827f7fbe6: Status 404 returned error can't find the container with id d63c5aebe77f62619077da6042a613a5a143bd6adec6ee0f3f70b6a827f7fbe6 Jun 03 23:04:55.773957 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.773936 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:04:55.794080 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:55.794055 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76df8c799f-tz68p" event={"ID":"b71d44b5-bbbe-4373-8135-85f7f993f426","Type":"ContainerStarted","Data":"d63c5aebe77f62619077da6042a613a5a143bd6adec6ee0f3f70b6a827f7fbe6"} Jun 03 23:04:56.802125 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:56.802095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76df8c799f-tz68p" event={"ID":"b71d44b5-bbbe-4373-8135-85f7f993f426","Type":"ContainerStarted","Data":"a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126"} Jun 03 23:04:56.821290 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:04:56.821229 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76df8c799f-tz68p" podStartSLOduration=1.428066471 podStartE2EDuration="1.821188114s" totalImagesPullingTime="393.121643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:04:56.820372572 +0000 UTC m=+877.017395441" watchObservedRunningTime="2026-06-03 23:04:56.821188114 +0000 UTC m=+877.018210982" Jun 03 23:05:20.258153 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:20.258077 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:05:20.261460 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:20.261436 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:05:20.261824 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:20.261806 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:05:20.264531 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:20.264512 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:05:37.387605 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.387575 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8"] Jun 03 23:05:37.391664 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.391638 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.393594 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.393568 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 23:05:37.393709 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.393625 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8mn54\"" Jun 03 23:05:37.393877 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.393861 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 23:05:37.393962 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.393935 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 23:05:37.403651 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.403628 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8"] Jun 03 23:05:37.482189 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.482157 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd9fe354-277c-411f-bdba-be70c6e8ae40-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.482385 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.482198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9fe354-277c-411f-bdba-be70c6e8ae40-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.482385 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.482329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd9fe354-277c-411f-bdba-be70c6e8ae40-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.482504 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.482400 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd9fe354-277c-411f-bdba-be70c6e8ae40-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.482504 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.482428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p85n2\" (UniqueName: \"kubernetes.io/projected/dd9fe354-277c-411f-bdba-be70c6e8ae40-kube-api-access-p85n2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.482585 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.482499 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd9fe354-277c-411f-bdba-be70c6e8ae40-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.583807 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.583777 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd9fe354-277c-411f-bdba-be70c6e8ae40-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.583954 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.583818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9fe354-277c-411f-bdba-be70c6e8ae40-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.583954 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.583840 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd9fe354-277c-411f-bdba-be70c6e8ae40-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.583954 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.583874 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd9fe354-277c-411f-bdba-be70c6e8ae40-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.583954 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.583899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p85n2\" (UniqueName: \"kubernetes.io/projected/dd9fe354-277c-411f-bdba-be70c6e8ae40-kube-api-access-p85n2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.583954 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.583943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd9fe354-277c-411f-bdba-be70c6e8ae40-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.584384 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.584361 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dd9fe354-277c-411f-bdba-be70c6e8ae40-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.584509 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.584386 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd9fe354-277c-411f-bdba-be70c6e8ae40-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.584509 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.584423 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd9fe354-277c-411f-bdba-be70c6e8ae40-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.586344 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.586328 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd9fe354-277c-411f-bdba-be70c6e8ae40-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.586643 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.586624 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9fe354-277c-411f-bdba-be70c6e8ae40-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.593897 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.593869 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p85n2\" (UniqueName: \"kubernetes.io/projected/dd9fe354-277c-411f-bdba-be70c6e8ae40-kube-api-access-p85n2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8\" (UID: \"dd9fe354-277c-411f-bdba-be70c6e8ae40\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.704839 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.704775 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:37.839383 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.839352 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8"] Jun 03 23:05:37.840888 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:05:37.840860 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9fe354_277c_411f_bdba_be70c6e8ae40.slice/crio-b363ef3ca9f8f46a0575bcc86dcde507442592db9a18ef1beaaa218fc1cd082f WatchSource:0}: Error finding container b363ef3ca9f8f46a0575bcc86dcde507442592db9a18ef1beaaa218fc1cd082f: Status 404 returned error can't find the container with id b363ef3ca9f8f46a0575bcc86dcde507442592db9a18ef1beaaa218fc1cd082f Jun 03 23:05:37.988754 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:37.988725 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" event={"ID":"dd9fe354-277c-411f-bdba-be70c6e8ae40","Type":"ContainerStarted","Data":"b363ef3ca9f8f46a0575bcc86dcde507442592db9a18ef1beaaa218fc1cd082f"} Jun 03 23:05:41.007917 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:41.007881 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" event={"ID":"dd9fe354-277c-411f-bdba-be70c6e8ae40","Type":"ContainerStarted","Data":"253cfd1a7c08ee89a588ad79ad7f4cf4e07eeb9029ab32ab3b5d4de9d238ce6d"} Jun 03 23:05:43.019188 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:43.019151 2561 generic.go:356] "Generic (PLEG): container finished" podID="dd9fe354-277c-411f-bdba-be70c6e8ae40" containerID="253cfd1a7c08ee89a588ad79ad7f4cf4e07eeb9029ab32ab3b5d4de9d238ce6d" exitCode=0 Jun 03 23:05:43.019592 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:43.019245 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" event={"ID":"dd9fe354-277c-411f-bdba-be70c6e8ae40","Type":"ContainerDied","Data":"253cfd1a7c08ee89a588ad79ad7f4cf4e07eeb9029ab32ab3b5d4de9d238ce6d"} Jun 03 23:05:45.032205 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:45.032167 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" event={"ID":"dd9fe354-277c-411f-bdba-be70c6e8ae40","Type":"ContainerStarted","Data":"eb39cea0a5a814581c6d4f7093b7b0be0863636f88e85adaaa7210bcea8f91df"} Jun 03 23:05:45.052351 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:45.052302 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" podStartSLOduration=2.5846825669999998 podStartE2EDuration="8.052287499s" totalImagesPullingTime="4.14672513s" totalInitContainerRuntime="1.320879802s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:05:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:05:45.050605483 +0000 UTC m=+925.247628352" watchObservedRunningTime="2026-06-03 23:05:45.052287499 +0000 UTC m=+925.249310367" Jun 03 23:05:47.705411 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:47.705366 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:47.705858 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:47.705440 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:47.718765 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:47.718736 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:05:48.057479 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:05:48.057451 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8" Jun 03 23:06:16.304151 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.304115 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m"] Jun 03 23:06:16.311721 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.311690 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.313826 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.313793 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 23:06:16.318513 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.318488 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m"] Jun 03 23:06:16.419815 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.419783 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/952c8c69-6590-425d-b99c-728b900c3886-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.419961 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.419836 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj2qs\" (UniqueName: \"kubernetes.io/projected/952c8c69-6590-425d-b99c-728b900c3886-kube-api-access-qj2qs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.419961 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.419855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/952c8c69-6590-425d-b99c-728b900c3886-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.419961 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.419922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/952c8c69-6590-425d-b99c-728b900c3886-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.420132 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.419990 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/952c8c69-6590-425d-b99c-728b900c3886-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.420132 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.420042 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/952c8c69-6590-425d-b99c-728b900c3886-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.521142 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.521116 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/952c8c69-6590-425d-b99c-728b900c3886-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.521303 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.521150 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/952c8c69-6590-425d-b99c-728b900c3886-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.521303 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.521189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj2qs\" (UniqueName: \"kubernetes.io/projected/952c8c69-6590-425d-b99c-728b900c3886-kube-api-access-qj2qs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.521303 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.521206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/952c8c69-6590-425d-b99c-728b900c3886-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.521303 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.521259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/952c8c69-6590-425d-b99c-728b900c3886-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.521303 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.521291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/952c8c69-6590-425d-b99c-728b900c3886-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.521618 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.521593 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/952c8c69-6590-425d-b99c-728b900c3886-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.521672 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.521620 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/952c8c69-6590-425d-b99c-728b900c3886-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.521708 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.521692 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/952c8c69-6590-425d-b99c-728b900c3886-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.523620 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.523599 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/952c8c69-6590-425d-b99c-728b900c3886-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.523832 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.523811 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/952c8c69-6590-425d-b99c-728b900c3886-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.528635 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.528618 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj2qs\" (UniqueName: \"kubernetes.io/projected/952c8c69-6590-425d-b99c-728b900c3886-kube-api-access-qj2qs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bsl5m\" (UID: \"952c8c69-6590-425d-b99c-728b900c3886\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.622447 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.622385 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:16.757789 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:16.757763 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m"] Jun 03 23:06:16.759988 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:06:16.759947 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod952c8c69_6590_425d_b99c_728b900c3886.slice/crio-023d36b5f12f3164214db238e23e380be389e07010bd38c170c079e0d1222cc9 WatchSource:0}: Error finding container 023d36b5f12f3164214db238e23e380be389e07010bd38c170c079e0d1222cc9: Status 404 returned error can't find the container with id 023d36b5f12f3164214db238e23e380be389e07010bd38c170c079e0d1222cc9 Jun 03 23:06:17.186041 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:17.186002 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" event={"ID":"952c8c69-6590-425d-b99c-728b900c3886","Type":"ContainerStarted","Data":"c5160abf2687997d84d21e9d03480cf51e099622bbd7d8cf217297ea543f900f"} Jun 03 23:06:17.186245 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:17.186050 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" event={"ID":"952c8c69-6590-425d-b99c-728b900c3886","Type":"ContainerStarted","Data":"023d36b5f12f3164214db238e23e380be389e07010bd38c170c079e0d1222cc9"} Jun 03 23:06:18.192851 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:18.192816 2561 generic.go:356] "Generic (PLEG): container finished" podID="952c8c69-6590-425d-b99c-728b900c3886" containerID="c5160abf2687997d84d21e9d03480cf51e099622bbd7d8cf217297ea543f900f" exitCode=0 Jun 03 23:06:18.193224 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:18.192898 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" event={"ID":"952c8c69-6590-425d-b99c-728b900c3886","Type":"ContainerDied","Data":"c5160abf2687997d84d21e9d03480cf51e099622bbd7d8cf217297ea543f900f"} Jun 03 23:06:19.199840 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:19.199805 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" event={"ID":"952c8c69-6590-425d-b99c-728b900c3886","Type":"ContainerStarted","Data":"e9945e24742b71a7805432d2ff9454b40a2a085fe1fb2134e14db14b7e454ad5"} Jun 03 23:06:19.221852 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:19.221796 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" podStartSLOduration=1.789420682 podStartE2EDuration="3.221780229s" totalImagesPullingTime="220.518997ms" totalInitContainerRuntime="1.21184055s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:06:19.220445423 +0000 UTC m=+959.417468288" watchObservedRunningTime="2026-06-03 23:06:19.221780229 +0000 UTC m=+959.418803097" Jun 03 23:06:26.623335 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:26.623304 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:26.623837 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:26.623385 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:26.635869 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:26.635841 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:06:27.247947 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:06:27.247919 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bsl5m" Jun 03 23:07:46.411026 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.410994 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f4c5f499d-stnfw"] Jun 03 23:07:46.414387 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.414370 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f4c5f499d-stnfw" Jun 03 23:07:46.420403 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.420380 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f4c5f499d-stnfw"] Jun 03 23:07:46.508630 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.508606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/40e2937b-6ebb-4518-bfeb-8eafaab41ba8-oidc-ca\") pod \"authorino-6f4c5f499d-stnfw\" (UID: \"40e2937b-6ebb-4518-bfeb-8eafaab41ba8\") " pod="kuadrant-system/authorino-6f4c5f499d-stnfw" Jun 03 23:07:46.508734 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.508640 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e2937b-6ebb-4518-bfeb-8eafaab41ba8-tls-cert\") pod \"authorino-6f4c5f499d-stnfw\" (UID: \"40e2937b-6ebb-4518-bfeb-8eafaab41ba8\") " pod="kuadrant-system/authorino-6f4c5f499d-stnfw" Jun 03 23:07:46.508734 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.508677 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-282w5\" (UniqueName: \"kubernetes.io/projected/40e2937b-6ebb-4518-bfeb-8eafaab41ba8-kube-api-access-282w5\") pod \"authorino-6f4c5f499d-stnfw\" (UID: \"40e2937b-6ebb-4518-bfeb-8eafaab41ba8\") " pod="kuadrant-system/authorino-6f4c5f499d-stnfw" Jun 03 23:07:46.609783 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.609760 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/40e2937b-6ebb-4518-bfeb-8eafaab41ba8-oidc-ca\") pod \"authorino-6f4c5f499d-stnfw\" (UID: \"40e2937b-6ebb-4518-bfeb-8eafaab41ba8\") " pod="kuadrant-system/authorino-6f4c5f499d-stnfw" Jun 03 23:07:46.609893 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.609792 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e2937b-6ebb-4518-bfeb-8eafaab41ba8-tls-cert\") pod \"authorino-6f4c5f499d-stnfw\" (UID: \"40e2937b-6ebb-4518-bfeb-8eafaab41ba8\") " pod="kuadrant-system/authorino-6f4c5f499d-stnfw" Jun 03 23:07:46.609893 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.609820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-282w5\" (UniqueName: \"kubernetes.io/projected/40e2937b-6ebb-4518-bfeb-8eafaab41ba8-kube-api-access-282w5\") pod \"authorino-6f4c5f499d-stnfw\" (UID: \"40e2937b-6ebb-4518-bfeb-8eafaab41ba8\") " pod="kuadrant-system/authorino-6f4c5f499d-stnfw" Jun 03 23:07:46.610433 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.610409 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/40e2937b-6ebb-4518-bfeb-8eafaab41ba8-oidc-ca\") pod \"authorino-6f4c5f499d-stnfw\" (UID: \"40e2937b-6ebb-4518-bfeb-8eafaab41ba8\") " pod="kuadrant-system/authorino-6f4c5f499d-stnfw" Jun 03 23:07:46.612598 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.612580 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e2937b-6ebb-4518-bfeb-8eafaab41ba8-tls-cert\") pod \"authorino-6f4c5f499d-stnfw\" (UID: \"40e2937b-6ebb-4518-bfeb-8eafaab41ba8\") " pod="kuadrant-system/authorino-6f4c5f499d-stnfw" Jun 03 23:07:46.620367 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.620344 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-282w5\" (UniqueName: \"kubernetes.io/projected/40e2937b-6ebb-4518-bfeb-8eafaab41ba8-kube-api-access-282w5\") pod \"authorino-6f4c5f499d-stnfw\" (UID: \"40e2937b-6ebb-4518-bfeb-8eafaab41ba8\") " pod="kuadrant-system/authorino-6f4c5f499d-stnfw" Jun 03 23:07:46.724378 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.724325 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f4c5f499d-stnfw" Jun 03 23:07:46.854261 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:46.854234 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f4c5f499d-stnfw"] Jun 03 23:07:46.856418 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:07:46.856393 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40e2937b_6ebb_4518_bfeb_8eafaab41ba8.slice/crio-c23e1c1dfad5891cfb1d6e35c486eda7a41ed188f2225bd7231d3c8974254c5c WatchSource:0}: Error finding container c23e1c1dfad5891cfb1d6e35c486eda7a41ed188f2225bd7231d3c8974254c5c: Status 404 returned error can't find the container with id c23e1c1dfad5891cfb1d6e35c486eda7a41ed188f2225bd7231d3c8974254c5c Jun 03 23:07:47.630690 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:47.630657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f4c5f499d-stnfw" event={"ID":"40e2937b-6ebb-4518-bfeb-8eafaab41ba8","Type":"ContainerStarted","Data":"6a6cb296c82b537f734103cbc5805d64b11a52e074b0557e16da985c2e41aee5"} Jun 03 23:07:47.631140 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:47.630710 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f4c5f499d-stnfw" event={"ID":"40e2937b-6ebb-4518-bfeb-8eafaab41ba8","Type":"ContainerStarted","Data":"c23e1c1dfad5891cfb1d6e35c486eda7a41ed188f2225bd7231d3c8974254c5c"} Jun 03 23:07:47.656670 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:47.656621 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f4c5f499d-stnfw" podStartSLOduration=1.046168967 podStartE2EDuration="1.656604023s" totalImagesPullingTime="610.435056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:07:47.654307436 +0000 UTC m=+1047.851330303" watchObservedRunningTime="2026-06-03 23:07:47.656604023 +0000 UTC m=+1047.853626892" Jun 03 23:07:47.697833 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:47.697783 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76df8c799f-tz68p"] Jun 03 23:07:47.698045 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:47.698016 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-76df8c799f-tz68p" podUID="b71d44b5-bbbe-4373-8135-85f7f993f426" containerName="authorino" containerID="cri-o://a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126" gracePeriod=30 Jun 03 23:07:47.970466 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:47.970441 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:07:48.022808 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.022778 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dqzs\" (UniqueName: \"kubernetes.io/projected/b71d44b5-bbbe-4373-8135-85f7f993f426-kube-api-access-7dqzs\") pod \"b71d44b5-bbbe-4373-8135-85f7f993f426\" (UID: \"b71d44b5-bbbe-4373-8135-85f7f993f426\") " Jun 03 23:07:48.022972 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.022847 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b71d44b5-bbbe-4373-8135-85f7f993f426-oidc-ca\") pod \"b71d44b5-bbbe-4373-8135-85f7f993f426\" (UID: \"b71d44b5-bbbe-4373-8135-85f7f993f426\") " Jun 03 23:07:48.022972 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.022906 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b71d44b5-bbbe-4373-8135-85f7f993f426-tls-cert\") pod \"b71d44b5-bbbe-4373-8135-85f7f993f426\" (UID: \"b71d44b5-bbbe-4373-8135-85f7f993f426\") " Jun 03 23:07:48.025283 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.025234 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b71d44b5-bbbe-4373-8135-85f7f993f426-kube-api-access-7dqzs" (OuterVolumeSpecName: "kube-api-access-7dqzs") pod "b71d44b5-bbbe-4373-8135-85f7f993f426" (UID: "b71d44b5-bbbe-4373-8135-85f7f993f426"). InnerVolumeSpecName "kube-api-access-7dqzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:07:48.028270 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.028244 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b71d44b5-bbbe-4373-8135-85f7f993f426-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "b71d44b5-bbbe-4373-8135-85f7f993f426" (UID: "b71d44b5-bbbe-4373-8135-85f7f993f426"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:07:48.033410 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.033389 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b71d44b5-bbbe-4373-8135-85f7f993f426-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b71d44b5-bbbe-4373-8135-85f7f993f426" (UID: "b71d44b5-bbbe-4373-8135-85f7f993f426"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:07:48.124186 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.124155 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dqzs\" (UniqueName: \"kubernetes.io/projected/b71d44b5-bbbe-4373-8135-85f7f993f426-kube-api-access-7dqzs\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 23:07:48.124186 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.124182 2561 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b71d44b5-bbbe-4373-8135-85f7f993f426-oidc-ca\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 23:07:48.124186 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.124192 2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b71d44b5-bbbe-4373-8135-85f7f993f426-tls-cert\") on node \"ip-10-0-143-45.ec2.internal\" DevicePath \"\"" Jun 03 23:07:48.639702 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.639669 2561 generic.go:356] "Generic (PLEG): container finished" podID="b71d44b5-bbbe-4373-8135-85f7f993f426" containerID="a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126" exitCode=0 Jun 03 23:07:48.640059 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.639710 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76df8c799f-tz68p" Jun 03 23:07:48.640059 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.639720 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76df8c799f-tz68p" event={"ID":"b71d44b5-bbbe-4373-8135-85f7f993f426","Type":"ContainerDied","Data":"a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126"} Jun 03 23:07:48.640059 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.639775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76df8c799f-tz68p" event={"ID":"b71d44b5-bbbe-4373-8135-85f7f993f426","Type":"ContainerDied","Data":"d63c5aebe77f62619077da6042a613a5a143bd6adec6ee0f3f70b6a827f7fbe6"} Jun 03 23:07:48.640059 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.639804 2561 scope.go:117] "RemoveContainer" containerID="a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126" Jun 03 23:07:48.648543 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.648524 2561 scope.go:117] "RemoveContainer" containerID="a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126" Jun 03 23:07:48.648793 ip-10-0-143-45 kubenswrapper[2561]: E0603 23:07:48.648776 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126\": container with ID starting with a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126 not found: ID does not exist" containerID="a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126" Jun 03 23:07:48.648837 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.648801 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126"} err="failed to get container status \"a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126\": rpc error: code = NotFound desc = could not find container \"a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126\": container with ID starting with a29a612244d3656e7272fc6b1ea8c2dd6f2e27a80808f9272ceb9920fea21126 not found: ID does not exist" Jun 03 23:07:48.654162 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.654142 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76df8c799f-tz68p"] Jun 03 23:07:48.658340 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:48.658320 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76df8c799f-tz68p"] Jun 03 23:07:50.247881 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:07:50.247849 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b71d44b5-bbbe-4373-8135-85f7f993f426" path="/var/lib/kubelet/pods/b71d44b5-bbbe-4373-8135-85f7f993f426/volumes" Jun 03 23:10:20.289055 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:10:20.288968 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:10:20.292083 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:10:20.292058 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:10:20.295907 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:10:20.295888 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:10:20.298835 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:10:20.298818 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:15:20.318681 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:15:20.318648 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:15:20.321738 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:15:20.321715 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:15:20.327081 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:15:20.327061 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:15:20.329805 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:15:20.329789 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:20:20.349568 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:20:20.349542 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:20:20.352320 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:20:20.352295 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:20:20.357876 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:20:20.357856 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:20:20.360498 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:20:20.360483 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:25:20.378857 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:25:20.378822 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:25:20.381688 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:25:20.381669 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:25:20.390271 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:25:20.390255 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:25:20.392903 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:25:20.392885 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:30:20.410343 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:30:20.410239 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:30:20.413309 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:30:20.413281 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:30:20.422074 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:30:20.422055 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:30:20.424869 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:30:20.424851 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fwdwt_ab98b3af-dc1d-4750-a720-23743d62f5ae/ovn-acl-logging/0.log" Jun 03 23:30:57.814547 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:30:57.814457 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f4c5f499d-stnfw_40e2937b-6ebb-4518-bfeb-8eafaab41ba8/authorino/0.log" Jun 03 23:31:03.914600 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:03.914574 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-967f449d5-lgkjb_26fde37d-7c3f-47c9-a669-384a5b0fd498/copy-manifests/0.log" Jun 03 23:31:03.922651 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:03.922629 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-967f449d5-lgkjb_26fde37d-7c3f-47c9-a669-384a5b0fd498/manager/0.log" Jun 03 23:31:04.036886 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:04.036864 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-nzn7j_30dd9aba-691d-4c6c-a543-950ea1e9a4e3/postgres/0.log" Jun 03 23:31:05.348258 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:05.348226 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f4c5f499d-stnfw_40e2937b-6ebb-4518-bfeb-8eafaab41ba8/authorino/0.log" Jun 03 23:31:06.810190 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:06.810153 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f59d86b67-2f857_29540219-0f24-41c0-9b11-815539a1a4e7/kube-auth-proxy/0.log" Jun 03 23:31:07.047027 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:07.046994 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-wz7gz_3a543b8e-2187-4935-b1f9-5186ab492232/istio-proxy/1.log" Jun 03 23:31:08.142533 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:08.142497 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8_dd9fe354-277c-411f-bdba-be70c6e8ae40/storage-initializer/0.log" Jun 03 23:31:08.149934 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:08.149914 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfkhd8_dd9fe354-277c-411f-bdba-be70c6e8ae40/main/0.log" Jun 03 23:31:08.378324 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:08.378286 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-bsl5m_952c8c69-6590-425d-b99c-728b900c3886/storage-initializer/0.log" Jun 03 23:31:08.386733 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:08.386698 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-bsl5m_952c8c69-6590-425d-b99c-728b900c3886/main/0.log" Jun 03 23:31:12.619976 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.619942 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xc65t/must-gather-d99h5"] Jun 03 23:31:12.620392 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.620383 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71d44b5-bbbe-4373-8135-85f7f993f426" containerName="authorino" Jun 03 23:31:12.620436 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.620397 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71d44b5-bbbe-4373-8135-85f7f993f426" containerName="authorino" Jun 03 23:31:12.620470 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.620459 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b71d44b5-bbbe-4373-8135-85f7f993f426" containerName="authorino" Jun 03 23:31:12.623609 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.623589 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xc65t/must-gather-d99h5" Jun 03 23:31:12.625745 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.625717 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xc65t\"/\"openshift-service-ca.crt\"" Jun 03 23:31:12.626125 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.626101 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xc65t\"/\"kube-root-ca.crt\"" Jun 03 23:31:12.626346 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.626330 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xc65t\"/\"default-dockercfg-ng5fq\"" Jun 03 23:31:12.630834 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.630810 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xc65t/must-gather-d99h5"] Jun 03 23:31:12.709366 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.709336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf2ae331-f7f3-4317-9d14-3167e95ec25e-must-gather-output\") pod \"must-gather-d99h5\" (UID: \"cf2ae331-f7f3-4317-9d14-3167e95ec25e\") " pod="openshift-must-gather-xc65t/must-gather-d99h5" Jun 03 23:31:12.709533 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.709388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txl9s\" (UniqueName: \"kubernetes.io/projected/cf2ae331-f7f3-4317-9d14-3167e95ec25e-kube-api-access-txl9s\") pod \"must-gather-d99h5\" (UID: \"cf2ae331-f7f3-4317-9d14-3167e95ec25e\") " pod="openshift-must-gather-xc65t/must-gather-d99h5" Jun 03 23:31:12.810342 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.810300 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf2ae331-f7f3-4317-9d14-3167e95ec25e-must-gather-output\") pod \"must-gather-d99h5\" (UID: \"cf2ae331-f7f3-4317-9d14-3167e95ec25e\") " pod="openshift-must-gather-xc65t/must-gather-d99h5" Jun 03 23:31:12.810516 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.810400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txl9s\" (UniqueName: \"kubernetes.io/projected/cf2ae331-f7f3-4317-9d14-3167e95ec25e-kube-api-access-txl9s\") pod \"must-gather-d99h5\" (UID: \"cf2ae331-f7f3-4317-9d14-3167e95ec25e\") " pod="openshift-must-gather-xc65t/must-gather-d99h5" Jun 03 23:31:12.810659 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.810634 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf2ae331-f7f3-4317-9d14-3167e95ec25e-must-gather-output\") pod \"must-gather-d99h5\" (UID: \"cf2ae331-f7f3-4317-9d14-3167e95ec25e\") " pod="openshift-must-gather-xc65t/must-gather-d99h5" Jun 03 23:31:12.818845 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.818820 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txl9s\" (UniqueName: \"kubernetes.io/projected/cf2ae331-f7f3-4317-9d14-3167e95ec25e-kube-api-access-txl9s\") pod \"must-gather-d99h5\" (UID: \"cf2ae331-f7f3-4317-9d14-3167e95ec25e\") " pod="openshift-must-gather-xc65t/must-gather-d99h5" Jun 03 23:31:12.934109 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:12.934021 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xc65t/must-gather-d99h5" Jun 03 23:31:13.062488 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:13.062431 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xc65t/must-gather-d99h5"] Jun 03 23:31:13.064812 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:31:13.064778 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf2ae331_f7f3_4317_9d14_3167e95ec25e.slice/crio-d1373adf2de8c23ee435467abd166c7db6fb18fc68514dcc6043b8ea19fd4179 WatchSource:0}: Error finding container d1373adf2de8c23ee435467abd166c7db6fb18fc68514dcc6043b8ea19fd4179: Status 404 returned error can't find the container with id d1373adf2de8c23ee435467abd166c7db6fb18fc68514dcc6043b8ea19fd4179 Jun 03 23:31:13.066796 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:13.066780 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:31:13.324915 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:13.324882 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc65t/must-gather-d99h5" event={"ID":"cf2ae331-f7f3-4317-9d14-3167e95ec25e","Type":"ContainerStarted","Data":"d1373adf2de8c23ee435467abd166c7db6fb18fc68514dcc6043b8ea19fd4179"} Jun 03 23:31:14.333504 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:14.333072 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc65t/must-gather-d99h5" event={"ID":"cf2ae331-f7f3-4317-9d14-3167e95ec25e","Type":"ContainerStarted","Data":"2ca10f36a291b5f1157dade3e8e4652d42c6eac9735c8016fae7c97ff661a47c"} Jun 03 23:31:14.333504 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:14.333124 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc65t/must-gather-d99h5" event={"ID":"cf2ae331-f7f3-4317-9d14-3167e95ec25e","Type":"ContainerStarted","Data":"148466e2c294a55c1f36f277eb3d2f613283e9fba7c3042f58f5b8998b65dcb8"} Jun 03 23:31:14.366481 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:14.366426 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xc65t/must-gather-d99h5" podStartSLOduration=1.513296821 podStartE2EDuration="2.36641018s" totalImagesPullingTime="853.113359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:31:14.364336857 +0000 UTC m=+2454.561359726" watchObservedRunningTime="2026-06-03 23:31:14.36641018 +0000 UTC m=+2454.563433048" Jun 03 23:31:15.779455 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:15.779405 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2xvmf_e38e8295-f82a-48d7-8c25-726eeed76404/global-pull-secret-syncer/0.log" Jun 03 23:31:15.968637 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:15.968604 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gjg7x_6315c8bf-857f-48ba-a84b-55549dae3d75/konnectivity-agent/0.log" Jun 03 23:31:16.088558 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:16.088479 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-45.ec2.internal_9756f600fbce4f01e92424ed781b5f3a/haproxy/0.log" Jun 03 23:31:21.634242 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:21.634124 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f4c5f499d-stnfw_40e2937b-6ebb-4518-bfeb-8eafaab41ba8/authorino/0.log" Jun 03 23:31:23.673595 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:23.673504 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-jlx8v_d697354a-1141-4b4e-9200-982ee4526c3c/kube-state-metrics/0.log" Jun 03 23:31:23.698344 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:23.698292 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-jlx8v_d697354a-1141-4b4e-9200-982ee4526c3c/kube-rbac-proxy-main/0.log" Jun 03 23:31:23.723865 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:23.723813 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-jlx8v_d697354a-1141-4b4e-9200-982ee4526c3c/kube-rbac-proxy-self/0.log" Jun 03 23:31:23.757722 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:23.757693 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-768dd4474d-hf2qj_103c9055-5f30-4f69-a95a-689505185b61/metrics-server/0.log" Jun 03 23:31:23.791999 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:23.791962 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-9b9fc658-pml2w_3ea2a325-6ef7-46f7-af21-74f9fc6774a7/monitoring-plugin/0.log" Jun 03 23:31:24.005818 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.005795 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5n9c_9423145a-05c7-40cd-9526-7af8602dc06d/node-exporter/0.log" Jun 03 23:31:24.032925 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.031327 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5n9c_9423145a-05c7-40cd-9526-7af8602dc06d/kube-rbac-proxy/0.log" Jun 03 23:31:24.056567 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.056542 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5n9c_9423145a-05c7-40cd-9526-7af8602dc06d/init-textfile/0.log" Jun 03 23:31:24.087793 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.087691 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-75dcm_dc1f805e-00cb-4ccd-9560-6005c8544711/kube-rbac-proxy-main/0.log" Jun 03 23:31:24.122962 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.122902 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-75dcm_dc1f805e-00cb-4ccd-9560-6005c8544711/kube-rbac-proxy-self/0.log" Jun 03 23:31:24.157493 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.157463 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-75dcm_dc1f805e-00cb-4ccd-9560-6005c8544711/openshift-state-metrics/0.log" Jun 03 23:31:24.219094 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.219060 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6bec3036-33ac-435d-90dd-0acc4c3c9581/prometheus/0.log" Jun 03 23:31:24.259524 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.259414 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6bec3036-33ac-435d-90dd-0acc4c3c9581/config-reloader/0.log" Jun 03 23:31:24.279876 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.279849 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6bec3036-33ac-435d-90dd-0acc4c3c9581/thanos-sidecar/0.log" Jun 03 23:31:24.303963 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.303862 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6bec3036-33ac-435d-90dd-0acc4c3c9581/kube-rbac-proxy-web/0.log" Jun 03 23:31:24.334978 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.334886 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6bec3036-33ac-435d-90dd-0acc4c3c9581/kube-rbac-proxy/0.log" Jun 03 23:31:24.360395 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.360327 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6bec3036-33ac-435d-90dd-0acc4c3c9581/kube-rbac-proxy-thanos/0.log" Jun 03 23:31:24.395144 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.395113 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6bec3036-33ac-435d-90dd-0acc4c3c9581/init-config-reloader/0.log" Jun 03 23:31:24.619420 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.619309 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-88b68f7c8-ttxgq_0ab23b79-f5f3-4ca3-83be-6f614b518013/thanos-query/0.log" Jun 03 23:31:24.643270 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.643241 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-88b68f7c8-ttxgq_0ab23b79-f5f3-4ca3-83be-6f614b518013/kube-rbac-proxy-web/0.log" Jun 03 23:31:24.668319 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.668292 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-88b68f7c8-ttxgq_0ab23b79-f5f3-4ca3-83be-6f614b518013/kube-rbac-proxy/0.log" Jun 03 23:31:24.702123 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.702090 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-88b68f7c8-ttxgq_0ab23b79-f5f3-4ca3-83be-6f614b518013/prom-label-proxy/0.log" Jun 03 23:31:24.732809 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.732781 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-88b68f7c8-ttxgq_0ab23b79-f5f3-4ca3-83be-6f614b518013/kube-rbac-proxy-rules/0.log" Jun 03 23:31:24.765084 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:24.765034 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-88b68f7c8-ttxgq_0ab23b79-f5f3-4ca3-83be-6f614b518013/kube-rbac-proxy-metrics/0.log" Jun 03 23:31:26.671001 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:26.670970 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/2.log" Jun 03 23:31:26.676652 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:26.676626 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-vdcxm_6fb8e45c-40ce-4d1b-9214-87dd9fb502ca/console-operator/3.log" Jun 03 23:31:27.300258 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:27.300226 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-56b467f5ff-x2jnw_ead0ab21-f636-48eb-a500-6e29e20cb53b/download-server/0.log" Jun 03 23:31:28.282930 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.282885 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp"] Jun 03 23:31:28.289612 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.289588 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.304567 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.304540 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp"] Jun 03 23:31:28.387809 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.387774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61f80f2d-7e29-428c-af4b-33240e42ec04-proc\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.387986 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.387841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61f80f2d-7e29-428c-af4b-33240e42ec04-sys\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.387986 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.387932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61f80f2d-7e29-428c-af4b-33240e42ec04-lib-modules\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.387986 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.387956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbx8q\" (UniqueName: \"kubernetes.io/projected/61f80f2d-7e29-428c-af4b-33240e42ec04-kube-api-access-cbx8q\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.388141 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.388001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61f80f2d-7e29-428c-af4b-33240e42ec04-podres\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.488869 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.488823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61f80f2d-7e29-428c-af4b-33240e42ec04-lib-modules\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.488869 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.488873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbx8q\" (UniqueName: \"kubernetes.io/projected/61f80f2d-7e29-428c-af4b-33240e42ec04-kube-api-access-cbx8q\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.489119 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.488922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61f80f2d-7e29-428c-af4b-33240e42ec04-podres\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.489119 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.488964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61f80f2d-7e29-428c-af4b-33240e42ec04-proc\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.489119 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.489013 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61f80f2d-7e29-428c-af4b-33240e42ec04-sys\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.489304 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.489132 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61f80f2d-7e29-428c-af4b-33240e42ec04-sys\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.489304 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.489281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61f80f2d-7e29-428c-af4b-33240e42ec04-lib-modules\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.489719 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.489690 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61f80f2d-7e29-428c-af4b-33240e42ec04-podres\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.489844 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.489759 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61f80f2d-7e29-428c-af4b-33240e42ec04-proc\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.497746 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.497712 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbx8q\" (UniqueName: \"kubernetes.io/projected/61f80f2d-7e29-428c-af4b-33240e42ec04-kube-api-access-cbx8q\") pod \"perf-node-gather-daemonset-chcrp\" (UID: \"61f80f2d-7e29-428c-af4b-33240e42ec04\") " pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.604061 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.603964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:28.782416 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:28.782337 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp"] Jun 03 23:31:28.786517 ip-10-0-143-45 kubenswrapper[2561]: W0603 23:31:28.786489 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod61f80f2d_7e29_428c_af4b_33240e42ec04.slice/crio-f7a21b5dc7b54d32f4cf1b5dcd854656518f04287ddbd1ef1c1da2417ff8f627 WatchSource:0}: Error finding container f7a21b5dc7b54d32f4cf1b5dcd854656518f04287ddbd1ef1c1da2417ff8f627: Status 404 returned error can't find the container with id f7a21b5dc7b54d32f4cf1b5dcd854656518f04287ddbd1ef1c1da2417ff8f627 Jun 03 23:31:29.273844 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:29.273815 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7rgls_5775370d-aa46-44ea-8fe3-77883c47feb4/dns/0.log" Jun 03 23:31:29.297498 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:29.297473 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7rgls_5775370d-aa46-44ea-8fe3-77883c47feb4/kube-rbac-proxy/0.log" Jun 03 23:31:29.447292 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:29.447250 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" event={"ID":"61f80f2d-7e29-428c-af4b-33240e42ec04","Type":"ContainerStarted","Data":"dba23d095d3c425518e64c3dd4e498337bf71113f304611b0082b5721a6046e6"} Jun 03 23:31:29.447474 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:29.447319 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" event={"ID":"61f80f2d-7e29-428c-af4b-33240e42ec04","Type":"ContainerStarted","Data":"f7a21b5dc7b54d32f4cf1b5dcd854656518f04287ddbd1ef1c1da2417ff8f627"} Jun 03 23:31:29.447474 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:29.447387 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:29.463364 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:29.463300 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" podStartSLOduration=1.463280396 podStartE2EDuration="1.463280396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:31:29.461572671 +0000 UTC m=+2469.658595532" watchObservedRunningTime="2026-06-03 23:31:29.463280396 +0000 UTC m=+2469.660303265" Jun 03 23:31:29.485077 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:29.485048 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gjk4g_f115edfc-b8cf-40d0-a424-e990f478cab3/dns-node-resolver/0.log" Jun 03 23:31:30.139645 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:30.139611 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xkqbx_75cdff9b-2d30-4a8e-bb7b-685011837e4b/node-ca/0.log" Jun 03 23:31:31.249835 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:31.249800 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f59d86b67-2f857_29540219-0f24-41c0-9b11-815539a1a4e7/kube-auth-proxy/0.log" Jun 03 23:31:31.313558 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:31.313525 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-wz7gz_3a543b8e-2187-4935-b1f9-5186ab492232/istio-proxy/0.log" Jun 03 23:31:31.355674 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:31.355644 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-wz7gz_3a543b8e-2187-4935-b1f9-5186ab492232/istio-proxy/1.log" Jun 03 23:31:32.133194 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:32.133165 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6gdqg_d38c13ae-5d62-404a-98f7-67fa2bd677f5/serve-healthcheck-canary/0.log" Jun 03 23:31:32.791274 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:32.791246 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c5b8w_ed5cf7ee-4768-4132-a2ee-27887e95ad26/kube-rbac-proxy/0.log" Jun 03 23:31:32.813326 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:32.813301 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c5b8w_ed5cf7ee-4768-4132-a2ee-27887e95ad26/exporter/0.log" Jun 03 23:31:32.836582 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:32.836548 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c5b8w_ed5cf7ee-4768-4132-a2ee-27887e95ad26/extractor/0.log" Jun 03 23:31:35.465162 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:35.465135 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xc65t/perf-node-gather-daemonset-chcrp" Jun 03 23:31:35.987932 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:35.987903 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-967f449d5-lgkjb_26fde37d-7c3f-47c9-a669-384a5b0fd498/manager/0.log" Jun 03 23:31:36.086407 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:36.086380 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-967f449d5-lgkjb_26fde37d-7c3f-47c9-a669-384a5b0fd498/copy-manifests/0.log" Jun 03 23:31:36.124895 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:36.124864 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-nzn7j_30dd9aba-691d-4c6c-a543-950ea1e9a4e3/postgres/0.log" Jun 03 23:31:37.982425 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:37.982328 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-747dfb677c-ffdcp_5583a325-1335-48bc-b51e-077aae784b8c/manager/0.log" Jun 03 23:31:40.800355 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:40.800326 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f59d86b67-2f857_29540219-0f24-41c0-9b11-815539a1a4e7/kube-auth-proxy/0.log" Jun 03 23:31:40.846165 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:40.846126 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-wz7gz_3a543b8e-2187-4935-b1f9-5186ab492232/istio-proxy/0.log" Jun 03 23:31:40.892675 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:40.892613 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-wz7gz_3a543b8e-2187-4935-b1f9-5186ab492232/istio-proxy/1.log" Jun 03 23:31:42.323229 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:42.323177 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f59d86b67-2f857_29540219-0f24-41c0-9b11-815539a1a4e7/kube-auth-proxy/0.log" Jun 03 23:31:42.364496 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:42.364463 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-wz7gz_3a543b8e-2187-4935-b1f9-5186ab492232/istio-proxy/0.log" Jun 03 23:31:42.412999 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:42.412970 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-wz7gz_3a543b8e-2187-4935-b1f9-5186ab492232/istio-proxy/1.log" Jun 03 23:31:43.512972 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:43.512942 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-wsx4b_055070ac-4422-430a-b4bf-9b770f5f9f2e/migrator/0.log" Jun 03 23:31:43.534645 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:43.534613 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-wsx4b_055070ac-4422-430a-b4bf-9b770f5f9f2e/graceful-termination/0.log" Jun 03 23:31:44.404646 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:44.404602 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f59d86b67-2f857_29540219-0f24-41c0-9b11-815539a1a4e7/kube-auth-proxy/0.log" Jun 03 23:31:44.442234 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:44.442154 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-wz7gz_3a543b8e-2187-4935-b1f9-5186ab492232/istio-proxy/0.log" Jun 03 23:31:44.483522 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:44.483494 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-wz7gz_3a543b8e-2187-4935-b1f9-5186ab492232/istio-proxy/1.log" Jun 03 23:31:45.113405 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:45.113376 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7h7zh_a434b67e-5ad2-4b55-8e0f-2843fb14a46b/kube-multus/0.log" Jun 03 23:31:45.173277 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:45.173250 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4htsl_56d468f4-bdc5-4de2-b6c8-4cf46f46d744/kube-multus-additional-cni-plugins/0.log" Jun 03 23:31:45.195170 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:45.195146 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4htsl_56d468f4-bdc5-4de2-b6c8-4cf46f46d744/egress-router-binary-copy/0.log" Jun 03 23:31:45.218558 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:45.218538 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4htsl_56d468f4-bdc5-4de2-b6c8-4cf46f46d744/cni-plugins/0.log" Jun 03 23:31:45.241861 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:45.241835 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4htsl_56d468f4-bdc5-4de2-b6c8-4cf46f46d744/bond-cni-plugin/0.log" Jun 03 23:31:45.268433 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:45.268408 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4htsl_56d468f4-bdc5-4de2-b6c8-4cf46f46d744/routeoverride-cni/0.log" Jun 03 23:31:45.290610 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:45.290533 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4htsl_56d468f4-bdc5-4de2-b6c8-4cf46f46d744/whereabouts-cni-bincopy/0.log" Jun 03 23:31:45.314394 ip-10-0-143-45 kubenswrapper[2561]: I0603 23:31:45.314371 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4htsl_56d468f4-bdc5-4de2-b6c8-4cf46f46d744/whereabouts-cni/0.log"