Jun 09 12:31:42.045641 ip-10-0-141-52 systemd[1]: Starting Kubernetes Kubelet... Jun 09 12:31:42.438966 ip-10-0-141-52 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:31:42.438966 ip-10-0-141-52 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 12:31:42.438966 ip-10-0-141-52 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:31:42.438966 ip-10-0-141-52 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 12:31:42.438966 ip-10-0-141-52 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:31:42.440614 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.440535 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 12:31:42.451458 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451437 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:42.451458 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451454 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:42.451458 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451460 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:42.451458 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451465 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451468 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451472 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451475 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451478 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451482 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451486 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451489 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451492 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451496 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451498 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451501 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451504 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451507 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451509 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451512 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451515 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451517 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451520 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451523 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:42.451633 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451526 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451528 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451531 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451535 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451539 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451542 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451544 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451547 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451550 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451553 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451556 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451559 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451562 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451564 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451568 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451571 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451573 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451576 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451578 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:42.452103 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451581 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451584 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451586 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451589 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451592 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451595 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451597 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451600 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451602 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451605 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451608 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451610 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451613 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451616 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451618 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451621 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451623 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451626 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451628 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451632 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451635 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:42.452582 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451637 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451640 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451642 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451645 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451648 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451651 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451653 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451656 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451659 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451661 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451664 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451666 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451670 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451672 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451675 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451678 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451680 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451683 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451686 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451688 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:42.453078 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451692 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451694 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451697 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451699 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451702 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451704 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451707 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451709 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451712 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451714 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451717 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451720 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451723 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451725 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451728 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.451731 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452470 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452478 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452481 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:42.453579 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452485 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452488 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452491 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452494 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452496 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452499 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452502 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452505 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452508 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452512 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452516 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452518 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452521 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452523 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452527 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452529 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452532 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452535 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452537 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452540 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:42.454043 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452542 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452545 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452548 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452551 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452554 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452556 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452559 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452562 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452565 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452567 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452570 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452573 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452576 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452579 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452581 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452584 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452587 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452589 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452592 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452595 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:42.454559 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452598 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452601 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452604 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452607 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452609 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452611 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452614 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452617 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452620 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452622 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452625 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452627 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452630 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452633 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452635 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452639 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452642 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452645 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452649 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452653 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:42.455053 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452656 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452660 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452663 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452666 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452669 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452672 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452675 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452678 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452681 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452684 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452686 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452689 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452691 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452694 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452696 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452699 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452701 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452704 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452706 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452709 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:42.455555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452712 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452714 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452717 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452719 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452723 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452726 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452729 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452732 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452735 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452738 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452741 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452744 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452747 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452749 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452752 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.452755 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453139 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453144 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453147 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:42.456072 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453151 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453154 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453157 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453160 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453163 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453165 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453168 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453172 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453176 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453179 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453183 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453186 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453189 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453193 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453197 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453199 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453203 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453207 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453210 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:42.456545 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453212 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453215 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453218 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453221 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453224 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453226 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453228 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453231 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453234 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453236 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453238 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453241 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453243 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453246 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453248 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453251 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453253 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453256 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453258 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453261 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:42.457006 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453263 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453266 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453268 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453271 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453278 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453280 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453283 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453286 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453289 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453292 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453295 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453297 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453300 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453303 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453305 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453308 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453310 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453313 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453315 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453318 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:42.457555 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453320 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453323 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453325 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453328 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453331 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453334 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453336 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453339 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453341 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453344 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453346 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453349 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453351 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453353 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453382 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453386 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453391 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453393 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453398 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453401 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:42.458033 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453404 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453406 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453409 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453411 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453414 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453419 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453422 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453424 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453427 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453429 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453432 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453434 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453437 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453439 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453442 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453444 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.453447 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453516 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453523 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453555 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453560 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 12:31:42.458614 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453564 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453567 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453571 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453575 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453578 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453582 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453586 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453591 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453594 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453597 2577 flags.go:64] FLAG: --cgroup-root="" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453600 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453603 2577 flags.go:64] FLAG: --client-ca-file="" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453607 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453610 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453614 2577 flags.go:64] FLAG: --cluster-domain="" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453617 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453622 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453625 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453628 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453632 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453635 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453638 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453641 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453643 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 09 12:31:42.459122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453646 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453649 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453652 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453655 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453659 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453662 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453665 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453668 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453671 2577 flags.go:64] FLAG: --enable-server="true" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453673 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453678 2577 flags.go:64] FLAG: --event-burst="100" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453681 2577 flags.go:64] FLAG: --event-qps="50" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453684 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453687 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453690 2577 flags.go:64] FLAG: --eviction-hard="" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453695 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453698 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453701 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453704 2577 flags.go:64] FLAG: --eviction-soft="" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453706 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453709 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453713 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453716 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453718 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453726 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 12:31:42.459703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453729 2577 flags.go:64] FLAG: --feature-gates="" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453733 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453736 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453739 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453742 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453745 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453747 2577 flags.go:64] FLAG: --help="false" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453750 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453753 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453756 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453759 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453762 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453765 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453768 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453771 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453774 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453777 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453780 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453783 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453786 2577 flags.go:64] FLAG: --kube-reserved="" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453788 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453791 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453796 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453798 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 12:31:42.460371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453801 2577 flags.go:64] FLAG: --lock-file="" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453804 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453807 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453810 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453815 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453818 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453821 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453825 2577 flags.go:64] FLAG: --logging-format="text" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453828 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453831 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453834 2577 flags.go:64] FLAG: --manifest-url="" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453837 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453841 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453844 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453848 2577 flags.go:64] FLAG: --max-pods="110" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453851 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453854 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453856 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453859 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453862 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453865 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453868 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453875 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453878 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453881 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 12:31:42.460969 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453884 2577 flags.go:64] FLAG: --pod-cidr="" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453886 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453892 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453895 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453898 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453901 2577 flags.go:64] FLAG: --port="10250" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453905 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453908 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02ff365afa46bbfda" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453911 2577 flags.go:64] FLAG: --qos-reserved="" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453914 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453917 2577 flags.go:64] FLAG: --register-node="true" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453920 2577 flags.go:64] FLAG: --register-with-taints="" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453923 2577 flags.go:64] FLAG: --registry-burst="10" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453927 2577 flags.go:64] FLAG: --registry-qps="5" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453931 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453934 2577 flags.go:64] FLAG: --reserved-memory="" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453937 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453941 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453943 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453946 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453949 2577 flags.go:64] FLAG: --runonce="false" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453952 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453954 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453957 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453960 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 12:31:42.461635 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453963 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453966 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453969 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453972 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453975 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453977 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453980 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453983 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453986 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453989 2577 flags.go:64] FLAG: --system-cgroups="" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453991 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453996 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.453999 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.454003 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.454007 2577 flags.go:64] FLAG: --tls-min-version="" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.454009 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.454012 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.454015 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.454018 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.454021 2577 flags.go:64] FLAG: --v="2" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.454024 2577 flags.go:64] FLAG: --version="false" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.454034 2577 flags.go:64] FLAG: --vmodule="" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.454038 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.454041 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 12:31:42.462265 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454150 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454155 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454159 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454163 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454166 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454170 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454174 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454177 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454180 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454183 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454186 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454189 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454192 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454195 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454198 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454200 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454203 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454205 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454208 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:42.462907 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454210 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454214 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454219 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454222 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454225 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454229 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454232 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454235 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454237 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454240 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454245 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454248 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454251 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454253 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454256 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454258 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454261 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454264 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454266 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:42.463376 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454269 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454271 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454274 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454277 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454279 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454282 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454284 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454287 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454289 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454292 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454294 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454297 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454300 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454302 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454305 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454308 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454311 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454313 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454316 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:42.463841 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454318 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454321 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454324 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454326 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454330 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454333 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454336 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454338 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454341 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454344 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454346 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454348 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454351 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454353 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454373 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454377 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454380 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454382 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454385 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454388 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454390 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:42.464301 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454393 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454396 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454399 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454402 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454404 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454407 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454409 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454413 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454416 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454419 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454421 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454424 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454426 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454429 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454432 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454435 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454438 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454440 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454444 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454447 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:42.464823 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.454449 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.455080 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.461851 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.461866 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.461886 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.461892 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461946 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461951 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461954 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461957 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461960 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461963 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461965 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461968 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:42.465315 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461970 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461975 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461979 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461982 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461985 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461988 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461991 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461994 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.461997 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462001 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462005 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462008 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462010 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462013 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462016 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462018 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462021 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462024 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462026 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:42.465697 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462030 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462032 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462036 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462040 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462043 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462045 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462048 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462051 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462054 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462056 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462059 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462061 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462064 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462066 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462069 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462071 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462074 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462077 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462079 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462082 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:42.466150 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462085 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462087 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462090 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462092 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462095 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462097 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462100 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462102 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462105 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462108 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462110 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462113 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462115 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462118 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462121 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462124 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462127 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462129 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462132 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:42.466660 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462136 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462139 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462142 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462144 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462147 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462150 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462152 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462155 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462158 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462160 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462163 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462165 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462168 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462170 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462173 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462176 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462178 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462181 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462183 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462186 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:42.467115 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462188 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462191 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462193 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462196 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462198 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462201 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462203 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462207 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462222 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462226 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462230 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462233 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462235 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.462240 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462349 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:42.467599 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462353 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462370 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462375 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462379 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462384 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462387 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462389 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462392 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462395 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462398 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462400 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462403 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462406 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462409 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462412 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462415 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462417 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462420 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462422 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462425 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:42.467964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462428 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462431 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462434 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462436 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462439 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462443 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462445 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462449 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462451 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462454 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462456 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462459 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462461 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462464 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462466 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462469 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462472 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462476 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462478 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462481 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:42.468503 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462484 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462487 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462489 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462491 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462494 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462496 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462499 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462501 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462504 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462506 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462509 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462511 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462514 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462516 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462519 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462521 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462524 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462527 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462530 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462532 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:42.468996 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462540 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462543 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462546 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462548 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462551 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462553 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462556 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462560 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462563 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462565 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462568 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462571 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462574 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462577 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462579 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462583 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462585 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462588 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462591 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:42.469521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462594 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462597 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462599 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462602 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462604 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462607 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462609 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462612 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462614 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462617 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462621 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462623 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462626 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462628 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462631 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462634 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462637 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462639 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:42.469977 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:42.462642 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:42.470543 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.462647 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:31:42.470543 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.462745 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 12:31:42.470543 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.464709 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 12:31:42.470543 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.466283 2577 server.go:1019] "Starting client certificate rotation" Jun 09 12:31:42.470543 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.466387 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 12:31:42.470543 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.466422 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 12:31:42.470543 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.469426 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 12:31:42.470768 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.470751 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 12:31:42.479830 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.479810 2577 log.go:25] "Validated CRI v1 runtime API" Jun 09 12:31:42.482327 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.482313 2577 log.go:25] "Validated CRI v1 image API" Jun 09 12:31:42.483106 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.483091 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 12:31:42.486111 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.486094 2577 fs.go:135] Filesystem UUIDs: map[194803de-6273-434d-9eae-ce8803332d2f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e695b920-6a16-4ddc-9ca5-98cac1e21187:/dev/nvme0n1p4] Jun 09 12:31:42.486177 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.486111 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 12:31:42.492281 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.492260 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 12:31:42.492932 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.492829 2577 manager.go:216] Machine: {Timestamp:2026-06-09 12:31:42.490688254 +0000 UTC m=+0.332719335 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102331 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27f8495b868687879ea22001f5ca5a SystemUUID:ec27f849-5b86-8687-879e-a22001f5ca5a BootID:6b635fc3-a407-49ef-86f5-95ac4cde10c9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:db:a0:93:1d:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:db:a0:93:1d:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:e8:e0:28:57:56 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 12:31:42.492932 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.492928 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 12:31:42.493023 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.493001 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 12:31:42.496333 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.496309 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 12:31:42.496481 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.496336 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-52.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 12:31:42.497619 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.497608 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 12:31:42.497657 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.497622 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 12:31:42.497657 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.497629 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 12:31:42.498386 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.498376 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 12:31:42.499207 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.499197 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 12:31:42.502553 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.502542 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 12:31:42.502664 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.502655 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 12:31:42.502698 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.502683 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 09 12:31:42.502698 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.502693 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 12:31:42.502758 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.502706 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 12:31:42.502758 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.502715 2577 kubelet.go:398] "Adding apiserver pod source" Jun 09 12:31:42.502758 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.502724 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 12:31:42.503034 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.503023 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 12:31:42.503070 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.503040 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 12:31:42.505130 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.505113 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 12:31:42.506405 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.506392 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 12:31:42.506455 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.506422 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 12:31:42.507107 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.507096 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 12:31:42.507143 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.507114 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 12:31:42.507143 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.507123 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 12:31:42.507143 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.507131 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 12:31:42.507143 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.507140 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 12:31:42.507247 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.507145 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 12:31:42.507247 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.507197 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 12:31:42.507247 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.507202 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 12:31:42.507247 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.507210 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 12:31:42.507247 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.507216 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 12:31:42.507247 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.507224 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 12:31:42.507247 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.507233 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 12:31:42.508693 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.508681 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 12:31:42.508693 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.508691 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 12:31:42.511803 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.511789 2577 server.go:1268] "Started kubelet" Jun 09 12:31:42.511941 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.511895 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 12:31:42.512245 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.512013 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 12:31:42.512382 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.512349 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 12:31:42.512571 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.512547 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 12:31:42.512640 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.512579 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-52.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 12:31:42.512640 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.512629 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 12:31:42.512784 ip-10-0-141-52 systemd[1]: Started Kubernetes Kubelet. Jun 09 12:31:42.516082 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.516058 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 12:31:42.516227 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.516205 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nf6wk" Jun 09 12:31:42.519464 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.519448 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 09 12:31:42.520877 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.520859 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 12:31:42.521137 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.521122 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nf6wk" Jun 09 12:31:42.521413 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.520462 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-52.ec2.internal.18b7699d6d3c3245 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-52.ec2.internal,UID:ip-10-0-141-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-52.ec2.internal,},FirstTimestamp:2026-06-09 12:31:42.511764037 +0000 UTC m=+0.353795091,LastTimestamp:2026-06-09 12:31:42.511764037 +0000 UTC m=+0.353795091,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-52.ec2.internal,}" Jun 09 12:31:42.523714 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.523697 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 12:31:42.523798 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.523699 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 12:31:42.523850 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.523825 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:42.524676 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.524660 2577 factory.go:55] Registering systemd factory Jun 09 12:31:42.524751 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.524680 2577 factory.go:223] Registration of the systemd container factory successfully Jun 09 12:31:42.524894 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.524880 2577 factory.go:153] Registering CRI-O factory Jun 09 12:31:42.524974 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.524897 2577 factory.go:223] Registration of the crio container factory successfully Jun 09 12:31:42.524974 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.524942 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 12:31:42.524974 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.524967 2577 factory.go:103] Registering Raw factory Jun 09 12:31:42.525086 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.524982 2577 manager.go:1196] Started watching for new ooms in manager Jun 09 12:31:42.525302 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.525293 2577 manager.go:349] Starting recovery of all containers Jun 09 12:31:42.526338 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.526319 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 12:31:42.526415 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.526344 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 12:31:42.526415 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.526318 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 12:31:42.526523 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.526443 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 09 12:31:42.526523 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.526451 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 09 12:31:42.534781 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.534625 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:42.536272 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.536257 2577 manager.go:354] Recovery completed Jun 09 12:31:42.540538 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.540506 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.541125 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.541107 2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-52.ec2.internal\" not found" node="ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.542465 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.542451 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.542529 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.542478 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.542529 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.542490 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.543003 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.542990 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 12:31:42.543048 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.543009 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 12:31:42.543048 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.542994 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.543125 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.543025 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 12:31:42.543690 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.543675 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.543764 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.543703 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.543764 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.543714 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.544448 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.544436 2577 policy_none.go:49] "None policy: Start" Jun 09 12:31:42.544486 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.544452 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 12:31:42.544486 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.544462 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 12:31:42.545411 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.545400 2577 policy_none.go:47] "Start" Jun 09 12:31:42.590044 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.590026 2577 manager.go:337] "Starting Device Plugin manager" Jun 09 12:31:42.603016 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.590061 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 12:31:42.603016 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.590073 2577 server.go:87] "Starting device plugin registration server" Jun 09 12:31:42.603016 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.590326 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 12:31:42.603016 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.590338 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 12:31:42.603016 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.590468 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 12:31:42.603016 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.590554 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 12:31:42.603016 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.590564 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 12:31:42.603016 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.591113 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 12:31:42.603016 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.591163 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:42.603016 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.602947 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 12:31:42.604078 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.604065 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 12:31:42.604119 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.604097 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 12:31:42.604119 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.604114 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 12:31:42.604200 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.604141 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 12:31:42.606566 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.606545 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:42.690873 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.690810 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.691940 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.691924 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.692000 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.691954 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.692000 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.691964 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.692000 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.691986 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.699700 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.699686 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.699744 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.699712 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-52.ec2.internal\": node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:42.704345 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.704329 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal"] Jun 09 12:31:42.704415 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.704401 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.705672 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.705654 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.705739 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.705685 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.705739 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.705695 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.707040 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.707028 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.707189 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.707174 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.707261 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.707204 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.707676 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.707658 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.707750 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.707660 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.707750 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.707690 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.707750 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.707701 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.707750 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.707702 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.707871 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.707764 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.708689 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.708672 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.708772 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.708695 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.709290 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.709275 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.709403 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.709302 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.709403 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.709315 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.714548 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.714533 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:42.738937 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.738914 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-52.ec2.internal\" not found" node="ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.743312 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.743295 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-52.ec2.internal\" not found" node="ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.815426 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.815403 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:42.826800 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.826781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d27643021eafcb61b865d9df84505f61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal\" (UID: \"d27643021eafcb61b865d9df84505f61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.826862 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.826805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27643021eafcb61b865d9df84505f61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal\" (UID: \"d27643021eafcb61b865d9df84505f61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.826862 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.826822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/890bf00dd14a920e517744df78149aac-config\") pod \"kube-apiserver-proxy-ip-10-0-141-52.ec2.internal\" (UID: \"890bf00dd14a920e517744df78149aac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.915821 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:42.915799 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:42.927122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.927102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d27643021eafcb61b865d9df84505f61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal\" (UID: \"d27643021eafcb61b865d9df84505f61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.927184 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.927126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27643021eafcb61b865d9df84505f61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal\" (UID: \"d27643021eafcb61b865d9df84505f61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.927184 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.927146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/890bf00dd14a920e517744df78149aac-config\") pod \"kube-apiserver-proxy-ip-10-0-141-52.ec2.internal\" (UID: \"890bf00dd14a920e517744df78149aac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.927184 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.927174 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27643021eafcb61b865d9df84505f61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal\" (UID: \"d27643021eafcb61b865d9df84505f61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.927275 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.927190 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d27643021eafcb61b865d9df84505f61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal\" (UID: \"d27643021eafcb61b865d9df84505f61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" Jun 09 12:31:42.927275 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:42.927179 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/890bf00dd14a920e517744df78149aac-config\") pod \"kube-apiserver-proxy-ip-10-0-141-52.ec2.internal\" (UID: \"890bf00dd14a920e517744df78149aac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal" Jun 09 12:31:43.016688 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:43.016620 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:43.043100 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:43.043071 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" Jun 09 12:31:43.048143 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:43.048126 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal" Jun 09 12:31:43.117113 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:43.117081 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:43.217639 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:43.217613 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:43.318271 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:43.318200 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:43.418777 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:43.418741 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:43.465380 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:43.465312 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 12:31:43.466256 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:43.465482 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 12:31:43.466256 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:43.465511 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 12:31:43.519159 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:43.519141 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:43.523698 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:43.523666 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 12:26:42 +0000 UTC" deadline="2028-01-26 01:25:52.629419028 +0000 UTC" Jun 09 12:31:43.523748 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:43.523699 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14292h54m9.105722979s" Jun 09 12:31:43.528541 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:43.528515 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890bf00dd14a920e517744df78149aac.slice/crio-94617f22f2526b1d26ff08bbdd0f877f8b88b797b62aeef33e78f60e0e5fea19 WatchSource:0}: Error finding container 94617f22f2526b1d26ff08bbdd0f877f8b88b797b62aeef33e78f60e0e5fea19: Status 404 returned error can't find the container with id 94617f22f2526b1d26ff08bbdd0f877f8b88b797b62aeef33e78f60e0e5fea19 Jun 09 12:31:43.529853 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:43.529329 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27643021eafcb61b865d9df84505f61.slice/crio-2a5d6f3e74853afd426fb258b5e6ce2045b6bac387b658bab12751b5aeb1e14e WatchSource:0}: Error finding container 2a5d6f3e74853afd426fb258b5e6ce2045b6bac387b658bab12751b5aeb1e14e: Status 404 returned error can't find the container with id 2a5d6f3e74853afd426fb258b5e6ce2045b6bac387b658bab12751b5aeb1e14e Jun 09 12:31:43.534452 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:43.534438 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:31:43.608019 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:43.607926 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" event={"ID":"d27643021eafcb61b865d9df84505f61","Type":"ContainerStarted","Data":"2a5d6f3e74853afd426fb258b5e6ce2045b6bac387b658bab12751b5aeb1e14e"} Jun 09 12:31:43.608881 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:43.608862 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal" event={"ID":"890bf00dd14a920e517744df78149aac","Type":"ContainerStarted","Data":"94617f22f2526b1d26ff08bbdd0f877f8b88b797b62aeef33e78f60e0e5fea19"} Jun 09 12:31:43.620025 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:43.620005 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:43.720644 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:43.720613 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:43.821259 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:43.821227 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:43.921908 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:43.921834 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:44.017974 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.017933 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:44.022371 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:44.022333 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-52.ec2.internal\" not found" Jun 09 12:31:44.110604 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.110578 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:44.123987 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.123951 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" Jun 09 12:31:44.135554 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.135500 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 12:31:44.136686 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.136664 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal" Jun 09 12:31:44.144856 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.144832 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 12:31:44.355911 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.355876 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:44.496985 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.496903 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:44.504247 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.504191 2577 apiserver.go:52] "Watching apiserver" Jun 09 12:31:44.510576 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.510556 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 12:31:44.511560 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.511532 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-jrzmz","openshift-multus/network-metrics-daemon-79pkx","openshift-network-diagnostics/network-check-target-m59fd","openshift-ovn-kubernetes/ovnkube-node-zbzkh","kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g","openshift-cluster-node-tuning-operator/tuned-thjnp","openshift-dns/node-resolver-j7hnl","openshift-image-registry/node-ca-tgr7c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal","openshift-network-operator/iptables-alerter-zl9h9","kube-system/global-pull-secret-syncer-l4lmg","kube-system/konnectivity-agent-cjwvz","openshift-multus/multus-additional-cni-plugins-6c496"] Jun 09 12:31:44.514257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.513703 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.514930 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.514905 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zl9h9" Jun 09 12:31:44.516650 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.516330 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:44.516650 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.516441 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.516650 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.516467 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.516650 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.516490 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dv5dc\"" Jun 09 12:31:44.516650 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:44.516551 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:31:44.517240 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.517212 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.517612 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.517591 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 12:31:44.517724 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.517693 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fhhxn\"" Jun 09 12:31:44.517833 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.517818 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.518184 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.518163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.519803 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.519769 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.520643 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.520618 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 12:31:44.520795 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.520670 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-svcsw\"" Jun 09 12:31:44.521026 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.521009 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.521632 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.521012 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 12:31:44.521727 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.521066 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.521797 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.521088 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 12:31:44.521797 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.521129 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 12:31:44.521902 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.521454 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.523175 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.523153 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tgr7c" Jun 09 12:31:44.524744 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.523633 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 12:31:44.524744 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.523768 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.524744 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.523797 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 12:31:44.524744 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.523916 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 12:31:44.524744 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.524037 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.524744 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.524090 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gs8ct\"" Jun 09 12:31:44.525090 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.524974 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4v6q6\"" Jun 09 12:31:44.525610 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.525173 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 12:31:44.525610 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.525389 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.525610 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.525414 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.525610 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.525513 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 12:31:44.525610 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.525604 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cjwvz" Jun 09 12:31:44.526257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.526241 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.526435 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.526262 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 12:31:44.526521 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.526262 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.526578 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.526312 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wmbxc\"" Jun 09 12:31:44.526842 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.526817 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:44.526943 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:44.526915 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:31:44.527789 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.527768 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-phgdz\"" Jun 09 12:31:44.527905 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.527819 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 12:31:44.528422 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.528234 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 12:31:44.528422 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.528353 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7hnl" Jun 09 12:31:44.530451 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.530432 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.530570 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.530537 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.530644 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.530626 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q9j9v\"" Jun 09 12:31:44.530960 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.530939 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.532718 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.532669 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 12:31:44.532813 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.532771 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q5rr6\"" Jun 09 12:31:44.534083 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.533911 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:44.534083 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:44.533971 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:31:44.535897 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.535871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-kubernetes\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.535984 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.535908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtrxh\" (UniqueName: \"kubernetes.io/projected/72ffa2a6-d1fd-4b61-95a1-ac861711944e-kube-api-access-gtrxh\") pod \"iptables-alerter-zl9h9\" (UID: \"72ffa2a6-d1fd-4b61-95a1-ac861711944e\") " pod="openshift-network-operator/iptables-alerter-zl9h9" Jun 09 12:31:44.535984 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.535935 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/915be28b-282f-430a-9b47-404fee0638e0-os-release\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.535984 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.535959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/915be28b-282f-430a-9b47-404fee0638e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.536138 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.535983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ac32929-68a9-4a14-b995-75d2be312610-tmp\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.536138 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-var-lib-openvswitch\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.536138 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536052 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-etc-openvswitch\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.536138 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536084 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-log-socket\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.536578 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-ovn-node-metrics-cert\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.536659 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536608 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/72ffa2a6-d1fd-4b61-95a1-ac861711944e-iptables-alerter-script\") pod \"iptables-alerter-zl9h9\" (UID: \"72ffa2a6-d1fd-4b61-95a1-ac861711944e\") " pod="openshift-network-operator/iptables-alerter-zl9h9" Jun 09 12:31:44.536659 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-slash\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.536770 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-run-netns\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.536770 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-run-systemd\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.536770 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-run-ovn-kubernetes\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.536770 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536760 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-cni-netd\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.537008 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/686ef415-ee65-4648-8eff-2443ddb85bf8-serviceca\") pod \"node-ca-tgr7c\" (UID: \"686ef415-ee65-4648-8eff-2443ddb85bf8\") " pod="openshift-image-registry/node-ca-tgr7c" Jun 09 12:31:44.537008 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ngzw\" (UniqueName: \"kubernetes.io/projected/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-kube-api-access-9ngzw\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.537008 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a1ecc72-45f1-4e73-944f-91aab54f0209-tmp-dir\") pod \"node-resolver-j7hnl\" (UID: \"3a1ecc72-45f1-4e73-944f-91aab54f0209\") " pod="openshift-dns/node-resolver-j7hnl" Jun 09 12:31:44.537008 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/915be28b-282f-430a-9b47-404fee0638e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.537008 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536899 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-socket-dir\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.537008 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:44.537008 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-run-ovn\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.537008 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.536981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-registration-dir\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.537008 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537002 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/686ef415-ee65-4648-8eff-2443ddb85bf8-host\") pod \"node-ca-tgr7c\" (UID: \"686ef415-ee65-4648-8eff-2443ddb85bf8\") " pod="openshift-image-registry/node-ca-tgr7c" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537026 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-modprobe-d\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-etc-selinux\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwhpp\" (UniqueName: \"kubernetes.io/projected/686ef415-ee65-4648-8eff-2443ddb85bf8-kube-api-access-hwhpp\") pod \"node-ca-tgr7c\" (UID: \"686ef415-ee65-4648-8eff-2443ddb85bf8\") " pod="openshift-image-registry/node-ca-tgr7c" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537094 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grk4w\" (UniqueName: \"kubernetes.io/projected/3da83d31-bbe3-4848-bbf4-a71740b91448-kube-api-access-grk4w\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537124 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-sys\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537147 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/915be28b-282f-430a-9b47-404fee0638e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvkbr\" (UniqueName: \"kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr\") pod \"network-check-target-m59fd\" (UID: \"73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e\") " pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-env-overrides\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7bb52492-ccd4-4eae-b38a-cc4a6df5c20c-agent-certs\") pod \"konnectivity-agent-cjwvz\" (UID: \"7bb52492-ccd4-4eae-b38a-cc4a6df5c20c\") " pod="kube-system/konnectivity-agent-cjwvz" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/915be28b-282f-430a-9b47-404fee0638e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537283 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2smp\" (UniqueName: \"kubernetes.io/projected/3a1ecc72-45f1-4e73-944f-91aab54f0209-kube-api-access-f2smp\") pod \"node-resolver-j7hnl\" (UID: \"3a1ecc72-45f1-4e73-944f-91aab54f0209\") " pod="openshift-dns/node-resolver-j7hnl" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537297 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-sysctl-d\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-host\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537329 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-run-openvswitch\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-ovnkube-config\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.537450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537398 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-sys-fs\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwd55\" (UniqueName: \"kubernetes.io/projected/b30992a6-11c1-4c39-9b53-a19bfb455c12-kube-api-access-lwd55\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-kubelet\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7bb52492-ccd4-4eae-b38a-cc4a6df5c20c-konnectivity-ca\") pod \"konnectivity-agent-cjwvz\" (UID: \"7bb52492-ccd4-4eae-b38a-cc4a6df5c20c\") " pod="kube-system/konnectivity-agent-cjwvz" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-systemd\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72ffa2a6-d1fd-4b61-95a1-ac861711944e-host-slash\") pod \"iptables-alerter-zl9h9\" (UID: \"72ffa2a6-d1fd-4b61-95a1-ac861711944e\") " pod="openshift-network-operator/iptables-alerter-zl9h9" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-systemd-units\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-cni-bin\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-ovnkube-script-lib\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-var-lib-kubelet\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/915be28b-282f-430a-9b47-404fee0638e0-system-cni-dir\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537715 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-sysctl-conf\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537754 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ac32929-68a9-4a14-b995-75d2be312610-etc-tuned\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c58lf\" (UniqueName: \"kubernetes.io/projected/915be28b-282f-430a-9b47-404fee0638e0-kube-api-access-c58lf\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-sysconfig\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.538162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/915be28b-282f-430a-9b47-404fee0638e0-cnibin\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.538952 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.538952 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a1ecc72-45f1-4e73-944f-91aab54f0209-hosts-file\") pod \"node-resolver-j7hnl\" (UID: \"3a1ecc72-45f1-4e73-944f-91aab54f0209\") " pod="openshift-dns/node-resolver-j7hnl" Jun 09 12:31:44.538952 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7znhp\" (UniqueName: \"kubernetes.io/projected/1ac32929-68a9-4a14-b995-75d2be312610-kube-api-access-7znhp\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.538952 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.537979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-device-dir\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.538952 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.538000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-run\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.538952 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.538022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-lib-modules\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.538952 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.538074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-node-log\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.540991 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.540695 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 12:31:44.557923 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.557901 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kh927" Jun 09 12:31:44.567605 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.567580 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kh927" Jun 09 12:31:44.627958 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.627930 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 12:31:44.638568 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-etc-openvswitch\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.638725 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638573 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-log-socket\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.638725 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-ovn-node-metrics-cert\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.638725 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/72ffa2a6-d1fd-4b61-95a1-ac861711944e-iptables-alerter-script\") pod \"iptables-alerter-zl9h9\" (UID: \"72ffa2a6-d1fd-4b61-95a1-ac861711944e\") " pod="openshift-network-operator/iptables-alerter-zl9h9" Jun 09 12:31:44.638725 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-slash\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.638725 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638663 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-run-netns\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.638725 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638669 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-log-socket\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.638725 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-run-systemd\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.638725 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-etc-openvswitch\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.638725 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638707 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-run-ovn-kubernetes\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-cni-netd\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638746 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-run-systemd\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638749 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-run-netns\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/686ef415-ee65-4648-8eff-2443ddb85bf8-serviceca\") pod \"node-ca-tgr7c\" (UID: \"686ef415-ee65-4648-8eff-2443ddb85bf8\") " pod="openshift-image-registry/node-ca-tgr7c" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638799 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-run-ovn-kubernetes\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638832 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-slash\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ngzw\" (UniqueName: \"kubernetes.io/projected/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-kube-api-access-9ngzw\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a1ecc72-45f1-4e73-944f-91aab54f0209-tmp-dir\") pod \"node-resolver-j7hnl\" (UID: \"3a1ecc72-45f1-4e73-944f-91aab54f0209\") " pod="openshift-dns/node-resolver-j7hnl" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-cni-netd\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/915be28b-282f-430a-9b47-404fee0638e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-os-release\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-multus-socket-dir-parent\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.638991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-hostroot\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-socket-dir\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639021 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-cni-binary-copy\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.639134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-run-k8s-cni-cncf-io\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639110 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae3ae62f-afb3-4025-ab11-5a27262a37b9-dbus\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-run-ovn\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639157 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-registration-dir\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/686ef415-ee65-4648-8eff-2443ddb85bf8-host\") pod \"node-ca-tgr7c\" (UID: \"686ef415-ee65-4648-8eff-2443ddb85bf8\") " pod="openshift-image-registry/node-ca-tgr7c" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639198 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a1ecc72-45f1-4e73-944f-91aab54f0209-tmp-dir\") pod \"node-resolver-j7hnl\" (UID: \"3a1ecc72-45f1-4e73-944f-91aab54f0209\") " pod="openshift-dns/node-resolver-j7hnl" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-modprobe-d\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639239 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/686ef415-ee65-4648-8eff-2443ddb85bf8-serviceca\") pod \"node-ca-tgr7c\" (UID: \"686ef415-ee65-4648-8eff-2443ddb85bf8\") " pod="openshift-image-registry/node-ca-tgr7c" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-cnibin\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-run-netns\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/72ffa2a6-d1fd-4b61-95a1-ac861711944e-iptables-alerter-script\") pod \"iptables-alerter-zl9h9\" (UID: \"72ffa2a6-d1fd-4b61-95a1-ac861711944e\") " pod="openshift-network-operator/iptables-alerter-zl9h9" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-socket-dir\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-etc-selinux\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639385 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhpp\" (UniqueName: \"kubernetes.io/projected/686ef415-ee65-4648-8eff-2443ddb85bf8-kube-api-access-hwhpp\") pod \"node-ca-tgr7c\" (UID: \"686ef415-ee65-4648-8eff-2443ddb85bf8\") " pod="openshift-image-registry/node-ca-tgr7c" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639387 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-run-ovn\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639393 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/686ef415-ee65-4648-8eff-2443ddb85bf8-host\") pod \"node-ca-tgr7c\" (UID: \"686ef415-ee65-4648-8eff-2443ddb85bf8\") " pod="openshift-image-registry/node-ca-tgr7c" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/915be28b-282f-430a-9b47-404fee0638e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:44.639409 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:44.639948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639340 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-registration-dir\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grk4w\" (UniqueName: \"kubernetes.io/projected/3da83d31-bbe3-4848-bbf4-a71740b91448-kube-api-access-grk4w\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639439 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-modprobe-d\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639483 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-etc-selinux\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639489 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-sys\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639445 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-sys\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:44.639512 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs podName:3da83d31-bbe3-4848-bbf4-a71740b91448 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:45.139490929 +0000 UTC m=+2.981521985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs") pod "network-metrics-daemon-79pkx" (UID: "3da83d31-bbe3-4848-bbf4-a71740b91448") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/915be28b-282f-430a-9b47-404fee0638e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639681 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvkbr\" (UniqueName: \"kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr\") pod \"network-check-target-m59fd\" (UID: \"73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e\") " pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-env-overrides\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7bb52492-ccd4-4eae-b38a-cc4a6df5c20c-agent-certs\") pod \"konnectivity-agent-cjwvz\" (UID: \"7bb52492-ccd4-4eae-b38a-cc4a6df5c20c\") " pod="kube-system/konnectivity-agent-cjwvz" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/915be28b-282f-430a-9b47-404fee0638e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.639995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-var-lib-cni-multus\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2smp\" (UniqueName: \"kubernetes.io/projected/3a1ecc72-45f1-4e73-944f-91aab54f0209-kube-api-access-f2smp\") pod \"node-resolver-j7hnl\" (UID: \"3a1ecc72-45f1-4e73-944f-91aab54f0209\") " pod="openshift-dns/node-resolver-j7hnl" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-sysctl-d\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-host\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.640791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640094 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-run-openvswitch\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640117 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-ovnkube-config\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/915be28b-282f-430a-9b47-404fee0638e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640165 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-sys-fs\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwd55\" (UniqueName: \"kubernetes.io/projected/b30992a6-11c1-4c39-9b53-a19bfb455c12-kube-api-access-lwd55\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-env-overrides\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-var-lib-cni-bin\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-kubelet\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640334 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7bb52492-ccd4-4eae-b38a-cc4a6df5c20c-konnectivity-ca\") pod \"konnectivity-agent-cjwvz\" (UID: \"7bb52492-ccd4-4eae-b38a-cc4a6df5c20c\") " pod="kube-system/konnectivity-agent-cjwvz" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-systemd\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-run-multus-certs\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640421 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-host\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640464 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-run-openvswitch\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-kubelet\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72ffa2a6-d1fd-4b61-95a1-ac861711944e-host-slash\") pod \"iptables-alerter-zl9h9\" (UID: \"72ffa2a6-d1fd-4b61-95a1-ac861711944e\") " pod="openshift-network-operator/iptables-alerter-zl9h9" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-systemd-units\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640533 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72ffa2a6-d1fd-4b61-95a1-ac861711944e-host-slash\") pod \"iptables-alerter-zl9h9\" (UID: \"72ffa2a6-d1fd-4b61-95a1-ac861711944e\") " pod="openshift-network-operator/iptables-alerter-zl9h9" Jun 09 12:31:44.641582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-cni-bin\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640574 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-sysctl-d\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640573 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-ovnkube-script-lib\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-var-lib-kubelet\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/915be28b-282f-430a-9b47-404fee0638e0-system-cni-dir\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-multus-conf-dir\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640680 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-sysctl-conf\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ac32929-68a9-4a14-b995-75d2be312610-etc-tuned\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640711 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-ovnkube-config\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c58lf\" (UniqueName: \"kubernetes.io/projected/915be28b-282f-430a-9b47-404fee0638e0-kube-api-access-c58lf\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640787 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-sysconfig\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/915be28b-282f-430a-9b47-404fee0638e0-cnibin\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640831 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-var-lib-kubelet\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-sysctl-conf\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwm5t\" (UniqueName: \"kubernetes.io/projected/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-kube-api-access-dwm5t\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.642478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-systemd-units\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640887 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-sys-fs\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.640993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a1ecc72-45f1-4e73-944f-91aab54f0209-hosts-file\") pod \"node-resolver-j7hnl\" (UID: \"3a1ecc72-45f1-4e73-944f-91aab54f0209\") " pod="openshift-dns/node-resolver-j7hnl" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641047 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7bb52492-ccd4-4eae-b38a-cc4a6df5c20c-konnectivity-ca\") pod \"konnectivity-agent-cjwvz\" (UID: \"7bb52492-ccd4-4eae-b38a-cc4a6df5c20c\") " pod="kube-system/konnectivity-agent-cjwvz" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7znhp\" (UniqueName: \"kubernetes.io/projected/1ac32929-68a9-4a14-b995-75d2be312610-kube-api-access-7znhp\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-multus-cni-dir\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641076 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-ovnkube-script-lib\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-multus-daemon-config\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae3ae62f-afb3-4025-ab11-5a27262a37b9-kubelet-config\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641151 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-cni-bin\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-device-dir\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641210 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-systemd\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-run\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641241 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/915be28b-282f-430a-9b47-404fee0638e0-cnibin\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.643288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-sysconfig\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641281 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/915be28b-282f-430a-9b47-404fee0638e0-system-cni-dir\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-lib-modules\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-system-cni-dir\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641325 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-run\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641340 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/915be28b-282f-430a-9b47-404fee0638e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-var-lib-kubelet\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641401 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b30992a6-11c1-4c39-9b53-a19bfb455c12-device-dir\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641426 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-lib-modules\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641477 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a1ecc72-45f1-4e73-944f-91aab54f0209-hosts-file\") pod \"node-resolver-j7hnl\" (UID: \"3a1ecc72-45f1-4e73-944f-91aab54f0209\") " pod="openshift-dns/node-resolver-j7hnl" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-node-log\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-kubernetes\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtrxh\" (UniqueName: \"kubernetes.io/projected/72ffa2a6-d1fd-4b61-95a1-ac861711944e-kube-api-access-gtrxh\") pod \"iptables-alerter-zl9h9\" (UID: \"72ffa2a6-d1fd-4b61-95a1-ac861711944e\") " pod="openshift-network-operator/iptables-alerter-zl9h9" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac32929-68a9-4a14-b995-75d2be312610-etc-kubernetes\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/915be28b-282f-430a-9b47-404fee0638e0-os-release\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641609 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-node-log\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/915be28b-282f-430a-9b47-404fee0638e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.644054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641669 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-etc-kubernetes\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.644646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ac32929-68a9-4a14-b995-75d2be312610-tmp\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.644646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641699 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/915be28b-282f-430a-9b47-404fee0638e0-os-release\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.644646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-var-lib-openvswitch\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.644646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.641863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-var-lib-openvswitch\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.644646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.642124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/915be28b-282f-430a-9b47-404fee0638e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.644646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.642935 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-ovn-node-metrics-cert\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.644646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.643484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ac32929-68a9-4a14-b995-75d2be312610-etc-tuned\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.644646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.644029 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7bb52492-ccd4-4eae-b38a-cc4a6df5c20c-agent-certs\") pod \"konnectivity-agent-cjwvz\" (UID: \"7bb52492-ccd4-4eae-b38a-cc4a6df5c20c\") " pod="kube-system/konnectivity-agent-cjwvz" Jun 09 12:31:44.644646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.644195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ac32929-68a9-4a14-b995-75d2be312610-tmp\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.648867 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:44.648211 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:44.648867 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:44.648234 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:44.648867 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:44.648248 2577 projected.go:196] Error preparing data for projected volume kube-api-access-tvkbr for pod openshift-network-diagnostics/network-check-target-m59fd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:44.648867 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:44.648304 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr podName:73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e nodeName:}" failed. No retries permitted until 2026-06-09 12:31:45.148287025 +0000 UTC m=+2.990318085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tvkbr" (UniqueName: "kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr") pod "network-check-target-m59fd" (UID: "73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:44.650418 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.649888 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwd55\" (UniqueName: \"kubernetes.io/projected/b30992a6-11c1-4c39-9b53-a19bfb455c12-kube-api-access-lwd55\") pod \"aws-ebs-csi-driver-node-rmv8g\" (UID: \"b30992a6-11c1-4c39-9b53-a19bfb455c12\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.650585 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.650516 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ngzw\" (UniqueName: \"kubernetes.io/projected/8114e26e-e0ed-4d9f-b952-91d24ef77fe6-kube-api-access-9ngzw\") pod \"ovnkube-node-zbzkh\" (UID: \"8114e26e-e0ed-4d9f-b952-91d24ef77fe6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.651752 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.651560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c58lf\" (UniqueName: \"kubernetes.io/projected/915be28b-282f-430a-9b47-404fee0638e0-kube-api-access-c58lf\") pod \"multus-additional-cni-plugins-6c496\" (UID: \"915be28b-282f-430a-9b47-404fee0638e0\") " pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.651839 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.651806 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2smp\" (UniqueName: \"kubernetes.io/projected/3a1ecc72-45f1-4e73-944f-91aab54f0209-kube-api-access-f2smp\") pod \"node-resolver-j7hnl\" (UID: \"3a1ecc72-45f1-4e73-944f-91aab54f0209\") " pod="openshift-dns/node-resolver-j7hnl" Jun 09 12:31:44.652401 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.652345 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grk4w\" (UniqueName: \"kubernetes.io/projected/3da83d31-bbe3-4848-bbf4-a71740b91448-kube-api-access-grk4w\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:44.653119 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.653078 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwhpp\" (UniqueName: \"kubernetes.io/projected/686ef415-ee65-4648-8eff-2443ddb85bf8-kube-api-access-hwhpp\") pod \"node-ca-tgr7c\" (UID: \"686ef415-ee65-4648-8eff-2443ddb85bf8\") " pod="openshift-image-registry/node-ca-tgr7c" Jun 09 12:31:44.653845 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.653816 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7znhp\" (UniqueName: \"kubernetes.io/projected/1ac32929-68a9-4a14-b995-75d2be312610-kube-api-access-7znhp\") pod \"tuned-thjnp\" (UID: \"1ac32929-68a9-4a14-b995-75d2be312610\") " pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.653944 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.653927 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtrxh\" (UniqueName: \"kubernetes.io/projected/72ffa2a6-d1fd-4b61-95a1-ac861711944e-kube-api-access-gtrxh\") pod \"iptables-alerter-zl9h9\" (UID: \"72ffa2a6-d1fd-4b61-95a1-ac861711944e\") " pod="openshift-network-operator/iptables-alerter-zl9h9" Jun 09 12:31:44.742599 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-var-lib-cni-multus\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.742774 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-var-lib-cni-bin\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.742774 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-run-multus-certs\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.742774 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-var-lib-cni-bin\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.742774 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-multus-conf-dir\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.742774 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742714 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-var-lib-cni-multus\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.742774 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:44.742774 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742751 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-multus-conf-dir\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.742774 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwm5t\" (UniqueName: \"kubernetes.io/projected/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-kube-api-access-dwm5t\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742787 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-multus-cni-dir\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-run-multus-certs\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:44.742841 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-multus-cni-dir\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:44.742894 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret podName:ae3ae62f-afb3-4025-ab11-5a27262a37b9 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:45.242874882 +0000 UTC m=+3.084905928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret") pod "global-pull-secret-syncer-l4lmg" (UID: "ae3ae62f-afb3-4025-ab11-5a27262a37b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-multus-daemon-config\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae3ae62f-afb3-4025-ab11-5a27262a37b9-kubelet-config\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-system-cni-dir\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.742989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-var-lib-kubelet\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743002 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae3ae62f-afb3-4025-ab11-5a27262a37b9-kubelet-config\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-etc-kubernetes\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-os-release\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-multus-socket-dir-parent\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743090 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-var-lib-kubelet\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-hostroot\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743056 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-system-cni-dir\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743147 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-os-release\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743092 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-etc-kubernetes\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743158 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-multus-socket-dir-parent\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-cni-binary-copy\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-run-k8s-cni-cncf-io\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743208 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-hostroot\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae3ae62f-afb3-4025-ab11-5a27262a37b9-dbus\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-cnibin\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-run-netns\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743348 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-run-netns\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743380 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae3ae62f-afb3-4025-ab11-5a27262a37b9-dbus\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-host-run-k8s-cni-cncf-io\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743419 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-cnibin\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743438 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-multus-daemon-config\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.743886 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.743597 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-cni-binary-copy\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.754119 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.754065 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwm5t\" (UniqueName: \"kubernetes.io/projected/e0c68667-6cac-4af3-8ac1-6b9871c2a94f-kube-api-access-dwm5t\") pod \"multus-jrzmz\" (UID: \"e0c68667-6cac-4af3-8ac1-6b9871c2a94f\") " pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.828041 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.828002 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-thjnp" Jun 09 12:31:44.836949 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.836925 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zl9h9" Jun 09 12:31:44.846152 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.846126 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:31:44.852047 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.851950 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6c496" Jun 09 12:31:44.860651 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.860635 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" Jun 09 12:31:44.868371 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.868340 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tgr7c" Jun 09 12:31:44.876897 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.876872 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cjwvz" Jun 09 12:31:44.884683 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.884666 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7hnl" Jun 09 12:31:44.889744 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:44.889726 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jrzmz" Jun 09 12:31:44.972334 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:44.972310 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c68667_6cac_4af3_8ac1_6b9871c2a94f.slice/crio-6639d6b02a200403bc0d21f1174fe8e140054ff17592fd1b1511b36739feab94 WatchSource:0}: Error finding container 6639d6b02a200403bc0d21f1174fe8e140054ff17592fd1b1511b36739feab94: Status 404 returned error can't find the container with id 6639d6b02a200403bc0d21f1174fe8e140054ff17592fd1b1511b36739feab94 Jun 09 12:31:44.973587 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:44.973563 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30992a6_11c1_4c39_9b53_a19bfb455c12.slice/crio-9f2050630dfb4aa622ef34c39744eedbff40d1ca1e9227813ff19de43ec52dd8 WatchSource:0}: Error finding container 9f2050630dfb4aa622ef34c39744eedbff40d1ca1e9227813ff19de43ec52dd8: Status 404 returned error can't find the container with id 9f2050630dfb4aa622ef34c39744eedbff40d1ca1e9227813ff19de43ec52dd8 Jun 09 12:31:44.974137 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:44.974114 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1ecc72_45f1_4e73_944f_91aab54f0209.slice/crio-7bba7c342f2bff79df5f0c6b7995d9fc6cc4fd021780739de185e2532cdbcf12 WatchSource:0}: Error finding container 7bba7c342f2bff79df5f0c6b7995d9fc6cc4fd021780739de185e2532cdbcf12: Status 404 returned error can't find the container with id 7bba7c342f2bff79df5f0c6b7995d9fc6cc4fd021780739de185e2532cdbcf12 Jun 09 12:31:44.974997 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:44.974959 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac32929_68a9_4a14_b995_75d2be312610.slice/crio-927d01589b7161f38dd162ac9fd909c9a9ceb46ce67b292609e3b7a446269129 WatchSource:0}: Error finding container 927d01589b7161f38dd162ac9fd909c9a9ceb46ce67b292609e3b7a446269129: Status 404 returned error can't find the container with id 927d01589b7161f38dd162ac9fd909c9a9ceb46ce67b292609e3b7a446269129 Jun 09 12:31:44.976766 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:44.976734 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8114e26e_e0ed_4d9f_b952_91d24ef77fe6.slice/crio-a23cea55fe7c14d18754266909dd64810ffc05a991c85fa3c76389f8fc7205e9 WatchSource:0}: Error finding container a23cea55fe7c14d18754266909dd64810ffc05a991c85fa3c76389f8fc7205e9: Status 404 returned error can't find the container with id a23cea55fe7c14d18754266909dd64810ffc05a991c85fa3c76389f8fc7205e9 Jun 09 12:31:44.979602 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:44.979378 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb52492_ccd4_4eae_b38a_cc4a6df5c20c.slice/crio-563ba819e1a263fbd8a53d21b61a3c775abe48bcc84ae02623dba3c165e0c843 WatchSource:0}: Error finding container 563ba819e1a263fbd8a53d21b61a3c775abe48bcc84ae02623dba3c165e0c843: Status 404 returned error can't find the container with id 563ba819e1a263fbd8a53d21b61a3c775abe48bcc84ae02623dba3c165e0c843 Jun 09 12:31:44.985795 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:31:44.985057 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686ef415_ee65_4648_8eff_2443ddb85bf8.slice/crio-5df8134508cd584ce7120d3855d909b4668d8817a502d3bb82ce10c5520b0f35 WatchSource:0}: Error finding container 5df8134508cd584ce7120d3855d909b4668d8817a502d3bb82ce10c5520b0f35: Status 404 returned error can't find the container with id 5df8134508cd584ce7120d3855d909b4668d8817a502d3bb82ce10c5520b0f35 Jun 09 12:31:45.146667 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.146557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:45.146804 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:45.146746 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:45.146864 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:45.146805 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs podName:3da83d31-bbe3-4848-bbf4-a71740b91448 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:46.146785301 +0000 UTC m=+3.988816357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs") pod "network-metrics-daemon-79pkx" (UID: "3da83d31-bbe3-4848-bbf4-a71740b91448") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:45.247547 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.247514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvkbr\" (UniqueName: \"kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr\") pod \"network-check-target-m59fd\" (UID: \"73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e\") " pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:45.247703 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.247567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:45.247703 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:45.247680 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:45.247808 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:45.247726 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret podName:ae3ae62f-afb3-4025-ab11-5a27262a37b9 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:46.247713902 +0000 UTC m=+4.089744944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret") pod "global-pull-secret-syncer-l4lmg" (UID: "ae3ae62f-afb3-4025-ab11-5a27262a37b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:45.247808 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:45.247682 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:45.247808 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:45.247777 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:45.247808 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:45.247790 2577 projected.go:196] Error preparing data for projected volume kube-api-access-tvkbr for pod openshift-network-diagnostics/network-check-target-m59fd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:45.247975 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:45.247833 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr podName:73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e nodeName:}" failed. No retries permitted until 2026-06-09 12:31:46.247820898 +0000 UTC m=+4.089851956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvkbr" (UniqueName: "kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr") pod "network-check-target-m59fd" (UID: "73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:45.570226 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.570197 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 12:26:44 +0000 UTC" deadline="2028-03-20 03:18:27.791306072 +0000 UTC" Jun 09 12:31:45.570226 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.570224 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15590h46m42.221084763s" Jun 09 12:31:45.604901 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.604881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:45.605026 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:45.605008 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:31:45.616620 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.616383 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6c496" event={"ID":"915be28b-282f-430a-9b47-404fee0638e0","Type":"ContainerStarted","Data":"d67923b2caa62bbfb2bcc474f8ad4194f196bdeb27d35d7ee370fa9c0189882a"} Jun 09 12:31:45.619764 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.619721 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tgr7c" event={"ID":"686ef415-ee65-4648-8eff-2443ddb85bf8","Type":"ContainerStarted","Data":"5df8134508cd584ce7120d3855d909b4668d8817a502d3bb82ce10c5520b0f35"} Jun 09 12:31:45.621572 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.621511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zl9h9" event={"ID":"72ffa2a6-d1fd-4b61-95a1-ac861711944e","Type":"ContainerStarted","Data":"fd616758aae0186e96f88695001a59c9a8df2ba1bdf248bef4224c2a4a344871"} Jun 09 12:31:45.624186 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.624160 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cjwvz" event={"ID":"7bb52492-ccd4-4eae-b38a-cc4a6df5c20c","Type":"ContainerStarted","Data":"563ba819e1a263fbd8a53d21b61a3c775abe48bcc84ae02623dba3c165e0c843"} Jun 09 12:31:45.626649 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.626603 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7hnl" event={"ID":"3a1ecc72-45f1-4e73-944f-91aab54f0209","Type":"ContainerStarted","Data":"7bba7c342f2bff79df5f0c6b7995d9fc6cc4fd021780739de185e2532cdbcf12"} Jun 09 12:31:45.629307 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.629285 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" event={"ID":"b30992a6-11c1-4c39-9b53-a19bfb455c12","Type":"ContainerStarted","Data":"9f2050630dfb4aa622ef34c39744eedbff40d1ca1e9227813ff19de43ec52dd8"} Jun 09 12:31:45.632121 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.632092 2577 generic.go:356] "Generic (PLEG): container finished" podID="d27643021eafcb61b865d9df84505f61" containerID="f8f794f55444f7b53d2aa6f83895411171ac971ff9ff4dbc58ffefdc265d41c5" exitCode=0 Jun 09 12:31:45.632219 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.632122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" event={"ID":"d27643021eafcb61b865d9df84505f61","Type":"ContainerDied","Data":"f8f794f55444f7b53d2aa6f83895411171ac971ff9ff4dbc58ffefdc265d41c5"} Jun 09 12:31:45.635012 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.634986 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" event={"ID":"8114e26e-e0ed-4d9f-b952-91d24ef77fe6","Type":"ContainerStarted","Data":"a23cea55fe7c14d18754266909dd64810ffc05a991c85fa3c76389f8fc7205e9"} Jun 09 12:31:45.636804 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.636777 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-thjnp" event={"ID":"1ac32929-68a9-4a14-b995-75d2be312610","Type":"ContainerStarted","Data":"927d01589b7161f38dd162ac9fd909c9a9ceb46ce67b292609e3b7a446269129"} Jun 09 12:31:45.638776 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.638752 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jrzmz" event={"ID":"e0c68667-6cac-4af3-8ac1-6b9871c2a94f","Type":"ContainerStarted","Data":"6639d6b02a200403bc0d21f1174fe8e140054ff17592fd1b1511b36739feab94"} Jun 09 12:31:45.641616 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:45.641185 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal" event={"ID":"890bf00dd14a920e517744df78149aac","Type":"ContainerStarted","Data":"814bf1b8209fb949ee7a070be214264883c8251c1020610151ab6c432d4a9786"} Jun 09 12:31:46.154949 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:46.154830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:46.155153 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:46.154997 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:46.155153 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:46.155069 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs podName:3da83d31-bbe3-4848-bbf4-a71740b91448 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:48.155049817 +0000 UTC m=+5.997080859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs") pod "network-metrics-daemon-79pkx" (UID: "3da83d31-bbe3-4848-bbf4-a71740b91448") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:46.255425 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:46.255374 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvkbr\" (UniqueName: \"kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr\") pod \"network-check-target-m59fd\" (UID: \"73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e\") " pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:46.255606 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:46.255442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:46.255606 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:46.255592 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:46.255723 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:46.255662 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret podName:ae3ae62f-afb3-4025-ab11-5a27262a37b9 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:48.255639056 +0000 UTC m=+6.097670099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret") pod "global-pull-secret-syncer-l4lmg" (UID: "ae3ae62f-afb3-4025-ab11-5a27262a37b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:46.255789 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:46.255754 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:46.255789 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:46.255772 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:46.255789 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:46.255785 2577 projected.go:196] Error preparing data for projected volume kube-api-access-tvkbr for pod openshift-network-diagnostics/network-check-target-m59fd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:46.255925 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:46.255819 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr podName:73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e nodeName:}" failed. No retries permitted until 2026-06-09 12:31:48.255808115 +0000 UTC m=+6.097839160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvkbr" (UniqueName: "kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr") pod "network-check-target-m59fd" (UID: "73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:46.571402 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:46.571282 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 12:26:44 +0000 UTC" deadline="2028-02-25 20:44:26.218096126 +0000 UTC" Jun 09 12:31:46.571402 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:46.571337 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15032h12m39.646762343s" Jun 09 12:31:46.608204 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:46.607546 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:46.608204 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:46.607666 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:31:46.608204 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:46.608058 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:46.608204 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:46.608149 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:31:46.661674 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:46.661637 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" event={"ID":"d27643021eafcb61b865d9df84505f61","Type":"ContainerStarted","Data":"48d234f5ed0f8e39e5b07894319ab50d129d14340504699fa755024bd7e34719"} Jun 09 12:31:46.676749 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:46.676695 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-52.ec2.internal" podStartSLOduration=2.676673227 podStartE2EDuration="2.676673227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:45.663669586 +0000 UTC m=+3.505700654" watchObservedRunningTime="2026-06-09 12:31:46.676673227 +0000 UTC m=+4.518704284" Jun 09 12:31:46.677113 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:46.677084 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-52.ec2.internal" podStartSLOduration=2.677074629 podStartE2EDuration="2.677074629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:46.676570916 +0000 UTC m=+4.518601982" watchObservedRunningTime="2026-06-09 12:31:46.677074629 +0000 UTC m=+4.519105694" Jun 09 12:31:47.605612 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:47.604401 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:47.605612 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:47.604541 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:31:48.170823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:48.170203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:48.170823 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:48.170377 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:48.170823 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:48.170449 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs podName:3da83d31-bbe3-4848-bbf4-a71740b91448 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:52.170429501 +0000 UTC m=+10.012460568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs") pod "network-metrics-daemon-79pkx" (UID: "3da83d31-bbe3-4848-bbf4-a71740b91448") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:48.271241 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:48.271204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:48.271449 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:48.271299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvkbr\" (UniqueName: \"kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr\") pod \"network-check-target-m59fd\" (UID: \"73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e\") " pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:48.271519 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:48.271483 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:48.271572 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:48.271552 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret podName:ae3ae62f-afb3-4025-ab11-5a27262a37b9 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:52.271530667 +0000 UTC m=+10.113561712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret") pod "global-pull-secret-syncer-l4lmg" (UID: "ae3ae62f-afb3-4025-ab11-5a27262a37b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:48.271738 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:48.271700 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:48.271738 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:48.271721 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:48.271738 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:48.271733 2577 projected.go:196] Error preparing data for projected volume kube-api-access-tvkbr for pod openshift-network-diagnostics/network-check-target-m59fd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:48.271917 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:48.271779 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr podName:73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e nodeName:}" failed. No retries permitted until 2026-06-09 12:31:52.271763714 +0000 UTC m=+10.113794784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvkbr" (UniqueName: "kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr") pod "network-check-target-m59fd" (UID: "73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:48.606050 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:48.605343 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:48.606050 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:48.605513 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:31:48.606050 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:48.605892 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:48.606050 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:48.606012 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:31:49.605329 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:49.605286 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:49.605527 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:49.605466 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:31:50.605873 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:50.605271 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:50.605873 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:50.605311 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:50.605873 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:50.605425 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:31:50.605873 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:50.605640 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:31:51.604968 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:51.604934 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:51.605148 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:51.605097 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:31:52.204958 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:52.204917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:52.205478 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:52.205095 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:52.205478 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:52.205179 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs podName:3da83d31-bbe3-4848-bbf4-a71740b91448 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:00.205158122 +0000 UTC m=+18.047189185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs") pod "network-metrics-daemon-79pkx" (UID: "3da83d31-bbe3-4848-bbf4-a71740b91448") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:52.305911 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:52.305874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvkbr\" (UniqueName: \"kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr\") pod \"network-check-target-m59fd\" (UID: \"73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e\") " pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:52.306090 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:52.305943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:52.306090 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:52.306021 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:52.306090 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:52.306048 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:52.306090 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:52.306049 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:52.306090 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:52.306061 2577 projected.go:196] Error preparing data for projected volume kube-api-access-tvkbr for pod openshift-network-diagnostics/network-check-target-m59fd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:52.306390 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:52.306114 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret podName:ae3ae62f-afb3-4025-ab11-5a27262a37b9 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:00.306095659 +0000 UTC m=+18.148126706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret") pod "global-pull-secret-syncer-l4lmg" (UID: "ae3ae62f-afb3-4025-ab11-5a27262a37b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:52.306390 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:52.306142 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr podName:73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e nodeName:}" failed. No retries permitted until 2026-06-09 12:32:00.306124309 +0000 UTC m=+18.148155358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvkbr" (UniqueName: "kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr") pod "network-check-target-m59fd" (UID: "73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:52.606215 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:52.605726 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:52.606215 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:52.605834 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:31:52.606215 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:52.605882 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:52.606215 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:52.605993 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:31:53.605433 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:53.605324 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:53.605869 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:53.605494 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:31:54.604972 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:54.604936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:54.605163 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:54.605071 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:31:54.605163 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:54.605129 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:54.605266 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:54.605238 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:31:55.604785 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:55.604738 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:55.605186 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:55.604880 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:31:56.604986 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:56.604948 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:56.605444 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:56.605079 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:31:56.605444 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:56.605143 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:56.605444 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:56.605264 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:31:57.604313 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:57.604278 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:57.604480 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:57.604428 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:31:58.604723 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:58.604685 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:31:58.605190 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:58.604686 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:31:58.605190 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:58.604795 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:31:58.605190 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:58.605147 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:31:59.604476 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:31:59.604416 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:31:59.604701 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:31:59.604563 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:32:00.260067 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:00.259986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:00.260504 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:00.260136 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:32:00.260504 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:00.260208 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs podName:3da83d31-bbe3-4848-bbf4-a71740b91448 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:16.260189429 +0000 UTC m=+34.102220489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs") pod "network-metrics-daemon-79pkx" (UID: "3da83d31-bbe3-4848-bbf4-a71740b91448") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:32:00.361002 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:00.360967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvkbr\" (UniqueName: \"kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr\") pod \"network-check-target-m59fd\" (UID: \"73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e\") " pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:00.361197 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:00.361019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:00.361197 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:00.361125 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:32:00.361197 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:00.361148 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:32:00.361197 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:00.361150 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:32:00.361197 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:00.361158 2577 projected.go:196] Error preparing data for projected volume kube-api-access-tvkbr for pod openshift-network-diagnostics/network-check-target-m59fd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:32:00.361487 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:00.361214 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret podName:ae3ae62f-afb3-4025-ab11-5a27262a37b9 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:16.361196025 +0000 UTC m=+34.203227075 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret") pod "global-pull-secret-syncer-l4lmg" (UID: "ae3ae62f-afb3-4025-ab11-5a27262a37b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:32:00.361487 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:00.361232 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr podName:73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e nodeName:}" failed. No retries permitted until 2026-06-09 12:32:16.361223193 +0000 UTC m=+34.203254236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvkbr" (UniqueName: "kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr") pod "network-check-target-m59fd" (UID: "73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:32:00.605385 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:00.605287 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:00.605385 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:00.605287 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:00.605594 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:00.605442 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:32:00.605594 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:00.605506 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:32:01.604456 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:01.604419 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:01.604873 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:01.604550 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:32:02.605905 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:02.605875 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:02.606380 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:02.605979 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:32:02.606380 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:02.606046 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:02.606380 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:02.606155 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:32:03.604628 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:03.604586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:03.604899 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:03.604733 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:32:04.608063 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.607896 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:04.608656 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.607952 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:04.608656 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:04.608146 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:32:04.608656 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:04.608223 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:32:04.702439 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.702410 2577 generic.go:356] "Generic (PLEG): container finished" podID="915be28b-282f-430a-9b47-404fee0638e0" containerID="f5518835f70f728399c22744253898b4f3e677efebbee0bd5701369ea378abab" exitCode=0 Jun 09 12:32:04.702580 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.702497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6c496" event={"ID":"915be28b-282f-430a-9b47-404fee0638e0","Type":"ContainerDied","Data":"f5518835f70f728399c22744253898b4f3e677efebbee0bd5701369ea378abab"} Jun 09 12:32:04.705086 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.705056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tgr7c" event={"ID":"686ef415-ee65-4648-8eff-2443ddb85bf8","Type":"ContainerStarted","Data":"b408c43a35196ad7ef253a126b1a83ff89ac5fe98a73ed568c28b33f7c95d7a7"} Jun 09 12:32:04.706999 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.706961 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cjwvz" event={"ID":"7bb52492-ccd4-4eae-b38a-cc4a6df5c20c","Type":"ContainerStarted","Data":"c0cd19cb858707c78f545f0e554a8f732cf8f78a84b1f0a5d71a1ffd8f293697"} Jun 09 12:32:04.708713 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.708692 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7hnl" event={"ID":"3a1ecc72-45f1-4e73-944f-91aab54f0209","Type":"ContainerStarted","Data":"4174db243dc4708e1c5f23d7a5258fa8609930747fbd83a0a19fec65f7b2f397"} Jun 09 12:32:04.710600 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.710572 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" event={"ID":"b30992a6-11c1-4c39-9b53-a19bfb455c12","Type":"ContainerStarted","Data":"17463ea9041582e13861d13ea0b0fab8795f05c28f563a5ec6767541f5571768"} Jun 09 12:32:04.712072 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.712045 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-thjnp" event={"ID":"1ac32929-68a9-4a14-b995-75d2be312610","Type":"ContainerStarted","Data":"563eaf3940fd6111e3836f090725cae83d5e32ebd68c4ec4e0f1446b956a7a88"} Jun 09 12:32:04.715454 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.715430 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jrzmz" event={"ID":"e0c68667-6cac-4af3-8ac1-6b9871c2a94f","Type":"ContainerStarted","Data":"d48985a7f0576060597b53d0ecc2a336310fdc36ac0cc1f6b9f103f1aef33162"} Jun 09 12:32:04.740384 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.740317 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tgr7c" podStartSLOduration=3.57877072 podStartE2EDuration="22.740299575s" totalImagesPullingTime="19.161528855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:04.73979333 +0000 UTC m=+22.581824396" watchObservedRunningTime="2026-06-09 12:32:04.740299575 +0000 UTC m=+22.582330642" Jun 09 12:32:04.754672 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.754570 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cjwvz" podStartSLOduration=7.813576959 podStartE2EDuration="22.7545507s" totalImagesPullingTime="14.940973741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:04.753688608 +0000 UTC m=+22.595719666" watchObservedRunningTime="2026-06-09 12:32:04.7545507 +0000 UTC m=+22.596581770" Jun 09 12:32:04.768014 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.767976 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j7hnl" podStartSLOduration=3.598885026 podStartE2EDuration="22.767962784s" totalImagesPullingTime="19.169077758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:04.767531966 +0000 UTC m=+22.609563055" watchObservedRunningTime="2026-06-09 12:32:04.767962784 +0000 UTC m=+22.609993848" Jun 09 12:32:04.786489 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.786437 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jrzmz" podStartSLOduration=3.578548213 podStartE2EDuration="22.786419648s" totalImagesPullingTime="19.207871435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:04.785522602 +0000 UTC m=+22.627553666" watchObservedRunningTime="2026-06-09 12:32:04.786419648 +0000 UTC m=+22.628450713" Jun 09 12:32:04.801209 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:04.801168 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-thjnp" podStartSLOduration=3.629570577 podStartE2EDuration="22.80115565s" totalImagesPullingTime="19.171585073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:04.801122742 +0000 UTC m=+22.643153807" watchObservedRunningTime="2026-06-09 12:32:04.80115565 +0000 UTC m=+22.643186715" Jun 09 12:32:05.388012 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.387977 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 12:32:05.603172 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.603076 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T12:32:05.387992545Z","UUID":"9b2df908-a1bf-497c-a0a8-ba324f9f2021","Handler":null,"Name":"","Endpoint":""} Jun 09 12:32:05.604344 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.604322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:05.604550 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:05.604528 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:32:05.604648 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.604633 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 12:32:05.604693 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.604666 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 12:32:05.721270 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.721185 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zl9h9" event={"ID":"72ffa2a6-d1fd-4b61-95a1-ac861711944e","Type":"ContainerStarted","Data":"7acff7455a9e49fe472acc539397bcb7fa2ca4c34d6a1e5f09608642cf2dd5f5"} Jun 09 12:32:05.723351 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.723323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" event={"ID":"b30992a6-11c1-4c39-9b53-a19bfb455c12","Type":"ContainerStarted","Data":"fb5aba0916fde773b788f13a99329f348e504c9a841d15d09f7357229fb7e27c"} Jun 09 12:32:05.726571 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.726554 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbzkh_8114e26e-e0ed-4d9f-b952-91d24ef77fe6/ovn-acl-logging/0.log" Jun 09 12:32:05.726934 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.726916 2577 generic.go:356] "Generic (PLEG): container finished" podID="8114e26e-e0ed-4d9f-b952-91d24ef77fe6" containerID="997f635546a6dce62276583583457378397b260aaafe92886f97a0b70134109c" exitCode=1 Jun 09 12:32:05.727084 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.727050 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" event={"ID":"8114e26e-e0ed-4d9f-b952-91d24ef77fe6","Type":"ContainerStarted","Data":"b19f3c3690dd51d00bafc132bd811c2d9a6f50b7982fa70b5cb63c43d42b00b9"} Jun 09 12:32:05.727245 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.727131 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" event={"ID":"8114e26e-e0ed-4d9f-b952-91d24ef77fe6","Type":"ContainerStarted","Data":"bbd129e391b91ac7fa8dbc619ce5e66b2a8202985b208c499026521f5bf3f2c8"} Jun 09 12:32:05.727245 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.727180 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" event={"ID":"8114e26e-e0ed-4d9f-b952-91d24ef77fe6","Type":"ContainerStarted","Data":"9972805249f81b2d8068780858d00fcd139c86d6a6e7d9af5451909fa0dfbbb2"} Jun 09 12:32:05.727245 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.727230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" event={"ID":"8114e26e-e0ed-4d9f-b952-91d24ef77fe6","Type":"ContainerStarted","Data":"0894e49cefc7d799caeb41c83f6b9a4f116c6a533ec2cb65ae330c56af922005"} Jun 09 12:32:05.727439 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.727278 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" event={"ID":"8114e26e-e0ed-4d9f-b952-91d24ef77fe6","Type":"ContainerDied","Data":"997f635546a6dce62276583583457378397b260aaafe92886f97a0b70134109c"} Jun 09 12:32:05.727439 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.727326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" event={"ID":"8114e26e-e0ed-4d9f-b952-91d24ef77fe6","Type":"ContainerStarted","Data":"5776d3e6cd0094ad11ac68a05e9a52a050ef0a4e11fae390781532eceb92c6a0"} Jun 09 12:32:05.736406 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:05.736344 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zl9h9" podStartSLOduration=4.571252616 podStartE2EDuration="23.736329458s" totalImagesPullingTime="19.165076842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:05.735776863 +0000 UTC m=+23.577807931" watchObservedRunningTime="2026-06-09 12:32:05.736329458 +0000 UTC m=+23.578360522" Jun 09 12:32:06.605297 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:06.605113 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:06.605521 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:06.605192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:06.605521 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:06.605429 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:32:06.605637 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:06.605527 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:32:06.731735 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:06.731699 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" event={"ID":"b30992a6-11c1-4c39-9b53-a19bfb455c12","Type":"ContainerStarted","Data":"c9b7ffc9c9c5f2141f1362ac4621e93ac2585b194714d0173ed16308be2dcdd5"} Jun 09 12:32:06.751504 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:06.751452 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmv8g" podStartSLOduration=11.956972985 podStartE2EDuration="24.751436616s" totalImagesPullingTime="12.794463631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:06.750989545 +0000 UTC m=+24.593020609" watchObservedRunningTime="2026-06-09 12:32:06.751436616 +0000 UTC m=+24.593467681" Jun 09 12:32:07.604584 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:07.604547 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:07.604832 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:07.604692 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:32:08.081499 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:08.081425 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cjwvz" Jun 09 12:32:08.082172 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:08.082153 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cjwvz" Jun 09 12:32:08.604907 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:08.604873 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:08.605088 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:08.604871 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:08.605088 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:08.605014 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:32:08.605088 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:08.605080 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:32:08.735967 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:08.735874 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cjwvz" Jun 09 12:32:08.736446 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:08.736427 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cjwvz" Jun 09 12:32:09.604824 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:09.604745 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:09.605335 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:09.604852 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:32:09.740503 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:09.740476 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbzkh_8114e26e-e0ed-4d9f-b952-91d24ef77fe6/ovn-acl-logging/0.log" Jun 09 12:32:09.740852 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:09.740829 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" event={"ID":"8114e26e-e0ed-4d9f-b952-91d24ef77fe6","Type":"ContainerStarted","Data":"8719921bab512a7abd693413ae999647a634b9c0f26f214ace72d49503b6333e"} Jun 09 12:32:09.742415 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:09.742394 2577 generic.go:356] "Generic (PLEG): container finished" podID="915be28b-282f-430a-9b47-404fee0638e0" containerID="34e8ce986f9744e4874cd4bbd899f8f05eeef4246058198ace3b1bc0a4b07604" exitCode=0 Jun 09 12:32:09.742516 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:09.742452 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6c496" event={"ID":"915be28b-282f-430a-9b47-404fee0638e0","Type":"ContainerDied","Data":"34e8ce986f9744e4874cd4bbd899f8f05eeef4246058198ace3b1bc0a4b07604"} Jun 09 12:32:10.607881 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:10.607856 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:10.608330 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:10.607973 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:32:10.608330 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:10.608018 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:10.608330 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:10.608105 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:32:11.604535 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:11.604462 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:11.604680 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:11.604556 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:32:11.748980 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:11.748939 2577 generic.go:356] "Generic (PLEG): container finished" podID="915be28b-282f-430a-9b47-404fee0638e0" containerID="29b886dd3eeef67e78fea0d0902d6882d26fe7b62dc1b1267dd9e2db1639d48f" exitCode=0 Jun 09 12:32:11.749497 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:11.749018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6c496" event={"ID":"915be28b-282f-430a-9b47-404fee0638e0","Type":"ContainerDied","Data":"29b886dd3eeef67e78fea0d0902d6882d26fe7b62dc1b1267dd9e2db1639d48f"} Jun 09 12:32:11.752454 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:11.752432 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbzkh_8114e26e-e0ed-4d9f-b952-91d24ef77fe6/ovn-acl-logging/0.log" Jun 09 12:32:11.752779 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:11.752758 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" event={"ID":"8114e26e-e0ed-4d9f-b952-91d24ef77fe6","Type":"ContainerStarted","Data":"1421e95295c7628013e38379c3c404f5bf2fbbcd75699f625510c41871b09f58"} Jun 09 12:32:11.753031 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:11.753013 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:32:11.753113 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:11.753087 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:32:11.753227 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:11.753136 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:32:11.753227 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:11.753188 2577 scope.go:117] "RemoveContainer" containerID="997f635546a6dce62276583583457378397b260aaafe92886f97a0b70134109c" Jun 09 12:32:11.771402 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:11.771380 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:32:11.771676 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:11.771659 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:32:12.607607 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:12.607583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:12.607752 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:12.607583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:12.607752 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:12.607675 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:32:12.607752 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:12.607735 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:32:12.758716 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:12.758698 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbzkh_8114e26e-e0ed-4d9f-b952-91d24ef77fe6/ovn-acl-logging/0.log" Jun 09 12:32:12.759110 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:12.759086 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" event={"ID":"8114e26e-e0ed-4d9f-b952-91d24ef77fe6","Type":"ContainerStarted","Data":"db75174779e877a1a3d6693c0a83771b0cf865e134f88b9184d99d83b94c18da"} Jun 09 12:32:12.788571 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:12.788505 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" podStartSLOduration=11.138169388 podStartE2EDuration="30.788482967s" totalImagesPullingTime="19.650313579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:12.787185621 +0000 UTC m=+30.629216685" watchObservedRunningTime="2026-06-09 12:32:12.788482967 +0000 UTC m=+30.630514034" Jun 09 12:32:12.965419 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:12.965390 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l4lmg"] Jun 09 12:32:12.965572 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:12.965547 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:12.965679 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:12.965658 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:32:12.968372 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:12.968328 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m59fd"] Jun 09 12:32:12.968472 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:12.968458 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:12.968565 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:12.968543 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:32:12.969238 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:12.969213 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-79pkx"] Jun 09 12:32:12.969338 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:12.969325 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:12.969472 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:12.969451 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:32:13.763669 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:13.763641 2577 generic.go:356] "Generic (PLEG): container finished" podID="915be28b-282f-430a-9b47-404fee0638e0" containerID="a5e03f2590a332aa262b30802648704b9fb14e0dc5e6d6ad532d3bbbb0e418c0" exitCode=0 Jun 09 12:32:13.764352 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:13.763726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6c496" event={"ID":"915be28b-282f-430a-9b47-404fee0638e0","Type":"ContainerDied","Data":"a5e03f2590a332aa262b30802648704b9fb14e0dc5e6d6ad532d3bbbb0e418c0"} Jun 09 12:32:14.604863 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:14.604827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:14.605054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:14.604872 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:14.605054 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:14.604967 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:32:14.605161 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:14.605041 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:32:14.605161 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:14.605062 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:14.605161 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:14.605148 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:32:16.279225 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:16.279146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:16.279707 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:16.279265 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:32:16.279707 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:16.279326 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs podName:3da83d31-bbe3-4848-bbf4-a71740b91448 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:48.279308427 +0000 UTC m=+66.121339474 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs") pod "network-metrics-daemon-79pkx" (UID: "3da83d31-bbe3-4848-bbf4-a71740b91448") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:32:16.379838 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:16.379796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvkbr\" (UniqueName: \"kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr\") pod \"network-check-target-m59fd\" (UID: \"73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e\") " pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:16.380023 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:16.379852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:16.380023 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:16.379968 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:32:16.380023 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:16.379990 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:32:16.380023 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:16.380015 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:32:16.380230 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:16.380028 2577 projected.go:196] Error preparing data for projected volume kube-api-access-tvkbr for pod openshift-network-diagnostics/network-check-target-m59fd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:32:16.380230 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:16.380032 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret podName:ae3ae62f-afb3-4025-ab11-5a27262a37b9 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:48.380014539 +0000 UTC m=+66.222045583 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret") pod "global-pull-secret-syncer-l4lmg" (UID: "ae3ae62f-afb3-4025-ab11-5a27262a37b9") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:32:16.380230 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:16.380085 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr podName:73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e nodeName:}" failed. No retries permitted until 2026-06-09 12:32:48.380068904 +0000 UTC m=+66.222099946 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvkbr" (UniqueName: "kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr") pod "network-check-target-m59fd" (UID: "73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:32:16.604981 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:16.604897 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:16.604981 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:16.604945 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:16.605199 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:16.604897 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:16.605199 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:16.605043 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:32:16.605199 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:16.605132 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m59fd" podUID="73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e" Jun 09 12:32:16.605313 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:16.605230 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4lmg" podUID="ae3ae62f-afb3-4025-ab11-5a27262a37b9" Jun 09 12:32:17.776636 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:17.776599 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6c496" event={"ID":"915be28b-282f-430a-9b47-404fee0638e0","Type":"ContainerStarted","Data":"20fe0458f71a398ae3c84861aebc73013cd32e08f26fe20485f0dc46e4a2a68d"} Jun 09 12:32:17.971269 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:17.971199 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-52.ec2.internal" event="NodeReady" Jun 09 12:32:17.971445 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:17.971344 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 12:32:18.016932 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.016897 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pl5db"] Jun 09 12:32:18.018768 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.018751 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-shdsj"] Jun 09 12:32:18.018877 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.018862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.023098 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.020586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-shdsj" Jun 09 12:32:18.025440 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.025420 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b8l29\"" Jun 09 12:32:18.025988 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.025975 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 12:32:18.027680 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.027519 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ksb5z\"" Jun 09 12:32:18.029929 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.029909 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 12:32:18.030504 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.030490 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 12:32:18.030600 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.030524 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 12:32:18.030883 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.030869 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 12:32:18.049065 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.049047 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pl5db"] Jun 09 12:32:18.056452 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.056425 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-shdsj"] Jun 09 12:32:18.091956 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.091907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/787ebe7b-fb40-4d91-9945-4c922c2ad486-config-volume\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.091956 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.091936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/787ebe7b-fb40-4d91-9945-4c922c2ad486-tmp-dir\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.092104 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.091972 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s74gr\" (UniqueName: \"kubernetes.io/projected/f2aab8e0-280c-4fac-b243-1b63e88d0b67-kube-api-access-s74gr\") pod \"ingress-canary-shdsj\" (UID: \"f2aab8e0-280c-4fac-b243-1b63e88d0b67\") " pod="openshift-ingress-canary/ingress-canary-shdsj" Jun 09 12:32:18.092104 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.092056 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2aab8e0-280c-4fac-b243-1b63e88d0b67-cert\") pod \"ingress-canary-shdsj\" (UID: \"f2aab8e0-280c-4fac-b243-1b63e88d0b67\") " pod="openshift-ingress-canary/ingress-canary-shdsj" Jun 09 12:32:18.092167 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.092102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.092167 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.092138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn7sc\" (UniqueName: \"kubernetes.io/projected/787ebe7b-fb40-4d91-9945-4c922c2ad486-kube-api-access-nn7sc\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.193268 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.193096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn7sc\" (UniqueName: \"kubernetes.io/projected/787ebe7b-fb40-4d91-9945-4c922c2ad486-kube-api-access-nn7sc\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.193268 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.193278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/787ebe7b-fb40-4d91-9945-4c922c2ad486-config-volume\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.193534 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.193295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/787ebe7b-fb40-4d91-9945-4c922c2ad486-tmp-dir\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.193534 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.193332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s74gr\" (UniqueName: \"kubernetes.io/projected/f2aab8e0-280c-4fac-b243-1b63e88d0b67-kube-api-access-s74gr\") pod \"ingress-canary-shdsj\" (UID: \"f2aab8e0-280c-4fac-b243-1b63e88d0b67\") " pod="openshift-ingress-canary/ingress-canary-shdsj" Jun 09 12:32:18.193534 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.193356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2aab8e0-280c-4fac-b243-1b63e88d0b67-cert\") pod \"ingress-canary-shdsj\" (UID: \"f2aab8e0-280c-4fac-b243-1b63e88d0b67\") " pod="openshift-ingress-canary/ingress-canary-shdsj" Jun 09 12:32:18.193534 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.193439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.193728 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:18.193538 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:18.193728 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:18.193603 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls podName:787ebe7b-fb40-4d91-9945-4c922c2ad486 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:18.693583876 +0000 UTC m=+36.535614933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls") pod "dns-default-pl5db" (UID: "787ebe7b-fb40-4d91-9945-4c922c2ad486") : secret "dns-default-metrics-tls" not found Jun 09 12:32:18.193728 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.193681 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/787ebe7b-fb40-4d91-9945-4c922c2ad486-tmp-dir\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.194002 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.193981 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/787ebe7b-fb40-4d91-9945-4c922c2ad486-config-volume\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.197294 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.197277 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2aab8e0-280c-4fac-b243-1b63e88d0b67-cert\") pod \"ingress-canary-shdsj\" (UID: \"f2aab8e0-280c-4fac-b243-1b63e88d0b67\") " pod="openshift-ingress-canary/ingress-canary-shdsj" Jun 09 12:32:18.202400 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.202377 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s74gr\" (UniqueName: \"kubernetes.io/projected/f2aab8e0-280c-4fac-b243-1b63e88d0b67-kube-api-access-s74gr\") pod \"ingress-canary-shdsj\" (UID: \"f2aab8e0-280c-4fac-b243-1b63e88d0b67\") " pod="openshift-ingress-canary/ingress-canary-shdsj" Jun 09 12:32:18.202836 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.202816 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn7sc\" (UniqueName: \"kubernetes.io/projected/787ebe7b-fb40-4d91-9945-4c922c2ad486-kube-api-access-nn7sc\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.336016 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.335905 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-shdsj" Jun 09 12:32:18.460810 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.460782 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-shdsj"] Jun 09 12:32:18.464667 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:32:18.464645 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2aab8e0_280c_4fac_b243_1b63e88d0b67.slice/crio-9e252a9112049673d109d3d37148f42a8ae5ee887f73b6e2864618759973b6a6 WatchSource:0}: Error finding container 9e252a9112049673d109d3d37148f42a8ae5ee887f73b6e2864618759973b6a6: Status 404 returned error can't find the container with id 9e252a9112049673d109d3d37148f42a8ae5ee887f73b6e2864618759973b6a6 Jun 09 12:32:18.604683 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.604605 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:18.604683 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.604622 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:18.604905 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.604608 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:18.607749 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.607560 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 12:32:18.607749 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.607618 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 12:32:18.607749 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.607640 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4k8hn\"" Jun 09 12:32:18.607749 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.607711 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 12:32:18.608028 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.607852 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 12:32:18.608257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.608240 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4297v\"" Jun 09 12:32:18.698430 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.698398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:18.698597 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:18.698554 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:18.698658 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:18.698605 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls podName:787ebe7b-fb40-4d91-9945-4c922c2ad486 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:19.698590983 +0000 UTC m=+37.540622025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls") pod "dns-default-pl5db" (UID: "787ebe7b-fb40-4d91-9945-4c922c2ad486") : secret "dns-default-metrics-tls" not found Jun 09 12:32:18.779636 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.779600 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-shdsj" event={"ID":"f2aab8e0-280c-4fac-b243-1b63e88d0b67","Type":"ContainerStarted","Data":"9e252a9112049673d109d3d37148f42a8ae5ee887f73b6e2864618759973b6a6"} Jun 09 12:32:18.782388 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.782342 2577 generic.go:356] "Generic (PLEG): container finished" podID="915be28b-282f-430a-9b47-404fee0638e0" containerID="20fe0458f71a398ae3c84861aebc73013cd32e08f26fe20485f0dc46e4a2a68d" exitCode=0 Jun 09 12:32:18.782511 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:18.782389 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6c496" event={"ID":"915be28b-282f-430a-9b47-404fee0638e0","Type":"ContainerDied","Data":"20fe0458f71a398ae3c84861aebc73013cd32e08f26fe20485f0dc46e4a2a68d"} Jun 09 12:32:19.707114 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:19.707078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:19.707294 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:19.707237 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:19.707355 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:19.707304 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls podName:787ebe7b-fb40-4d91-9945-4c922c2ad486 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:21.707284769 +0000 UTC m=+39.549315814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls") pod "dns-default-pl5db" (UID: "787ebe7b-fb40-4d91-9945-4c922c2ad486") : secret "dns-default-metrics-tls" not found Jun 09 12:32:19.789037 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:19.789002 2577 generic.go:356] "Generic (PLEG): container finished" podID="915be28b-282f-430a-9b47-404fee0638e0" containerID="ebdca12100d992f2cf3e39c4dd95a63e13c43847f22a10dd7167951f57cd2434" exitCode=0 Jun 09 12:32:19.789521 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:19.789084 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6c496" event={"ID":"915be28b-282f-430a-9b47-404fee0638e0","Type":"ContainerDied","Data":"ebdca12100d992f2cf3e39c4dd95a63e13c43847f22a10dd7167951f57cd2434"} Jun 09 12:32:20.793141 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:20.792893 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-shdsj" event={"ID":"f2aab8e0-280c-4fac-b243-1b63e88d0b67","Type":"ContainerStarted","Data":"a5e688e5fd2dc138c02d320525c7da2b37cfc1afd6f000c3b9b7e301cc7cecdb"} Jun 09 12:32:20.796087 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:20.796058 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6c496" event={"ID":"915be28b-282f-430a-9b47-404fee0638e0","Type":"ContainerStarted","Data":"a7ce4de199d11c7de10f2fe20b3b6a811837720352a55067eb29f32cd086ca6c"} Jun 09 12:32:20.809144 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:20.809105 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-shdsj" podStartSLOduration=0.95714002 podStartE2EDuration="2.809088311s" totalImagesPullingTime="1.851948291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:20.808862886 +0000 UTC m=+38.650893966" watchObservedRunningTime="2026-06-09 12:32:20.809088311 +0000 UTC m=+38.651119376" Jun 09 12:32:20.829661 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:20.829584 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6c496" podStartSLOduration=9.164177895 podStartE2EDuration="38.829569457s" totalImagesPullingTime="29.665391562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:20.828510807 +0000 UTC m=+38.670541868" watchObservedRunningTime="2026-06-09 12:32:20.829569457 +0000 UTC m=+38.671600521" Jun 09 12:32:21.722142 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:21.722105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:21.722317 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:21.722227 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:21.722317 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:21.722279 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls podName:787ebe7b-fb40-4d91-9945-4c922c2ad486 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:25.722264533 +0000 UTC m=+43.564295575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls") pod "dns-default-pl5db" (UID: "787ebe7b-fb40-4d91-9945-4c922c2ad486") : secret "dns-default-metrics-tls" not found Jun 09 12:32:25.748602 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:25.748558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:25.749036 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:25.748704 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:25.749036 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:25.748765 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls podName:787ebe7b-fb40-4d91-9945-4c922c2ad486 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:33.74875141 +0000 UTC m=+51.590782452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls") pod "dns-default-pl5db" (UID: "787ebe7b-fb40-4d91-9945-4c922c2ad486") : secret "dns-default-metrics-tls" not found Jun 09 12:32:31.899486 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.899452 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq"] Jun 09 12:32:31.913132 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.913099 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5"] Jun 09 12:32:31.913302 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.913226 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:31.916137 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.916104 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 12:32:31.917423 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.917079 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 12:32:31.917809 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.917787 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 12:32:31.918008 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.917787 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 12:32:31.927130 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.927110 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq"] Jun 09 12:32:31.927212 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.927143 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5"] Jun 09 12:32:31.927250 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.927219 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:31.929841 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.929819 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 12:32:31.929948 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.929901 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 12:32:31.930041 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.930024 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 12:32:31.930155 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.930086 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 12:32:31.989597 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.989567 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fd85c49-eef4-43e3-9416-79352feb1943-tmp\") pod \"klusterlet-addon-workmgr-6b4774cf68-czzmq\" (UID: \"8fd85c49-eef4-43e3-9416-79352feb1943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:31.989597 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.989602 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8fd85c49-eef4-43e3-9416-79352feb1943-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b4774cf68-czzmq\" (UID: \"8fd85c49-eef4-43e3-9416-79352feb1943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:31.989803 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:31.989635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrfgf\" (UniqueName: \"kubernetes.io/projected/8fd85c49-eef4-43e3-9416-79352feb1943-kube-api-access-lrfgf\") pod \"klusterlet-addon-workmgr-6b4774cf68-czzmq\" (UID: \"8fd85c49-eef4-43e3-9416-79352feb1943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:32.090961 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.090925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fd85c49-eef4-43e3-9416-79352feb1943-tmp\") pod \"klusterlet-addon-workmgr-6b4774cf68-czzmq\" (UID: \"8fd85c49-eef4-43e3-9416-79352feb1943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:32.090961 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.090961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8fd85c49-eef4-43e3-9416-79352feb1943-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b4774cf68-czzmq\" (UID: \"8fd85c49-eef4-43e3-9416-79352feb1943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:32.091202 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.090997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrfgf\" (UniqueName: \"kubernetes.io/projected/8fd85c49-eef4-43e3-9416-79352feb1943-kube-api-access-lrfgf\") pod \"klusterlet-addon-workmgr-6b4774cf68-czzmq\" (UID: \"8fd85c49-eef4-43e3-9416-79352feb1943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:32.091202 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.091027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prc5b\" (UniqueName: \"kubernetes.io/projected/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-kube-api-access-prc5b\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.091202 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.091064 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-hub\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.091202 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.091170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-ca\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.091202 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.091189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.091457 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.091222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.091457 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.091242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.091457 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.091316 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fd85c49-eef4-43e3-9416-79352feb1943-tmp\") pod \"klusterlet-addon-workmgr-6b4774cf68-czzmq\" (UID: \"8fd85c49-eef4-43e3-9416-79352feb1943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:32.094824 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.094802 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8fd85c49-eef4-43e3-9416-79352feb1943-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b4774cf68-czzmq\" (UID: \"8fd85c49-eef4-43e3-9416-79352feb1943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:32.098917 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.098894 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrfgf\" (UniqueName: \"kubernetes.io/projected/8fd85c49-eef4-43e3-9416-79352feb1943-kube-api-access-lrfgf\") pod \"klusterlet-addon-workmgr-6b4774cf68-czzmq\" (UID: \"8fd85c49-eef4-43e3-9416-79352feb1943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:32.192344 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.192317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prc5b\" (UniqueName: \"kubernetes.io/projected/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-kube-api-access-prc5b\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.192531 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.192373 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-hub\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.192531 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.192401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-ca\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.192531 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.192416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.192531 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.192440 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.192531 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.192461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.193461 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.193434 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.194917 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.194888 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-ca\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.195032 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.194963 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-hub\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.195032 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.194989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.195182 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.195167 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.199994 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.199968 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prc5b\" (UniqueName: \"kubernetes.io/projected/0a65d759-5041-4c0c-b1fc-1b8a3e0553bd-kube-api-access-prc5b\") pod \"cluster-proxy-proxy-agent-856999f7c4-rrpk5\" (UID: \"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.224288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.224266 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:32.246238 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.246199 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:32:32.371249 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.371219 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq"] Jun 09 12:32:32.374249 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:32:32.374222 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd85c49_eef4_43e3_9416_79352feb1943.slice/crio-1a8544095c009cd335b5e05479d8cb97dd47552f46f4a529d2e18a3588d03c9b WatchSource:0}: Error finding container 1a8544095c009cd335b5e05479d8cb97dd47552f46f4a529d2e18a3588d03c9b: Status 404 returned error can't find the container with id 1a8544095c009cd335b5e05479d8cb97dd47552f46f4a529d2e18a3588d03c9b Jun 09 12:32:32.389883 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.389170 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5"] Jun 09 12:32:32.391230 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:32:32.391211 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a65d759_5041_4c0c_b1fc_1b8a3e0553bd.slice/crio-7256afab8760fc6b4c00666b02c836d9ad613391da007f85adceb097478acf5a WatchSource:0}: Error finding container 7256afab8760fc6b4c00666b02c836d9ad613391da007f85adceb097478acf5a: Status 404 returned error can't find the container with id 7256afab8760fc6b4c00666b02c836d9ad613391da007f85adceb097478acf5a Jun 09 12:32:32.828271 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.828235 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" event={"ID":"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd","Type":"ContainerStarted","Data":"7256afab8760fc6b4c00666b02c836d9ad613391da007f85adceb097478acf5a"} Jun 09 12:32:32.829242 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:32.829217 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" event={"ID":"8fd85c49-eef4-43e3-9416-79352feb1943","Type":"ContainerStarted","Data":"1a8544095c009cd335b5e05479d8cb97dd47552f46f4a529d2e18a3588d03c9b"} Jun 09 12:32:33.806425 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:33.806318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:33.806981 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:33.806476 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:33.806981 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:33.806544 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls podName:787ebe7b-fb40-4d91-9945-4c922c2ad486 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:49.806526458 +0000 UTC m=+67.648557504 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls") pod "dns-default-pl5db" (UID: "787ebe7b-fb40-4d91-9945-4c922c2ad486") : secret "dns-default-metrics-tls" not found Jun 09 12:32:38.851245 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:38.851204 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" event={"ID":"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd","Type":"ContainerStarted","Data":"2c81debdb124fe195d6f53337c34d1fd551688382625a90351d9a38904c98837"} Jun 09 12:32:38.851245 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:38.851247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" event={"ID":"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd","Type":"ContainerStarted","Data":"97d61d01972aa1b3cf905a882ddfeb7a5da1f8a4deac285b954ca711424aa936"} Jun 09 12:32:38.851789 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:38.851263 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" event={"ID":"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd","Type":"ContainerStarted","Data":"a6ff5a714cad5ad304fcd33d80d150d983d94dd34ac677cb948b5544638352bc"} Jun 09 12:32:38.852540 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:38.852510 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" event={"ID":"8fd85c49-eef4-43e3-9416-79352feb1943","Type":"ContainerStarted","Data":"e8116dc30546215b3ffec2f961b68d8946430f27bec93cdbb5a09fce3e89a590"} Jun 09 12:32:38.852735 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:38.852717 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:38.854342 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:38.854324 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:32:38.873471 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:38.873428 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" podStartSLOduration=2.049416756 podStartE2EDuration="7.873414216s" totalImagesPullingTime="5.82399746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:38.871727154 +0000 UTC m=+56.713758219" watchObservedRunningTime="2026-06-09 12:32:38.873414216 +0000 UTC m=+56.715445279" Jun 09 12:32:38.887467 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:38.887422 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" podStartSLOduration=2.0446733 podStartE2EDuration="7.887408047s" totalImagesPullingTime="5.842734747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:38.887349224 +0000 UTC m=+56.729380309" watchObservedRunningTime="2026-06-09 12:32:38.887408047 +0000 UTC m=+56.729439111" Jun 09 12:32:43.784756 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:43.784732 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbzkh" Jun 09 12:32:48.314209 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.314174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:32:48.317578 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.317547 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 12:32:48.324944 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:48.324919 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 12:32:48.325054 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:48.325002 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs podName:3da83d31-bbe3-4848-bbf4-a71740b91448 nodeName:}" failed. No retries permitted until 2026-06-09 12:33:52.32498319 +0000 UTC m=+130.167014237 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs") pod "network-metrics-daemon-79pkx" (UID: "3da83d31-bbe3-4848-bbf4-a71740b91448") : secret "metrics-daemon-secret" not found Jun 09 12:32:48.414879 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.414827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvkbr\" (UniqueName: \"kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr\") pod \"network-check-target-m59fd\" (UID: \"73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e\") " pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:48.414879 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.414890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:48.417824 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.417804 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 12:32:48.417878 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.417803 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 12:32:48.427271 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.427222 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae3ae62f-afb3-4025-ab11-5a27262a37b9-original-pull-secret\") pod \"global-pull-secret-syncer-l4lmg\" (UID: \"ae3ae62f-afb3-4025-ab11-5a27262a37b9\") " pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:48.427543 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.427527 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 12:32:48.437752 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.437732 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvkbr\" (UniqueName: \"kubernetes.io/projected/73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e-kube-api-access-tvkbr\") pod \"network-check-target-m59fd\" (UID: \"73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e\") " pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:48.618463 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.618386 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4297v\"" Jun 09 12:32:48.626522 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.626502 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:48.626522 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.626514 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4lmg" Jun 09 12:32:48.752752 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.752724 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m59fd"] Jun 09 12:32:48.756136 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:32:48.756107 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73aaa7b6_6b2a_4808_b155_b2f5aeb6ca9e.slice/crio-64acab160eec03634289d32672ec9a646c07862aab5a9a35bef93b31f12d1e1e WatchSource:0}: Error finding container 64acab160eec03634289d32672ec9a646c07862aab5a9a35bef93b31f12d1e1e: Status 404 returned error can't find the container with id 64acab160eec03634289d32672ec9a646c07862aab5a9a35bef93b31f12d1e1e Jun 09 12:32:48.766433 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.766413 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l4lmg"] Jun 09 12:32:48.769521 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:32:48.769501 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3ae62f_afb3_4025_ab11_5a27262a37b9.slice/crio-2046116e92dd8c6d322dbcd0fa66cea4af90c293c3f2efa5289a5a2eaec4bb70 WatchSource:0}: Error finding container 2046116e92dd8c6d322dbcd0fa66cea4af90c293c3f2efa5289a5a2eaec4bb70: Status 404 returned error can't find the container with id 2046116e92dd8c6d322dbcd0fa66cea4af90c293c3f2efa5289a5a2eaec4bb70 Jun 09 12:32:48.878663 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.878558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m59fd" event={"ID":"73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e","Type":"ContainerStarted","Data":"64acab160eec03634289d32672ec9a646c07862aab5a9a35bef93b31f12d1e1e"} Jun 09 12:32:48.879677 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:48.879640 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l4lmg" event={"ID":"ae3ae62f-afb3-4025-ab11-5a27262a37b9","Type":"ContainerStarted","Data":"2046116e92dd8c6d322dbcd0fa66cea4af90c293c3f2efa5289a5a2eaec4bb70"} Jun 09 12:32:49.824765 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:49.824718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:32:49.825196 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:49.824874 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:49.825196 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:32:49.824957 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls podName:787ebe7b-fb40-4d91-9945-4c922c2ad486 nodeName:}" failed. No retries permitted until 2026-06-09 12:33:21.824932667 +0000 UTC m=+99.666963710 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls") pod "dns-default-pl5db" (UID: "787ebe7b-fb40-4d91-9945-4c922c2ad486") : secret "dns-default-metrics-tls" not found Jun 09 12:32:53.896568 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:53.896526 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m59fd" event={"ID":"73aaa7b6-6b2a-4808-b155-b2f5aeb6ca9e","Type":"ContainerStarted","Data":"007ad00c537da0136d4c04033452f72f3eb45256f6efa24cdc1a26483af3cba2"} Jun 09 12:32:53.897021 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:53.896647 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:32:53.897946 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:53.897924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l4lmg" event={"ID":"ae3ae62f-afb3-4025-ab11-5a27262a37b9","Type":"ContainerStarted","Data":"0b2884600854fd322f7643109a84638f718e2d96719d889b9c4ea9da8bb4a04c"} Jun 09 12:32:53.912342 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:53.912298 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m59fd" podStartSLOduration=67.430721504 podStartE2EDuration="1m11.91228637s" totalImagesPullingTime="4.481564866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:53.911337767 +0000 UTC m=+71.753368842" watchObservedRunningTime="2026-06-09 12:32:53.91228637 +0000 UTC m=+71.754317467" Jun 09 12:32:53.926557 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:32:53.926515 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l4lmg" podStartSLOduration=67.454846529 podStartE2EDuration="1m11.926501012s" totalImagesPullingTime="4.471654483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:53.925820955 +0000 UTC m=+71.767852030" watchObservedRunningTime="2026-06-09 12:32:53.926501012 +0000 UTC m=+71.768532076" Jun 09 12:33:21.842552 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:33:21.842419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:33:21.843048 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:33:21.842562 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:33:21.843048 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:33:21.842641 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls podName:787ebe7b-fb40-4d91-9945-4c922c2ad486 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:25.842623478 +0000 UTC m=+163.684654521 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls") pod "dns-default-pl5db" (UID: "787ebe7b-fb40-4d91-9945-4c922c2ad486") : secret "dns-default-metrics-tls" not found Jun 09 12:33:24.903085 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:33:24.903058 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m59fd" Jun 09 12:33:52.348309 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:33:52.348275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:33:52.348771 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:33:52.348407 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 12:33:52.348771 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:33:52.348469 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs podName:3da83d31-bbe3-4848-bbf4-a71740b91448 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:54.348454595 +0000 UTC m=+252.190485638 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs") pod "network-metrics-daemon-79pkx" (UID: "3da83d31-bbe3-4848-bbf4-a71740b91448") : secret "metrics-daemon-secret" not found Jun 09 12:34:21.030664 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:34:21.030615 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pl5db" podUID="787ebe7b-fb40-4d91-9945-4c922c2ad486" Jun 09 12:34:21.146073 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:34:21.146041 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pl5db" Jun 09 12:34:21.622250 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:34:21.622212 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-79pkx" podUID="3da83d31-bbe3-4848-bbf4-a71740b91448" Jun 09 12:34:25.880068 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:34:25.880024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:34:25.880487 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:34:25.880178 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:34:25.880487 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:34:25.880255 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls podName:787ebe7b-fb40-4d91-9945-4c922c2ad486 nodeName:}" failed. No retries permitted until 2026-06-09 12:36:27.880236028 +0000 UTC m=+285.722267071 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls") pod "dns-default-pl5db" (UID: "787ebe7b-fb40-4d91-9945-4c922c2ad486") : secret "dns-default-metrics-tls" not found Jun 09 12:34:34.605293 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:34:34.605195 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:34:38.853996 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:34:38.853941 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" podUID="8fd85c49-eef4-43e3-9416-79352feb1943" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jun 09 12:34:39.197473 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:34:39.197441 2577 generic.go:356] "Generic (PLEG): container finished" podID="8fd85c49-eef4-43e3-9416-79352feb1943" containerID="e8116dc30546215b3ffec2f961b68d8946430f27bec93cdbb5a09fce3e89a590" exitCode=1 Jun 09 12:34:39.197658 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:34:39.197510 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" event={"ID":"8fd85c49-eef4-43e3-9416-79352feb1943","Type":"ContainerDied","Data":"e8116dc30546215b3ffec2f961b68d8946430f27bec93cdbb5a09fce3e89a590"} Jun 09 12:34:39.197869 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:34:39.197852 2577 scope.go:117] "RemoveContainer" containerID="e8116dc30546215b3ffec2f961b68d8946430f27bec93cdbb5a09fce3e89a590" Jun 09 12:34:40.202095 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:34:40.202060 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" event={"ID":"8fd85c49-eef4-43e3-9416-79352feb1943","Type":"ContainerStarted","Data":"eb587edbedd1ba222bbb0309d332d4ed2d45c0bd697ae294f78fa3a3f46ac47b"} Jun 09 12:34:40.202590 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:34:40.202325 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:34:40.202945 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:34:40.202927 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:35:04.208048 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:04.208022 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7hnl_3a1ecc72-45f1-4e73-944f-91aab54f0209/dns-node-resolver/0.log" Jun 09 12:35:05.411519 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:05.411489 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tgr7c_686ef415-ee65-4648-8eff-2443ddb85bf8/node-ca/0.log" Jun 09 12:35:06.214243 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:06.214194 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-shdsj_f2aab8e0-280c-4fac-b243-1b63e88d0b67/serve-healthcheck-canary/0.log" Jun 09 12:35:28.812956 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.812925 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6kczz"] Jun 09 12:35:28.816007 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.815992 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:28.819452 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.819428 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 12:35:28.820636 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.820614 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2pflr\"" Jun 09 12:35:28.820636 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.820627 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 12:35:28.820807 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.820647 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 12:35:28.820885 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.820865 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 12:35:28.835262 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.835238 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6kczz"] Jun 09 12:35:28.923776 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.923745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-crio-socket\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:28.923915 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.923796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:28.923915 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.923820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:28.923915 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.923841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bswsh\" (UniqueName: \"kubernetes.io/projected/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-kube-api-access-bswsh\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:28.924026 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:28.923921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-data-volume\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:29.024403 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.024345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-data-volume\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:29.024559 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.024418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-crio-socket\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:29.024559 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.024466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:29.024559 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.024481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-crio-socket\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:29.024559 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.024502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:29.024559 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.024525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bswsh\" (UniqueName: \"kubernetes.io/projected/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-kube-api-access-bswsh\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:29.024806 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.024787 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-data-volume\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:29.025098 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.025083 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:29.026803 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.026788 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:29.050956 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.050930 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bswsh\" (UniqueName: \"kubernetes.io/projected/122ca31d-a569-42c4-bb20-f3cbc6a0eedc-kube-api-access-bswsh\") pod \"insights-runtime-extractor-6kczz\" (UID: \"122ca31d-a569-42c4-bb20-f3cbc6a0eedc\") " pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:29.125122 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.125055 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6kczz" Jun 09 12:35:29.290987 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.290939 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6kczz"] Jun 09 12:35:29.295964 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:35:29.295933 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122ca31d_a569_42c4_bb20_f3cbc6a0eedc.slice/crio-b8c1a69596f821726cabcc78e6c2ae441f19f8316ab6a53b067a918133b90250 WatchSource:0}: Error finding container b8c1a69596f821726cabcc78e6c2ae441f19f8316ab6a53b067a918133b90250: Status 404 returned error can't find the container with id b8c1a69596f821726cabcc78e6c2ae441f19f8316ab6a53b067a918133b90250 Jun 09 12:35:29.339150 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:29.339124 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6kczz" event={"ID":"122ca31d-a569-42c4-bb20-f3cbc6a0eedc","Type":"ContainerStarted","Data":"b8c1a69596f821726cabcc78e6c2ae441f19f8316ab6a53b067a918133b90250"} Jun 09 12:35:30.343180 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:30.343096 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6kczz" event={"ID":"122ca31d-a569-42c4-bb20-f3cbc6a0eedc","Type":"ContainerStarted","Data":"ef9acd5daa2c323f3d24a39898fbce4c2a915fed7689f5f167e9dae4b7fc401c"} Jun 09 12:35:30.343180 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:30.343178 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6kczz" event={"ID":"122ca31d-a569-42c4-bb20-f3cbc6a0eedc","Type":"ContainerStarted","Data":"1dba80c74d50626d6bb1e84a9af8daaddddce436b14173fb1f4ab94a15949db4"} Jun 09 12:35:32.351660 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:32.351624 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6kczz" event={"ID":"122ca31d-a569-42c4-bb20-f3cbc6a0eedc","Type":"ContainerStarted","Data":"8675014bc25acb920cd9a57a7579a272ca2a3a89a727ec4f4b57d5ba51e4fe30"} Jun 09 12:35:32.378876 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:32.378827 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6kczz" podStartSLOduration=1.901479835 podStartE2EDuration="4.378812023s" totalImagesPullingTime="2.477332188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:35:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:32.378315602 +0000 UTC m=+230.220346665" watchObservedRunningTime="2026-06-09 12:35:32.378812023 +0000 UTC m=+230.220843087" Jun 09 12:35:41.483910 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.483877 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6nhwt"] Jun 09 12:35:41.487080 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.487061 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.490468 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.490448 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 12:35:41.490581 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.490502 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 12:35:41.491393 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.491374 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 12:35:41.491462 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.491418 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 12:35:41.491527 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.491476 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 12:35:41.491586 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.491544 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 12:35:41.491681 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.491667 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f9plm\"" Jun 09 12:35:41.540524 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.540497 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s"] Jun 09 12:35:41.543562 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.543548 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.547432 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.547406 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pfhl8\"" Jun 09 12:35:41.547582 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.547565 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 12:35:41.548028 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.548013 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 12:35:41.570545 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.570515 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s"] Jun 09 12:35:41.620162 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.620126 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-wtmp\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.620309 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.620176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.620309 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.620226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe0b0928-9723-4f89-9aff-815cbb18fe23-metrics-client-ca\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.620309 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.620288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-textfile\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.620492 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.620315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-accelerators-collector-config\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.620492 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.620331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-tls\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.620492 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.620349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe0b0928-9723-4f89-9aff-815cbb18fe23-sys\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.620492 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.620392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe0b0928-9723-4f89-9aff-815cbb18fe23-root\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.620492 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.620443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tkqw\" (UniqueName: \"kubernetes.io/projected/fe0b0928-9723-4f89-9aff-815cbb18fe23-kube-api-access-9tkqw\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721266 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721266 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe0b0928-9723-4f89-9aff-815cbb18fe23-metrics-client-ca\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721501 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721306 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-textfile\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721501 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e96915-99b5-4deb-bd7d-2b180025348c-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wg65s\" (UID: \"c7e96915-99b5-4deb-bd7d-2b180025348c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.721501 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-accelerators-collector-config\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721501 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-tls\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721701 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe0b0928-9723-4f89-9aff-815cbb18fe23-sys\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721701 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-textfile\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721701 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721642 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7e96915-99b5-4deb-bd7d-2b180025348c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wg65s\" (UID: \"c7e96915-99b5-4deb-bd7d-2b180025348c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.721701 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721679 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe0b0928-9723-4f89-9aff-815cbb18fe23-root\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721701 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721693 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe0b0928-9723-4f89-9aff-815cbb18fe23-sys\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721944 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tkqw\" (UniqueName: \"kubernetes.io/projected/fe0b0928-9723-4f89-9aff-815cbb18fe23-kube-api-access-9tkqw\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721944 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721739 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe0b0928-9723-4f89-9aff-815cbb18fe23-root\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721944 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7e96915-99b5-4deb-bd7d-2b180025348c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wg65s\" (UID: \"c7e96915-99b5-4deb-bd7d-2b180025348c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.721944 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhb4z\" (UniqueName: \"kubernetes.io/projected/c7e96915-99b5-4deb-bd7d-2b180025348c-kube-api-access-xhb4z\") pod \"openshift-state-metrics-65f78d5c66-wg65s\" (UID: \"c7e96915-99b5-4deb-bd7d-2b180025348c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.721944 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-wtmp\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.721944 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721929 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-wtmp\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.722173 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.721981 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe0b0928-9723-4f89-9aff-815cbb18fe23-metrics-client-ca\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.722173 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.722007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-accelerators-collector-config\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.723597 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.723571 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.723755 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.723736 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe0b0928-9723-4f89-9aff-815cbb18fe23-node-exporter-tls\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.732074 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.732053 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tkqw\" (UniqueName: \"kubernetes.io/projected/fe0b0928-9723-4f89-9aff-815cbb18fe23-kube-api-access-9tkqw\") pod \"node-exporter-6nhwt\" (UID: \"fe0b0928-9723-4f89-9aff-815cbb18fe23\") " pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.796606 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.796537 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6nhwt" Jun 09 12:35:41.807134 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:35:41.807109 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0b0928_9723_4f89_9aff_815cbb18fe23.slice/crio-189f47bbf76a001b42a570bf224151005b73e6ec6fded27745c7b7c7c896d8d6 WatchSource:0}: Error finding container 189f47bbf76a001b42a570bf224151005b73e6ec6fded27745c7b7c7c896d8d6: Status 404 returned error can't find the container with id 189f47bbf76a001b42a570bf224151005b73e6ec6fded27745c7b7c7c896d8d6 Jun 09 12:35:41.822822 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.822800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e96915-99b5-4deb-bd7d-2b180025348c-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wg65s\" (UID: \"c7e96915-99b5-4deb-bd7d-2b180025348c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.822910 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.822841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7e96915-99b5-4deb-bd7d-2b180025348c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wg65s\" (UID: \"c7e96915-99b5-4deb-bd7d-2b180025348c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.822910 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.822875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7e96915-99b5-4deb-bd7d-2b180025348c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wg65s\" (UID: \"c7e96915-99b5-4deb-bd7d-2b180025348c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.822910 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.822903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhb4z\" (UniqueName: \"kubernetes.io/projected/c7e96915-99b5-4deb-bd7d-2b180025348c-kube-api-access-xhb4z\") pod \"openshift-state-metrics-65f78d5c66-wg65s\" (UID: \"c7e96915-99b5-4deb-bd7d-2b180025348c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.823485 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.823466 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e96915-99b5-4deb-bd7d-2b180025348c-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wg65s\" (UID: \"c7e96915-99b5-4deb-bd7d-2b180025348c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.825230 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.825206 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7e96915-99b5-4deb-bd7d-2b180025348c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wg65s\" (UID: \"c7e96915-99b5-4deb-bd7d-2b180025348c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.825329 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.825298 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7e96915-99b5-4deb-bd7d-2b180025348c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wg65s\" (UID: \"c7e96915-99b5-4deb-bd7d-2b180025348c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.832121 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.832103 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhb4z\" (UniqueName: \"kubernetes.io/projected/c7e96915-99b5-4deb-bd7d-2b180025348c-kube-api-access-xhb4z\") pod \"openshift-state-metrics-65f78d5c66-wg65s\" (UID: \"c7e96915-99b5-4deb-bd7d-2b180025348c\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.852352 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.852330 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" Jun 09 12:35:41.977315 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:41.977282 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s"] Jun 09 12:35:41.980021 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:35:41.979991 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e96915_99b5_4deb_bd7d_2b180025348c.slice/crio-708f605d11071c211f0264a7b13f3326303eee063422b31abe654bc24c9ecc81 WatchSource:0}: Error finding container 708f605d11071c211f0264a7b13f3326303eee063422b31abe654bc24c9ecc81: Status 404 returned error can't find the container with id 708f605d11071c211f0264a7b13f3326303eee063422b31abe654bc24c9ecc81 Jun 09 12:35:42.383870 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:42.383782 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" event={"ID":"c7e96915-99b5-4deb-bd7d-2b180025348c","Type":"ContainerStarted","Data":"17fd13db32e02a1073f7b22b209074c9b78584505a5fd00754fad05882eb8ca0"} Jun 09 12:35:42.383870 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:42.383869 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" event={"ID":"c7e96915-99b5-4deb-bd7d-2b180025348c","Type":"ContainerStarted","Data":"4bb5d6a46f88c391b36bcf4764243bc55cf0af5c2b9c75130642525596a4a9d9"} Jun 09 12:35:42.384084 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:42.383888 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" event={"ID":"c7e96915-99b5-4deb-bd7d-2b180025348c","Type":"ContainerStarted","Data":"708f605d11071c211f0264a7b13f3326303eee063422b31abe654bc24c9ecc81"} Jun 09 12:35:42.384894 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:42.384871 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6nhwt" event={"ID":"fe0b0928-9723-4f89-9aff-815cbb18fe23","Type":"ContainerStarted","Data":"189f47bbf76a001b42a570bf224151005b73e6ec6fded27745c7b7c7c896d8d6"} Jun 09 12:35:43.390230 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:43.390142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" event={"ID":"c7e96915-99b5-4deb-bd7d-2b180025348c","Type":"ContainerStarted","Data":"b202ce9e698d2b445061b0c17ac218bdedb13cf4b935567055921789baa92d83"} Jun 09 12:35:43.391770 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:43.391743 2577 generic.go:356] "Generic (PLEG): container finished" podID="fe0b0928-9723-4f89-9aff-815cbb18fe23" containerID="cd5221b1bdba25167db6e249b3746221e70ef8dc2bc0304cbf46f14c57f29f75" exitCode=0 Jun 09 12:35:43.391894 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:43.391780 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6nhwt" event={"ID":"fe0b0928-9723-4f89-9aff-815cbb18fe23","Type":"ContainerDied","Data":"cd5221b1bdba25167db6e249b3746221e70ef8dc2bc0304cbf46f14c57f29f75"} Jun 09 12:35:43.415134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:43.415087 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wg65s" podStartSLOduration=1.425376468 podStartE2EDuration="2.4150737s" totalImagesPullingTime="989.697232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:43.413794752 +0000 UTC m=+241.255825817" watchObservedRunningTime="2026-06-09 12:35:43.4150737 +0000 UTC m=+241.257104764" Jun 09 12:35:44.397272 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:44.397234 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6nhwt" event={"ID":"fe0b0928-9723-4f89-9aff-815cbb18fe23","Type":"ContainerStarted","Data":"49f2ed654d97926f4892b6f56f77cbb8f06c673216f51e6baf6dfaba60495fa4"} Jun 09 12:35:44.397734 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:44.397289 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6nhwt" event={"ID":"fe0b0928-9723-4f89-9aff-815cbb18fe23","Type":"ContainerStarted","Data":"7801d25aebe9b6be1255b12bce464d6a8916849a2fbc873e42d494a947779833"} Jun 09 12:35:45.961233 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:45.961162 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6nhwt" podStartSLOduration=3.621631174 podStartE2EDuration="4.96114046s" totalImagesPullingTime="1.273398444s" totalInitContainerRuntime="66.110842ms" isStatefulPod=true podCreationTimestamp="2026-06-09 12:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:44.422967438 +0000 UTC m=+242.264998502" watchObservedRunningTime="2026-06-09 12:35:45.96114046 +0000 UTC m=+243.803171508" Jun 09 12:35:45.962440 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:45.962413 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79557d5bb8-tj4sb"] Jun 09 12:35:45.965420 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:45.965402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:45.969355 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:45.969334 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qcqbn\"" Jun 09 12:35:45.969501 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:45.969380 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 12:35:45.969616 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:45.969378 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 12:35:45.969616 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:45.969379 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 12:35:45.969616 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:45.969391 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 12:35:45.969735 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:45.969402 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5vk1ejv7mt82t\"" Jun 09 12:35:45.978967 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:45.978944 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79557d5bb8-tj4sb"] Jun 09 12:35:46.153032 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.152994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7a1ef022-2398-40ce-86be-1bbb549f4d9f-secret-metrics-server-tls\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.153179 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.153056 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7a1ef022-2398-40ce-86be-1bbb549f4d9f-metrics-server-audit-profiles\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.153179 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.153086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79lz9\" (UniqueName: \"kubernetes.io/projected/7a1ef022-2398-40ce-86be-1bbb549f4d9f-kube-api-access-79lz9\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.153271 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.153193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7a1ef022-2398-40ce-86be-1bbb549f4d9f-secret-metrics-server-client-certs\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.153271 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.153230 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a1ef022-2398-40ce-86be-1bbb549f4d9f-client-ca-bundle\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.153271 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.153250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1ef022-2398-40ce-86be-1bbb549f4d9f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.153375 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.153295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7a1ef022-2398-40ce-86be-1bbb549f4d9f-audit-log\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.205538 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.205502 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-vppdw"] Jun 09 12:35:46.208334 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.208314 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" Jun 09 12:35:46.210780 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.210759 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 12:35:46.210885 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.210838 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fnzsm\"" Jun 09 12:35:46.217828 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.217806 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-vppdw"] Jun 09 12:35:46.254453 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.254430 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7a1ef022-2398-40ce-86be-1bbb549f4d9f-secret-metrics-server-tls\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.254549 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.254468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7a1ef022-2398-40ce-86be-1bbb549f4d9f-metrics-server-audit-profiles\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.254549 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.254492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79lz9\" (UniqueName: \"kubernetes.io/projected/7a1ef022-2398-40ce-86be-1bbb549f4d9f-kube-api-access-79lz9\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.254665 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.254546 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7a1ef022-2398-40ce-86be-1bbb549f4d9f-secret-metrics-server-client-certs\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.254665 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.254579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a1ef022-2398-40ce-86be-1bbb549f4d9f-client-ca-bundle\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.254665 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.254605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1ef022-2398-40ce-86be-1bbb549f4d9f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.254665 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.254642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7a1ef022-2398-40ce-86be-1bbb549f4d9f-audit-log\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.255034 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.254998 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7a1ef022-2398-40ce-86be-1bbb549f4d9f-audit-log\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.255338 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.255321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1ef022-2398-40ce-86be-1bbb549f4d9f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.255607 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.255584 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7a1ef022-2398-40ce-86be-1bbb549f4d9f-metrics-server-audit-profiles\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.257068 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.257040 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a1ef022-2398-40ce-86be-1bbb549f4d9f-client-ca-bundle\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.257142 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.257047 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7a1ef022-2398-40ce-86be-1bbb549f4d9f-secret-metrics-server-client-certs\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.257142 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.257073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7a1ef022-2398-40ce-86be-1bbb549f4d9f-secret-metrics-server-tls\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.262776 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.262758 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79lz9\" (UniqueName: \"kubernetes.io/projected/7a1ef022-2398-40ce-86be-1bbb549f4d9f-kube-api-access-79lz9\") pod \"metrics-server-79557d5bb8-tj4sb\" (UID: \"7a1ef022-2398-40ce-86be-1bbb549f4d9f\") " pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.274553 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.274535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:35:46.355908 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.355879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aa08a173-646f-4046-afbf-9f5db2d7dba1-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vppdw\" (UID: \"aa08a173-646f-4046-afbf-9f5db2d7dba1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" Jun 09 12:35:46.356050 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.355961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpc7l\" (UniqueName: \"kubernetes.io/projected/aa08a173-646f-4046-afbf-9f5db2d7dba1-kube-api-access-jpc7l\") pod \"monitoring-plugin-76b68cc874-vppdw\" (UID: \"aa08a173-646f-4046-afbf-9f5db2d7dba1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" Jun 09 12:35:46.409340 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.409238 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79557d5bb8-tj4sb"] Jun 09 12:35:46.411914 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:35:46.411887 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1ef022_2398_40ce_86be_1bbb549f4d9f.slice/crio-b941abd936a26220f1da9a562bbdb8b18cd3da13716b5093ecf6103f560917ed WatchSource:0}: Error finding container b941abd936a26220f1da9a562bbdb8b18cd3da13716b5093ecf6103f560917ed: Status 404 returned error can't find the container with id b941abd936a26220f1da9a562bbdb8b18cd3da13716b5093ecf6103f560917ed Jun 09 12:35:46.456380 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.456337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpc7l\" (UniqueName: \"kubernetes.io/projected/aa08a173-646f-4046-afbf-9f5db2d7dba1-kube-api-access-jpc7l\") pod \"monitoring-plugin-76b68cc874-vppdw\" (UID: \"aa08a173-646f-4046-afbf-9f5db2d7dba1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" Jun 09 12:35:46.456521 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.456415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aa08a173-646f-4046-afbf-9f5db2d7dba1-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vppdw\" (UID: \"aa08a173-646f-4046-afbf-9f5db2d7dba1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" Jun 09 12:35:46.456521 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:35:46.456509 2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 09 12:35:46.456637 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:35:46.456571 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa08a173-646f-4046-afbf-9f5db2d7dba1-monitoring-plugin-cert podName:aa08a173-646f-4046-afbf-9f5db2d7dba1 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:46.956552606 +0000 UTC m=+244.798583666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/aa08a173-646f-4046-afbf-9f5db2d7dba1-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-vppdw" (UID: "aa08a173-646f-4046-afbf-9f5db2d7dba1") : secret "monitoring-plugin-cert" not found Jun 09 12:35:46.467531 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.467475 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpc7l\" (UniqueName: \"kubernetes.io/projected/aa08a173-646f-4046-afbf-9f5db2d7dba1-kube-api-access-jpc7l\") pod \"monitoring-plugin-76b68cc874-vppdw\" (UID: \"aa08a173-646f-4046-afbf-9f5db2d7dba1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" Jun 09 12:35:46.961219 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.961159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aa08a173-646f-4046-afbf-9f5db2d7dba1-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vppdw\" (UID: \"aa08a173-646f-4046-afbf-9f5db2d7dba1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" Jun 09 12:35:46.964369 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:46.964339 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aa08a173-646f-4046-afbf-9f5db2d7dba1-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vppdw\" (UID: \"aa08a173-646f-4046-afbf-9f5db2d7dba1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" Jun 09 12:35:47.116733 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.116700 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" Jun 09 12:35:47.275445 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.275344 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-vppdw"] Jun 09 12:35:47.279659 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:35:47.279630 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa08a173_646f_4046_afbf_9f5db2d7dba1.slice/crio-ce98e9aa34a73a8276841d4ff5df8c7e9ab171f6feac573287a0451328ad5677 WatchSource:0}: Error finding container ce98e9aa34a73a8276841d4ff5df8c7e9ab171f6feac573287a0451328ad5677: Status 404 returned error can't find the container with id ce98e9aa34a73a8276841d4ff5df8c7e9ab171f6feac573287a0451328ad5677 Jun 09 12:35:47.408264 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.408233 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" event={"ID":"aa08a173-646f-4046-afbf-9f5db2d7dba1","Type":"ContainerStarted","Data":"ce98e9aa34a73a8276841d4ff5df8c7e9ab171f6feac573287a0451328ad5677"} Jun 09 12:35:47.409277 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.409252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" event={"ID":"7a1ef022-2398-40ce-86be-1bbb549f4d9f","Type":"ContainerStarted","Data":"b941abd936a26220f1da9a562bbdb8b18cd3da13716b5093ecf6103f560917ed"} Jun 09 12:35:47.848942 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.848918 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:35:47.852387 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.852369 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.857799 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.857782 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 12:35:47.859009 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.858990 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 12:35:47.863801 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.863781 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 12:35:47.863916 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.863850 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 12:35:47.864189 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.864167 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 12:35:47.864189 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.864185 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 12:35:47.864350 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.864221 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 12:35:47.864350 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.864327 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 12:35:47.864500 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.864485 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 12:35:47.864797 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.864781 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j5fnh\"" Jun 09 12:35:47.864864 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.864822 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 12:35:47.865228 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.865195 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 12:35:47.865305 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.865253 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 12:35:47.865623 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.865608 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fpvmfpkgjn2dt\"" Jun 09 12:35:47.868990 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.868961 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 12:35:47.869086 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.868978 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 12:35:47.888513 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.888491 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:35:47.968095 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968059 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968143 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968171 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-web-config\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968209 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2395601f-b926-4d8e-a699-4d059b19aef2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zxrn\" (UniqueName: \"kubernetes.io/projected/2395601f-b926-4d8e-a699-4d059b19aef2-kube-api-access-5zxrn\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968434 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968477 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2395601f-b926-4d8e-a699-4d059b19aef2-config-out\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.968539 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.969049 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.969049 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.969049 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968590 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:47.969049 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:47.968611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-config\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069020 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.068931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069020 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.068971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-web-config\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069020 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.068997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069308 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069308 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2395601f-b926-4d8e-a699-4d059b19aef2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069308 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069308 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069308 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxrn\" (UniqueName: \"kubernetes.io/projected/2395601f-b926-4d8e-a699-4d059b19aef2-kube-api-access-5zxrn\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069308 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069308 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069308 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069747 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2395601f-b926-4d8e-a699-4d059b19aef2-config-out\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069747 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069546 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069747 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069747 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069747 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069747 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-config\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.069747 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.070098 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.070098 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.069777 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.070870 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.070538 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.070870 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.070732 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.071768 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.071741 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.072195 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.072171 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.072404 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.072346 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.072587 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.072561 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.072693 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.072669 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.072967 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.072943 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.073033 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.072991 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.073919 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.073874 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2395601f-b926-4d8e-a699-4d059b19aef2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.074705 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.074684 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-web-config\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.075053 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.075026 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-config\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.075130 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.075112 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.075265 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.075237 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.075570 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.075551 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2395601f-b926-4d8e-a699-4d059b19aef2-config-out\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.075570 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.075561 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.076234 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.076209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.076504 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.076482 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.076796 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.076781 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.079158 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.079136 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zxrn\" (UniqueName: \"kubernetes.io/projected/2395601f-b926-4d8e-a699-4d059b19aef2-kube-api-access-5zxrn\") pod \"prometheus-k8s-0\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.161632 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.161600 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:35:48.334729 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.334640 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:35:48.340670 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:35:48.340643 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2395601f_b926_4d8e_a699_4d059b19aef2.slice/crio-80ebb8d3ec18c9551eb652525475755bd8c61a7292a77b9a24033ee72f83d302 WatchSource:0}: Error finding container 80ebb8d3ec18c9551eb652525475755bd8c61a7292a77b9a24033ee72f83d302: Status 404 returned error can't find the container with id 80ebb8d3ec18c9551eb652525475755bd8c61a7292a77b9a24033ee72f83d302 Jun 09 12:35:48.415291 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.415257 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerStarted","Data":"80ebb8d3ec18c9551eb652525475755bd8c61a7292a77b9a24033ee72f83d302"} Jun 09 12:35:48.416849 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:48.416822 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" event={"ID":"7a1ef022-2398-40ce-86be-1bbb549f4d9f","Type":"ContainerStarted","Data":"6784bd71858057ce1b01a0a66bf7b9a18a377896a32c300715c5c3d5cf4a9180"} Jun 09 12:35:49.422596 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:49.422556 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerStarted","Data":"de1d393370c1826a479e2b874f8dc1ed9b5f87d399f7c29d580f223662738317"} Jun 09 12:35:49.463683 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:49.463627 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" podStartSLOduration=3.077887326 podStartE2EDuration="4.463606032s" totalImagesPullingTime="1.385718706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:48.444607151 +0000 UTC m=+246.286638215" watchObservedRunningTime="2026-06-09 12:35:49.463606032 +0000 UTC m=+247.305637095" Jun 09 12:35:50.427382 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:50.427326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" event={"ID":"aa08a173-646f-4046-afbf-9f5db2d7dba1","Type":"ContainerStarted","Data":"69a67c32a5a68edd713ce8aa3391d01b1e4a211a43a49da8b3ed25d4df92b65c"} Jun 09 12:35:50.427818 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:50.427458 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" Jun 09 12:35:50.428913 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:50.428885 2577 generic.go:356] "Generic (PLEG): container finished" podID="2395601f-b926-4d8e-a699-4d059b19aef2" containerID="de1d393370c1826a479e2b874f8dc1ed9b5f87d399f7c29d580f223662738317" exitCode=0 Jun 09 12:35:50.429041 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:50.428952 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerDied","Data":"de1d393370c1826a479e2b874f8dc1ed9b5f87d399f7c29d580f223662738317"} Jun 09 12:35:50.432628 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:50.432608 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" Jun 09 12:35:50.445572 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:50.445529 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vppdw" podStartSLOduration=2.02446714 podStartE2EDuration="4.445514019s" totalImagesPullingTime="2.421046879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:50.444173074 +0000 UTC m=+248.286204162" watchObservedRunningTime="2026-06-09 12:35:50.445514019 +0000 UTC m=+248.287545084" Jun 09 12:35:54.425699 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:54.425660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:35:54.428213 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:54.428187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da83d31-bbe3-4848-bbf4-a71740b91448-metrics-certs\") pod \"network-metrics-daemon-79pkx\" (UID: \"3da83d31-bbe3-4848-bbf4-a71740b91448\") " pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:35:54.446091 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:54.446061 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerStarted","Data":"bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a"} Jun 09 12:35:54.446229 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:54.446143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerStarted","Data":"f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68"} Jun 09 12:35:54.709424 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:54.709343 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4k8hn\"" Jun 09 12:35:54.716626 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:54.716598 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79pkx" Jun 09 12:35:54.888694 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:54.888428 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-79pkx"] Jun 09 12:35:54.891116 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:35:54.891087 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da83d31_bbe3_4848_bbf4_a71740b91448.slice/crio-e25e7e313fdbd7a7fcc22889466f43156b12caa2b1ed66fefbe5d6c4e74f37d5 WatchSource:0}: Error finding container e25e7e313fdbd7a7fcc22889466f43156b12caa2b1ed66fefbe5d6c4e74f37d5: Status 404 returned error can't find the container with id e25e7e313fdbd7a7fcc22889466f43156b12caa2b1ed66fefbe5d6c4e74f37d5 Jun 09 12:35:55.452050 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:55.452009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-79pkx" event={"ID":"3da83d31-bbe3-4848-bbf4-a71740b91448","Type":"ContainerStarted","Data":"e25e7e313fdbd7a7fcc22889466f43156b12caa2b1ed66fefbe5d6c4e74f37d5"} Jun 09 12:35:56.459070 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:56.459037 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerStarted","Data":"abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece"} Jun 09 12:35:56.459473 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:56.459138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerStarted","Data":"7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487"} Jun 09 12:35:56.459473 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:56.459182 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerStarted","Data":"8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26"} Jun 09 12:35:56.459473 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:56.459221 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerStarted","Data":"07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b"} Jun 09 12:35:56.460702 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:56.460681 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-79pkx" event={"ID":"3da83d31-bbe3-4848-bbf4-a71740b91448","Type":"ContainerStarted","Data":"f6e7cab382e84fcaf7a70f33dc32973ca0dc0a2d95e3cc676f89fa4b7a23878b"} Jun 09 12:35:56.460798 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:56.460717 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-79pkx" event={"ID":"3da83d31-bbe3-4848-bbf4-a71740b91448","Type":"ContainerStarted","Data":"714b28e2beba4f979d6b4b434a5c3d8322b6e90fc23e8b891b93a072f9410cb4"} Jun 09 12:35:56.508889 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:56.508834 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.551734266 podStartE2EDuration="9.508791725s" totalImagesPullingTime="5.936569817s" totalInitContainerRuntime="20.487642ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:56.507138119 +0000 UTC m=+254.349169205" watchObservedRunningTime="2026-06-09 12:35:56.508791725 +0000 UTC m=+254.350822788" Jun 09 12:35:56.527805 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:56.527759 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-79pkx" podStartSLOduration=253.31752668 podStartE2EDuration="4m14.527742934s" totalImagesPullingTime="1.210216254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:56.526141701 +0000 UTC m=+254.368172764" watchObservedRunningTime="2026-06-09 12:35:56.527742934 +0000 UTC m=+254.369773998" Jun 09 12:35:58.162586 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:35:58.162549 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:36:06.275200 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:06.275123 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:36:06.275200 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:06.275187 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:36:22.247788 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:22.247750 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" podUID="0a65d759-5041-4c0c-b1fc-1b8a3e0553bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 12:36:24.146594 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:36:24.146547 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pl5db" podUID="787ebe7b-fb40-4d91-9945-4c922c2ad486" Jun 09 12:36:24.559899 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:24.559870 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pl5db" Jun 09 12:36:26.279723 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:26.279694 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:36:26.283301 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:26.283277 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79557d5bb8-tj4sb" Jun 09 12:36:27.904545 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:27.904505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:36:27.906829 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:27.906800 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/787ebe7b-fb40-4d91-9945-4c922c2ad486-metrics-tls\") pod \"dns-default-pl5db\" (UID: \"787ebe7b-fb40-4d91-9945-4c922c2ad486\") " pod="openshift-dns/dns-default-pl5db" Jun 09 12:36:28.163661 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:28.163578 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b8l29\"" Jun 09 12:36:28.170789 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:28.170770 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pl5db" Jun 09 12:36:28.358634 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:28.358601 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pl5db"] Jun 09 12:36:28.362267 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:36:28.362242 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787ebe7b_fb40_4d91_9945_4c922c2ad486.slice/crio-ac508b63ade53cdc6e23cff47311ed5027f40ca13f43b3a0ec6b1e8a6e5b79dd WatchSource:0}: Error finding container ac508b63ade53cdc6e23cff47311ed5027f40ca13f43b3a0ec6b1e8a6e5b79dd: Status 404 returned error can't find the container with id ac508b63ade53cdc6e23cff47311ed5027f40ca13f43b3a0ec6b1e8a6e5b79dd Jun 09 12:36:28.574988 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:28.574953 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pl5db" event={"ID":"787ebe7b-fb40-4d91-9945-4c922c2ad486","Type":"ContainerStarted","Data":"ac508b63ade53cdc6e23cff47311ed5027f40ca13f43b3a0ec6b1e8a6e5b79dd"} Jun 09 12:36:30.584420 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:30.584390 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pl5db" event={"ID":"787ebe7b-fb40-4d91-9945-4c922c2ad486","Type":"ContainerStarted","Data":"04d3d78a2b4aff8c449a0caf90f5acce0582f363b050853e511ab8c8a8d8432d"} Jun 09 12:36:30.584891 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:30.584439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pl5db" event={"ID":"787ebe7b-fb40-4d91-9945-4c922c2ad486","Type":"ContainerStarted","Data":"f125ace7d73e9ab3a1154d61c27fa3a8a1216f80f6d278fba566d9ddd9b74438"} Jun 09 12:36:30.584891 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:30.584472 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pl5db" Jun 09 12:36:30.603029 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:30.602986 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pl5db" podStartSLOduration=251.021511366 podStartE2EDuration="4m12.602972203s" totalImagesPullingTime="1.581460837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:36:30.601378769 +0000 UTC m=+288.443409833" watchObservedRunningTime="2026-06-09 12:36:30.602972203 +0000 UTC m=+288.445003267" Jun 09 12:36:32.195527 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:32.195495 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79557d5bb8-tj4sb_7a1ef022-2398-40ce-86be-1bbb549f4d9f/metrics-server/0.log" Jun 09 12:36:32.247280 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:32.247243 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" podUID="0a65d759-5041-4c0c-b1fc-1b8a3e0553bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 12:36:32.399252 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:32.399218 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-vppdw_aa08a173-646f-4046-afbf-9f5db2d7dba1/monitoring-plugin/0.log" Jun 09 12:36:32.596319 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:32.596250 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6nhwt_fe0b0928-9723-4f89-9aff-815cbb18fe23/init-textfile/0.log" Jun 09 12:36:32.797324 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:32.797298 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6nhwt_fe0b0928-9723-4f89-9aff-815cbb18fe23/node-exporter/0.log" Jun 09 12:36:32.996378 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:32.996342 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6nhwt_fe0b0928-9723-4f89-9aff-815cbb18fe23/kube-rbac-proxy/0.log" Jun 09 12:36:34.400153 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:34.400127 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wg65s_c7e96915-99b5-4deb-bd7d-2b180025348c/kube-rbac-proxy-main/0.log" Jun 09 12:36:34.596380 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:34.596330 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wg65s_c7e96915-99b5-4deb-bd7d-2b180025348c/kube-rbac-proxy-self/0.log" Jun 09 12:36:34.796733 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:34.796707 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wg65s_c7e96915-99b5-4deb-bd7d-2b180025348c/openshift-state-metrics/0.log" Jun 09 12:36:34.997074 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:34.997047 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2395601f-b926-4d8e-a699-4d059b19aef2/init-config-reloader/0.log" Jun 09 12:36:35.201583 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:35.201555 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2395601f-b926-4d8e-a699-4d059b19aef2/prometheus/0.log" Jun 09 12:36:35.397098 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:35.397072 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2395601f-b926-4d8e-a699-4d059b19aef2/config-reloader/0.log" Jun 09 12:36:35.598174 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:35.598092 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2395601f-b926-4d8e-a699-4d059b19aef2/thanos-sidecar/0.log" Jun 09 12:36:35.796270 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:35.796243 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2395601f-b926-4d8e-a699-4d059b19aef2/kube-rbac-proxy-web/0.log" Jun 09 12:36:35.996608 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:35.996581 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2395601f-b926-4d8e-a699-4d059b19aef2/kube-rbac-proxy/0.log" Jun 09 12:36:36.197804 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:36.197775 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2395601f-b926-4d8e-a699-4d059b19aef2/kube-rbac-proxy-thanos/0.log" Jun 09 12:36:39.615136 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:39.615054 2577 generic.go:356] "Generic (PLEG): container finished" podID="8fd85c49-eef4-43e3-9416-79352feb1943" containerID="eb587edbedd1ba222bbb0309d332d4ed2d45c0bd697ae294f78fa3a3f46ac47b" exitCode=1 Jun 09 12:36:39.615136 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:39.615101 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" event={"ID":"8fd85c49-eef4-43e3-9416-79352feb1943","Type":"ContainerDied","Data":"eb587edbedd1ba222bbb0309d332d4ed2d45c0bd697ae294f78fa3a3f46ac47b"} Jun 09 12:36:39.615584 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:39.615149 2577 scope.go:117] "RemoveContainer" containerID="e8116dc30546215b3ffec2f961b68d8946430f27bec93cdbb5a09fce3e89a590" Jun 09 12:36:39.615584 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:39.615474 2577 scope.go:117] "RemoveContainer" containerID="eb587edbedd1ba222bbb0309d332d4ed2d45c0bd697ae294f78fa3a3f46ac47b" Jun 09 12:36:39.615663 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:36:39.615635 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6b4774cf68-czzmq_open-cluster-management-agent-addon(8fd85c49-eef4-43e3-9416-79352feb1943)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" podUID="8fd85c49-eef4-43e3-9416-79352feb1943" Jun 09 12:36:39.796888 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:39.796861 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pl5db_787ebe7b-fb40-4d91-9945-4c922c2ad486/dns/0.log" Jun 09 12:36:40.002588 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:40.002562 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pl5db_787ebe7b-fb40-4d91-9945-4c922c2ad486/kube-rbac-proxy/0.log" Jun 09 12:36:40.203202 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:40.203168 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:36:40.591057 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:40.591027 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pl5db" Jun 09 12:36:40.619753 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:40.619728 2577 scope.go:117] "RemoveContainer" containerID="eb587edbedd1ba222bbb0309d332d4ed2d45c0bd697ae294f78fa3a3f46ac47b" Jun 09 12:36:40.620204 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:36:40.619901 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6b4774cf68-czzmq_open-cluster-management-agent-addon(8fd85c49-eef4-43e3-9416-79352feb1943)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" podUID="8fd85c49-eef4-43e3-9416-79352feb1943" Jun 09 12:36:40.795603 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:40.795578 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7hnl_3a1ecc72-45f1-4e73-944f-91aab54f0209/dns-node-resolver/0.log" Jun 09 12:36:41.999590 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:41.999565 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tgr7c_686ef415-ee65-4648-8eff-2443ddb85bf8/node-ca/0.log" Jun 09 12:36:42.224639 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.224608 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:36:42.224986 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.224973 2577 scope.go:117] "RemoveContainer" containerID="eb587edbedd1ba222bbb0309d332d4ed2d45c0bd697ae294f78fa3a3f46ac47b" Jun 09 12:36:42.225153 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:36:42.225134 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6b4774cf68-czzmq_open-cluster-management-agent-addon(8fd85c49-eef4-43e3-9416-79352feb1943)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" podUID="8fd85c49-eef4-43e3-9416-79352feb1943" Jun 09 12:36:42.247631 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.247600 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" podUID="0a65d759-5041-4c0c-b1fc-1b8a3e0553bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 12:36:42.247747 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.247656 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" Jun 09 12:36:42.248136 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.248106 2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"2c81debdb124fe195d6f53337c34d1fd551688382625a90351d9a38904c98837"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 12:36:42.248173 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.248154 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" podUID="0a65d759-5041-4c0c-b1fc-1b8a3e0553bd" containerName="service-proxy" containerID="cri-o://2c81debdb124fe195d6f53337c34d1fd551688382625a90351d9a38904c98837" gracePeriod=30 Jun 09 12:36:42.541879 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.541792 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbzkh_8114e26e-e0ed-4d9f-b952-91d24ef77fe6/ovn-acl-logging/0.log" Jun 09 12:36:42.550559 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.550536 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbzkh_8114e26e-e0ed-4d9f-b952-91d24ef77fe6/ovn-acl-logging/0.log" Jun 09 12:36:42.551489 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.551468 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 12:36:42.628828 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.628682 2577 generic.go:356] "Generic (PLEG): container finished" podID="0a65d759-5041-4c0c-b1fc-1b8a3e0553bd" containerID="2c81debdb124fe195d6f53337c34d1fd551688382625a90351d9a38904c98837" exitCode=2 Jun 09 12:36:42.628828 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.628761 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" event={"ID":"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd","Type":"ContainerDied","Data":"2c81debdb124fe195d6f53337c34d1fd551688382625a90351d9a38904c98837"} Jun 09 12:36:42.628828 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.628808 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-856999f7c4-rrpk5" event={"ID":"0a65d759-5041-4c0c-b1fc-1b8a3e0553bd","Type":"ContainerStarted","Data":"3cbfd16dc4db253055ba5bc6969fbeda1a63f9feaf3779b741d1be28766c0276"} Jun 09 12:36:42.804318 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:42.804245 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-shdsj_f2aab8e0-280c-4fac-b243-1b63e88d0b67/serve-healthcheck-canary/0.log" Jun 09 12:36:48.162191 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:48.162149 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:36:48.182151 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:48.182129 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:36:48.664874 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:48.664850 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:36:53.604798 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:53.604768 2577 scope.go:117] "RemoveContainer" containerID="eb587edbedd1ba222bbb0309d332d4ed2d45c0bd697ae294f78fa3a3f46ac47b" Jun 09 12:36:53.669973 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:53.669941 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" event={"ID":"8fd85c49-eef4-43e3-9416-79352feb1943","Type":"ContainerStarted","Data":"76a6807408db427485937e09c26ac4117b894b039da52ba6ad2adaa9248c322a"} Jun 09 12:36:53.670307 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:53.670288 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:36:53.671463 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:53.671438 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" podUID="8fd85c49-eef4-43e3-9416-79352feb1943" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jun 09 12:36:54.674409 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:36:54.674383 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b4774cf68-czzmq" Jun 09 12:37:06.285553 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.285522 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:37:06.286049 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.285788 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="prometheus" containerID="cri-o://f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68" gracePeriod=600 Jun 09 12:37:06.286049 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.285810 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="kube-rbac-proxy" containerID="cri-o://7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487" gracePeriod=600 Jun 09 12:37:06.286049 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.285840 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="thanos-sidecar" containerID="cri-o://07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b" gracePeriod=600 Jun 09 12:37:06.286049 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.285875 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="config-reloader" containerID="cri-o://bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a" gracePeriod=600 Jun 09 12:37:06.286049 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.285877 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece" gracePeriod=600 Jun 09 12:37:06.286049 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.285900 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="kube-rbac-proxy-web" containerID="cri-o://8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26" gracePeriod=600 Jun 09 12:37:06.717719 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.717689 2577 generic.go:356] "Generic (PLEG): container finished" podID="2395601f-b926-4d8e-a699-4d059b19aef2" containerID="abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece" exitCode=0 Jun 09 12:37:06.717719 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.717714 2577 generic.go:356] "Generic (PLEG): container finished" podID="2395601f-b926-4d8e-a699-4d059b19aef2" containerID="7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487" exitCode=0 Jun 09 12:37:06.717719 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.717719 2577 generic.go:356] "Generic (PLEG): container finished" podID="2395601f-b926-4d8e-a699-4d059b19aef2" containerID="07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b" exitCode=0 Jun 09 12:37:06.717719 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.717724 2577 generic.go:356] "Generic (PLEG): container finished" podID="2395601f-b926-4d8e-a699-4d059b19aef2" containerID="bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a" exitCode=0 Jun 09 12:37:06.717967 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.717729 2577 generic.go:356] "Generic (PLEG): container finished" podID="2395601f-b926-4d8e-a699-4d059b19aef2" containerID="f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68" exitCode=0 Jun 09 12:37:06.717967 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.717754 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerDied","Data":"abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece"} Jun 09 12:37:06.717967 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.717813 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerDied","Data":"7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487"} Jun 09 12:37:06.717967 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.717839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerDied","Data":"07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b"} Jun 09 12:37:06.717967 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.717863 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerDied","Data":"bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a"} Jun 09 12:37:06.717967 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:06.717886 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerDied","Data":"f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68"} Jun 09 12:37:07.517769 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.517747 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.624963 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.624884 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-1\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.624963 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.624917 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-db\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.624963 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.624938 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-kubelet-serving-ca-bundle\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.624963 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.624960 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-kube-rbac-proxy\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625010 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2395601f-b926-4d8e-a699-4d059b19aef2-config-out\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625039 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-web-config\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625068 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-serving-certs-ca-bundle\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625094 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-metrics-client-certs\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625121 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-tls\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625155 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-0\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625183 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-metrics-client-ca\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625207 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-2\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625254 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zxrn\" (UniqueName: \"kubernetes.io/projected/2395601f-b926-4d8e-a699-4d059b19aef2-kube-api-access-5zxrn\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625282 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625323 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625327 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:07.625791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625345 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2395601f-b926-4d8e-a699-4d059b19aef2-tls-assets\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625395 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:07.625791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625446 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-trusted-ca-bundle\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625490 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-thanos-prometheus-http-client-file\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625521 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-grpc-tls\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.625791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625543 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-config\") pod \"2395601f-b926-4d8e-a699-4d059b19aef2\" (UID: \"2395601f-b926-4d8e-a699-4d059b19aef2\") " Jun 09 12:37:07.626230 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625813 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:07.626230 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.625844 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:07.626230 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.626073 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:37:07.626398 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.626198 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:07.626398 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.626347 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:07.627187 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.627152 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.627187 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.627183 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.627382 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.627199 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-db\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.627382 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.627212 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.627382 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.627225 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.627382 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.627238 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-configmap-metrics-client-ca\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.627382 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.627250 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.627629 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.627468 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:07.627996 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.627969 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2395601f-b926-4d8e-a699-4d059b19aef2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:37:07.629427 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.629385 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:07.629571 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.629550 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:07.629871 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.629850 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2395601f-b926-4d8e-a699-4d059b19aef2-kube-api-access-5zxrn" (OuterVolumeSpecName: "kube-api-access-5zxrn") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "kube-api-access-5zxrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:37:07.629953 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.629854 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-config" (OuterVolumeSpecName: "config") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:07.630012 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.629976 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2395601f-b926-4d8e-a699-4d059b19aef2-config-out" (OuterVolumeSpecName: "config-out") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:37:07.630274 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.630248 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:07.630538 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.630513 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:07.630627 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.630532 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:07.630866 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.630837 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:07.630934 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.630866 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:07.638834 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.638815 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-web-config" (OuterVolumeSpecName: "web-config") pod "2395601f-b926-4d8e-a699-4d059b19aef2" (UID: "2395601f-b926-4d8e-a699-4d059b19aef2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:07.724469 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.724437 2577 generic.go:356] "Generic (PLEG): container finished" podID="2395601f-b926-4d8e-a699-4d059b19aef2" containerID="8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26" exitCode=0 Jun 09 12:37:07.724646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.724503 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerDied","Data":"8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26"} Jun 09 12:37:07.724646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.724517 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.724646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.724576 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2395601f-b926-4d8e-a699-4d059b19aef2","Type":"ContainerDied","Data":"80ebb8d3ec18c9551eb652525475755bd8c61a7292a77b9a24033ee72f83d302"} Jun 09 12:37:07.724646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.724625 2577 scope.go:117] "RemoveContainer" containerID="abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece" Jun 09 12:37:07.728042 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728024 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zxrn\" (UniqueName: \"kubernetes.io/projected/2395601f-b926-4d8e-a699-4d059b19aef2-kube-api-access-5zxrn\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.728128 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728048 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.728128 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728065 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.728128 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728080 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2395601f-b926-4d8e-a699-4d059b19aef2-tls-assets\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.728128 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728094 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.728128 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728108 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-grpc-tls\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.728128 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728121 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-config\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.728323 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728134 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-kube-rbac-proxy\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.728323 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728147 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2395601f-b926-4d8e-a699-4d059b19aef2-config-out\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.728323 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728161 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-web-config\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.728323 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728173 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-metrics-client-certs\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.728323 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728188 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2395601f-b926-4d8e-a699-4d059b19aef2-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.728323 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.728203 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2395601f-b926-4d8e-a699-4d059b19aef2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.733266 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.733248 2577 scope.go:117] "RemoveContainer" containerID="7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487" Jun 09 12:37:07.740235 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.740220 2577 scope.go:117] "RemoveContainer" containerID="8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26" Jun 09 12:37:07.747929 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.747886 2577 scope.go:117] "RemoveContainer" containerID="07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b" Jun 09 12:37:07.749720 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.749701 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:37:07.754099 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.754075 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:37:07.755288 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.755273 2577 scope.go:117] "RemoveContainer" containerID="bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a" Jun 09 12:37:07.761620 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.761607 2577 scope.go:117] "RemoveContainer" containerID="f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68" Jun 09 12:37:07.768109 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.768093 2577 scope.go:117] "RemoveContainer" containerID="de1d393370c1826a479e2b874f8dc1ed9b5f87d399f7c29d580f223662738317" Jun 09 12:37:07.774299 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.774283 2577 scope.go:117] "RemoveContainer" containerID="abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece" Jun 09 12:37:07.774540 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:37:07.774523 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece\": container with ID starting with abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece not found: ID does not exist" containerID="abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece" Jun 09 12:37:07.774591 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.774547 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece"} err="failed to get container status \"abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece\": rpc error: code = NotFound desc = could not find container \"abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece\": container with ID starting with abce761f0efecda92cb7766001736528e4162615c8b8a9cabb842d34f8ce9ece not found: ID does not exist" Jun 09 12:37:07.774591 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.774564 2577 scope.go:117] "RemoveContainer" containerID="7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487" Jun 09 12:37:07.774782 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:37:07.774765 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487\": container with ID starting with 7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487 not found: ID does not exist" containerID="7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487" Jun 09 12:37:07.774825 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.774791 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487"} err="failed to get container status \"7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487\": rpc error: code = NotFound desc = could not find container \"7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487\": container with ID starting with 7813f454b2cf7028cd41c1cdf57f8730c0f0a603aee5f7c0c4ec765865e68487 not found: ID does not exist" Jun 09 12:37:07.774825 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.774811 2577 scope.go:117] "RemoveContainer" containerID="8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26" Jun 09 12:37:07.775007 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:37:07.774986 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26\": container with ID starting with 8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26 not found: ID does not exist" containerID="8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26" Jun 09 12:37:07.775048 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.775012 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26"} err="failed to get container status \"8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26\": rpc error: code = NotFound desc = could not find container \"8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26\": container with ID starting with 8e97748a167db6c2010c8103802b95124249eecae4e61a0df1c6f1aee2520e26 not found: ID does not exist" Jun 09 12:37:07.775048 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.775025 2577 scope.go:117] "RemoveContainer" containerID="07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b" Jun 09 12:37:07.775219 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:37:07.775200 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b\": container with ID starting with 07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b not found: ID does not exist" containerID="07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b" Jun 09 12:37:07.775279 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.775227 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b"} err="failed to get container status \"07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b\": rpc error: code = NotFound desc = could not find container \"07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b\": container with ID starting with 07c7fc83d42de2b68d1847b81cd919f65509fa405218e0c665edcdd60963480b not found: ID does not exist" Jun 09 12:37:07.775279 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.775250 2577 scope.go:117] "RemoveContainer" containerID="bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a" Jun 09 12:37:07.775469 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:37:07.775452 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a\": container with ID starting with bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a not found: ID does not exist" containerID="bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a" Jun 09 12:37:07.775515 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.775475 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a"} err="failed to get container status \"bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a\": rpc error: code = NotFound desc = could not find container \"bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a\": container with ID starting with bab3a30196be54f17361dd88f97dcb759ba1145ae91345d67e31aab88b6eb18a not found: ID does not exist" Jun 09 12:37:07.775515 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.775489 2577 scope.go:117] "RemoveContainer" containerID="f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68" Jun 09 12:37:07.775671 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:37:07.775657 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68\": container with ID starting with f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68 not found: ID does not exist" containerID="f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68" Jun 09 12:37:07.775715 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.775672 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68"} err="failed to get container status \"f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68\": rpc error: code = NotFound desc = could not find container \"f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68\": container with ID starting with f8091818b0748c8019724d08ee39b5bdb21a890e48af6135ce2b27d9502a5f68 not found: ID does not exist" Jun 09 12:37:07.775715 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.775684 2577 scope.go:117] "RemoveContainer" containerID="de1d393370c1826a479e2b874f8dc1ed9b5f87d399f7c29d580f223662738317" Jun 09 12:37:07.775872 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:37:07.775842 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de1d393370c1826a479e2b874f8dc1ed9b5f87d399f7c29d580f223662738317\": container with ID starting with de1d393370c1826a479e2b874f8dc1ed9b5f87d399f7c29d580f223662738317 not found: ID does not exist" containerID="de1d393370c1826a479e2b874f8dc1ed9b5f87d399f7c29d580f223662738317" Jun 09 12:37:07.775913 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.775875 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1d393370c1826a479e2b874f8dc1ed9b5f87d399f7c29d580f223662738317"} err="failed to get container status \"de1d393370c1826a479e2b874f8dc1ed9b5f87d399f7c29d580f223662738317\": rpc error: code = NotFound desc = could not find container \"de1d393370c1826a479e2b874f8dc1ed9b5f87d399f7c29d580f223662738317\": container with ID starting with de1d393370c1826a479e2b874f8dc1ed9b5f87d399f7c29d580f223662738317 not found: ID does not exist" Jun 09 12:37:07.786155 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786135 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:37:07.786429 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786414 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="init-config-reloader" Jun 09 12:37:07.786504 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786432 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="init-config-reloader" Jun 09 12:37:07.786504 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786442 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="config-reloader" Jun 09 12:37:07.786504 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786451 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="config-reloader" Jun 09 12:37:07.786504 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786465 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="kube-rbac-proxy" Jun 09 12:37:07.786504 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786474 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="kube-rbac-proxy" Jun 09 12:37:07.786504 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786490 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="kube-rbac-proxy-web" Jun 09 12:37:07.786504 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786498 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="kube-rbac-proxy-web" Jun 09 12:37:07.786823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786520 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="thanos-sidecar" Jun 09 12:37:07.786823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786528 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="thanos-sidecar" Jun 09 12:37:07.786823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786539 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="prometheus" Jun 09 12:37:07.786823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786547 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="prometheus" Jun 09 12:37:07.786823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786559 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="kube-rbac-proxy-thanos" Jun 09 12:37:07.786823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786568 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="kube-rbac-proxy-thanos" Jun 09 12:37:07.786823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786625 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="kube-rbac-proxy" Jun 09 12:37:07.786823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786637 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="thanos-sidecar" Jun 09 12:37:07.786823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786648 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="kube-rbac-proxy-thanos" Jun 09 12:37:07.786823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786658 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="config-reloader" Jun 09 12:37:07.786823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786669 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="prometheus" Jun 09 12:37:07.786823 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.786677 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" containerName="kube-rbac-proxy-web" Jun 09 12:37:07.792295 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.792279 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.796256 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.796238 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 12:37:07.796333 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.796238 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 12:37:07.796591 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.796575 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 12:37:07.796857 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.796845 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 12:37:07.796857 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.796851 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 12:37:07.796926 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.796862 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 12:37:07.797088 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.797074 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 12:37:07.797431 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.797409 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 12:37:07.797560 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.797456 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 12:37:07.797560 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.797413 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fpvmfpkgjn2dt\"" Jun 09 12:37:07.797802 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.797787 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 12:37:07.798090 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.798070 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 12:37:07.798199 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.798077 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 12:37:07.798199 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.798124 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j5fnh\"" Jun 09 12:37:07.806045 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.802234 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 12:37:07.806909 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.806889 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 12:37:07.810842 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.810823 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:37:07.829480 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829576 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829576 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829659 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-config\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829659 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58cd1d00-f894-45b9-84a3-ad8f36187a7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829739 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829664 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829739 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829739 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829708 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829739 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829888 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58cd1d00-f894-45b9-84a3-ad8f36187a7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829888 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829888 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829803 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829888 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829888 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.829888 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6dqm\" (UniqueName: \"kubernetes.io/projected/58cd1d00-f894-45b9-84a3-ad8f36187a7c-kube-api-access-m6dqm\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.830140 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.830140 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.830140 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.830140 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.829999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.830140 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.830013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.930790 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.930756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.930790 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.930792 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931028 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.930810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931028 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.930826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931028 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.930843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6dqm\" (UniqueName: \"kubernetes.io/projected/58cd1d00-f894-45b9-84a3-ad8f36187a7c-kube-api-access-m6dqm\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931028 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.930877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931028 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.930906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931028 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.930921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931028 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.930945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931028 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.930966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931028 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931441 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931441 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931441 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-config\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931441 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58cd1d00-f894-45b9-84a3-ad8f36187a7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931441 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931441 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931441 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931441 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931441 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58cd1d00-f894-45b9-84a3-ad8f36187a7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931804 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931551 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931804 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931804 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931658 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.931959 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.931880 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.932960 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.932228 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.932960 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.932682 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.933763 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.933736 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.934321 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.934297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.934632 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.934606 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.935099 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.935072 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-config\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.935183 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.935079 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.935642 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.935615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.935797 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.935776 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/58cd1d00-f894-45b9-84a3-ad8f36187a7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.935865 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.935797 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/58cd1d00-f894-45b9-84a3-ad8f36187a7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.936211 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.936178 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.936302 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.936286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.936393 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.936329 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/58cd1d00-f894-45b9-84a3-ad8f36187a7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.936588 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.936571 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.937001 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.936985 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/58cd1d00-f894-45b9-84a3-ad8f36187a7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:07.941353 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:07.941331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6dqm\" (UniqueName: \"kubernetes.io/projected/58cd1d00-f894-45b9-84a3-ad8f36187a7c-kube-api-access-m6dqm\") pod \"prometheus-k8s-0\" (UID: \"58cd1d00-f894-45b9-84a3-ad8f36187a7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:08.101724 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:08.101667 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:37:08.239900 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:08.239697 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:37:08.242296 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:37:08.242271 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58cd1d00_f894_45b9_84a3_ad8f36187a7c.slice/crio-469fe6ed0682bd1286f899d8bfe7a77b7f7bc9d8f67c168b9bc0e0c2d48ab41e WatchSource:0}: Error finding container 469fe6ed0682bd1286f899d8bfe7a77b7f7bc9d8f67c168b9bc0e0c2d48ab41e: Status 404 returned error can't find the container with id 469fe6ed0682bd1286f899d8bfe7a77b7f7bc9d8f67c168b9bc0e0c2d48ab41e Jun 09 12:37:08.609101 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:08.609005 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2395601f-b926-4d8e-a699-4d059b19aef2" path="/var/lib/kubelet/pods/2395601f-b926-4d8e-a699-4d059b19aef2/volumes" Jun 09 12:37:08.729919 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:08.729883 2577 generic.go:356] "Generic (PLEG): container finished" podID="58cd1d00-f894-45b9-84a3-ad8f36187a7c" containerID="cc5c6d04f2ccf10cd9f6b9481d03233fcfc8a17876e9d5beb0c6c4a84c1bf5ee" exitCode=0 Jun 09 12:37:08.729919 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:08.729921 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58cd1d00-f894-45b9-84a3-ad8f36187a7c","Type":"ContainerDied","Data":"cc5c6d04f2ccf10cd9f6b9481d03233fcfc8a17876e9d5beb0c6c4a84c1bf5ee"} Jun 09 12:37:08.730135 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:08.729984 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58cd1d00-f894-45b9-84a3-ad8f36187a7c","Type":"ContainerStarted","Data":"469fe6ed0682bd1286f899d8bfe7a77b7f7bc9d8f67c168b9bc0e0c2d48ab41e"} Jun 09 12:37:09.737065 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:09.737029 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58cd1d00-f894-45b9-84a3-ad8f36187a7c","Type":"ContainerStarted","Data":"abdb182e032d7112f4e56155b38485ada80e26a21574eddfed0cc2a9844752eb"} Jun 09 12:37:09.737487 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:09.737098 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58cd1d00-f894-45b9-84a3-ad8f36187a7c","Type":"ContainerStarted","Data":"4317c4ef76708ebcccb3dd03e11a2659a9e466a7f4f4276a9836d538664c8c45"} Jun 09 12:37:09.737487 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:09.737131 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58cd1d00-f894-45b9-84a3-ad8f36187a7c","Type":"ContainerStarted","Data":"ce351a66918162ceeda5f06641d9588b448764b606de2da3acd12bf755df7442"} Jun 09 12:37:09.737487 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:09.737156 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58cd1d00-f894-45b9-84a3-ad8f36187a7c","Type":"ContainerStarted","Data":"c913390b666d9619fca554a78e1090e7496855e5095e593a4db32b86f5094617"} Jun 09 12:37:09.737487 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:09.737187 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58cd1d00-f894-45b9-84a3-ad8f36187a7c","Type":"ContainerStarted","Data":"39ac33c728a1111a8135d5c57b482f842abbfa8ac101e0ffb7ae9911aa612b14"} Jun 09 12:37:09.737487 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:09.737213 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"58cd1d00-f894-45b9-84a3-ad8f36187a7c","Type":"ContainerStarted","Data":"9c73f3e9ef2ff2ef6a874181ba790b245e037e8f7a1f11b7c8f2315e529f0ed2"} Jun 09 12:37:09.786878 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:09.786828 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.765325153 podStartE2EDuration="2.786806976s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.481823ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:37:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:37:09.784437887 +0000 UTC m=+327.626468967" watchObservedRunningTime="2026-06-09 12:37:09.786806976 +0000 UTC m=+327.628838040" Jun 09 12:37:13.102033 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:37:13.101998 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:38:08.102054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:38:08.102006 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:38:08.117044 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:38:08.117022 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:38:08.954083 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:38:08.954050 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:40:42.259671 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.259595 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r"] Jun 09 12:40:42.262850 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.262831 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.266589 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.266561 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2wp74\"" Jun 09 12:40:42.266842 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.266818 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 12:40:42.266940 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.266455 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 12:40:42.267106 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.267088 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 12:40:42.267447 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.267205 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 12:40:42.308991 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.308965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm6gb\" (UniqueName: \"kubernetes.io/projected/ccd920d1-b253-4521-8646-a88a321dacc4-kube-api-access-fm6gb\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.309133 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.309000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccd920d1-b253-4521-8646-a88a321dacc4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.309133 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.309017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccd920d1-b253-4521-8646-a88a321dacc4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.309133 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.309109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccd920d1-b253-4521-8646-a88a321dacc4-tmp\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.309257 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.309146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccd920d1-b253-4521-8646-a88a321dacc4-manifests\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.405127 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.405096 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r"] Jun 09 12:40:42.409770 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.409746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccd920d1-b253-4521-8646-a88a321dacc4-tmp\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.409907 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.409776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccd920d1-b253-4521-8646-a88a321dacc4-manifests\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.409907 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.409805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm6gb\" (UniqueName: \"kubernetes.io/projected/ccd920d1-b253-4521-8646-a88a321dacc4-kube-api-access-fm6gb\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.409907 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.409832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccd920d1-b253-4521-8646-a88a321dacc4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.409907 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.409856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccd920d1-b253-4521-8646-a88a321dacc4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.410301 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.410273 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccd920d1-b253-4521-8646-a88a321dacc4-manifests\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.412112 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.412085 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccd920d1-b253-4521-8646-a88a321dacc4-tmp\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.412202 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.412166 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccd920d1-b253-4521-8646-a88a321dacc4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.412241 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.412230 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccd920d1-b253-4521-8646-a88a321dacc4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.423154 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.423132 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm6gb\" (UniqueName: \"kubernetes.io/projected/ccd920d1-b253-4521-8646-a88a321dacc4-kube-api-access-fm6gb\") pod \"opendatahub-operator-controller-manager-6b4c856db4-8mw7r\" (UID: \"ccd920d1-b253-4521-8646-a88a321dacc4\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.579325 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.579250 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2wp74\"" Jun 09 12:40:42.586740 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.586720 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:42.743902 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.743872 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r"] Jun 09 12:40:42.747558 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:40:42.747536 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd920d1_b253_4521_8646_a88a321dacc4.slice/crio-faf1edcdddf9e743b6644719ee22f6aee5979f5b39e0318157cd9b8e93eb1885 WatchSource:0}: Error finding container faf1edcdddf9e743b6644719ee22f6aee5979f5b39e0318157cd9b8e93eb1885: Status 404 returned error can't find the container with id faf1edcdddf9e743b6644719ee22f6aee5979f5b39e0318157cd9b8e93eb1885 Jun 09 12:40:42.749197 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:42.749179 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:40:43.480155 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:43.480106 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" event={"ID":"ccd920d1-b253-4521-8646-a88a321dacc4","Type":"ContainerStarted","Data":"faf1edcdddf9e743b6644719ee22f6aee5979f5b39e0318157cd9b8e93eb1885"} Jun 09 12:40:46.494472 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:46.494439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" event={"ID":"ccd920d1-b253-4521-8646-a88a321dacc4","Type":"ContainerStarted","Data":"bd6ab52caae0ee682250223d8da7ee0134d24bbfb287df253cbd13a3e8f37d51"} Jun 09 12:40:47.500278 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:47.500243 2577 generic.go:356] "Generic (PLEG): container finished" podID="ccd920d1-b253-4521-8646-a88a321dacc4" containerID="bd6ab52caae0ee682250223d8da7ee0134d24bbfb287df253cbd13a3e8f37d51" exitCode=0 Jun 09 12:40:47.500850 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:47.500312 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" event={"ID":"ccd920d1-b253-4521-8646-a88a321dacc4","Type":"ContainerDied","Data":"bd6ab52caae0ee682250223d8da7ee0134d24bbfb287df253cbd13a3e8f37d51"} Jun 09 12:40:48.505984 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:48.505946 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" event={"ID":"ccd920d1-b253-4521-8646-a88a321dacc4","Type":"ContainerStarted","Data":"b8e849787212c35025393317bad8fa049dc51649f1ae35abd88c35c7dec27c20"} Jun 09 12:40:48.506355 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:48.506096 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:40:48.530937 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:48.530844 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" podStartSLOduration=2.384569451 podStartE2EDuration="6.530825808s" totalImagesPullingTime="3.165117481s" totalInitContainerRuntime="981.138876ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:40:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:40:48.529399375 +0000 UTC m=+546.371430432" watchObservedRunningTime="2026-06-09 12:40:48.530825808 +0000 UTC m=+546.372856873" Jun 09 12:40:59.512720 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:40:59.512690 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-8mw7r" Jun 09 12:41:01.977267 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:01.977227 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq"] Jun 09 12:41:01.990861 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:01.990836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" Jun 09 12:41:01.997803 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:01.996878 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 12:41:01.997803 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:01.996992 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tqb88\"" Jun 09 12:41:01.997803 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:01.997002 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 12:41:01.997803 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:01.997138 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 12:41:01.997803 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:01.997156 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 12:41:01.998995 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:01.998968 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq"] Jun 09 12:41:02.077344 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:02.077303 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0642592f-37d0-473b-88d7-2b1190e34319-tls-certs\") pod \"kube-auth-proxy-79dfc5c477-sbpmq\" (UID: \"0642592f-37d0-473b-88d7-2b1190e34319\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" Jun 09 12:41:02.077344 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:02.077347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvngf\" (UniqueName: \"kubernetes.io/projected/0642592f-37d0-473b-88d7-2b1190e34319-kube-api-access-kvngf\") pod \"kube-auth-proxy-79dfc5c477-sbpmq\" (UID: \"0642592f-37d0-473b-88d7-2b1190e34319\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" Jun 09 12:41:02.077595 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:02.077415 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0642592f-37d0-473b-88d7-2b1190e34319-tmp\") pod \"kube-auth-proxy-79dfc5c477-sbpmq\" (UID: \"0642592f-37d0-473b-88d7-2b1190e34319\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" Jun 09 12:41:02.178761 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:02.178723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0642592f-37d0-473b-88d7-2b1190e34319-tls-certs\") pod \"kube-auth-proxy-79dfc5c477-sbpmq\" (UID: \"0642592f-37d0-473b-88d7-2b1190e34319\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" Jun 09 12:41:02.178941 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:02.178768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvngf\" (UniqueName: \"kubernetes.io/projected/0642592f-37d0-473b-88d7-2b1190e34319-kube-api-access-kvngf\") pod \"kube-auth-proxy-79dfc5c477-sbpmq\" (UID: \"0642592f-37d0-473b-88d7-2b1190e34319\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" Jun 09 12:41:02.178941 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:02.178814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0642592f-37d0-473b-88d7-2b1190e34319-tmp\") pod \"kube-auth-proxy-79dfc5c477-sbpmq\" (UID: \"0642592f-37d0-473b-88d7-2b1190e34319\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" Jun 09 12:41:02.181159 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:02.181137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0642592f-37d0-473b-88d7-2b1190e34319-tmp\") pod \"kube-auth-proxy-79dfc5c477-sbpmq\" (UID: \"0642592f-37d0-473b-88d7-2b1190e34319\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" Jun 09 12:41:02.181277 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:02.181259 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0642592f-37d0-473b-88d7-2b1190e34319-tls-certs\") pod \"kube-auth-proxy-79dfc5c477-sbpmq\" (UID: \"0642592f-37d0-473b-88d7-2b1190e34319\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" Jun 09 12:41:02.193616 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:02.193585 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvngf\" (UniqueName: \"kubernetes.io/projected/0642592f-37d0-473b-88d7-2b1190e34319-kube-api-access-kvngf\") pod \"kube-auth-proxy-79dfc5c477-sbpmq\" (UID: \"0642592f-37d0-473b-88d7-2b1190e34319\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" Jun 09 12:41:02.301543 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:02.301456 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" Jun 09 12:41:02.436739 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:02.436714 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq"] Jun 09 12:41:02.439378 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:41:02.439333 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0642592f_37d0_473b_88d7_2b1190e34319.slice/crio-cad32a8c9afb7b1c45fd3d7b341bfa9db8553ddb9ab47bd2013a785bf352a720 WatchSource:0}: Error finding container cad32a8c9afb7b1c45fd3d7b341bfa9db8553ddb9ab47bd2013a785bf352a720: Status 404 returned error can't find the container with id cad32a8c9afb7b1c45fd3d7b341bfa9db8553ddb9ab47bd2013a785bf352a720 Jun 09 12:41:02.557068 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:02.556987 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" event={"ID":"0642592f-37d0-473b-88d7-2b1190e34319","Type":"ContainerStarted","Data":"cad32a8c9afb7b1c45fd3d7b341bfa9db8553ddb9ab47bd2013a785bf352a720"} Jun 09 12:41:04.758297 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.758265 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9"] Jun 09 12:41:04.760737 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.760707 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:04.764081 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.764054 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 12:41:04.764255 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.764116 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 12:41:04.765103 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.765080 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 12:41:04.765231 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.765157 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:41:04.765231 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.765222 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-njs8q\"" Jun 09 12:41:04.765480 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.765463 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 12:41:04.781150 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.781123 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9"] Jun 09 12:41:04.903049 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.903009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fb39235f-bfdb-4ef2-8261-81d1cc578bcf-manager-config\") pod \"lws-controller-manager-b48576bd-xkjn9\" (UID: \"fb39235f-bfdb-4ef2-8261-81d1cc578bcf\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:04.903227 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.903051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv7sl\" (UniqueName: \"kubernetes.io/projected/fb39235f-bfdb-4ef2-8261-81d1cc578bcf-kube-api-access-vv7sl\") pod \"lws-controller-manager-b48576bd-xkjn9\" (UID: \"fb39235f-bfdb-4ef2-8261-81d1cc578bcf\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:04.903227 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.903130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb39235f-bfdb-4ef2-8261-81d1cc578bcf-cert\") pod \"lws-controller-manager-b48576bd-xkjn9\" (UID: \"fb39235f-bfdb-4ef2-8261-81d1cc578bcf\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:04.903227 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:04.903196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb39235f-bfdb-4ef2-8261-81d1cc578bcf-metrics-cert\") pod \"lws-controller-manager-b48576bd-xkjn9\" (UID: \"fb39235f-bfdb-4ef2-8261-81d1cc578bcf\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:05.003705 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.003670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fb39235f-bfdb-4ef2-8261-81d1cc578bcf-manager-config\") pod \"lws-controller-manager-b48576bd-xkjn9\" (UID: \"fb39235f-bfdb-4ef2-8261-81d1cc578bcf\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:05.003705 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.003712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv7sl\" (UniqueName: \"kubernetes.io/projected/fb39235f-bfdb-4ef2-8261-81d1cc578bcf-kube-api-access-vv7sl\") pod \"lws-controller-manager-b48576bd-xkjn9\" (UID: \"fb39235f-bfdb-4ef2-8261-81d1cc578bcf\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:05.003925 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.003738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb39235f-bfdb-4ef2-8261-81d1cc578bcf-cert\") pod \"lws-controller-manager-b48576bd-xkjn9\" (UID: \"fb39235f-bfdb-4ef2-8261-81d1cc578bcf\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:05.003982 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.003919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb39235f-bfdb-4ef2-8261-81d1cc578bcf-metrics-cert\") pod \"lws-controller-manager-b48576bd-xkjn9\" (UID: \"fb39235f-bfdb-4ef2-8261-81d1cc578bcf\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:05.004503 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.004478 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fb39235f-bfdb-4ef2-8261-81d1cc578bcf-manager-config\") pod \"lws-controller-manager-b48576bd-xkjn9\" (UID: \"fb39235f-bfdb-4ef2-8261-81d1cc578bcf\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:05.006557 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.006535 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb39235f-bfdb-4ef2-8261-81d1cc578bcf-metrics-cert\") pod \"lws-controller-manager-b48576bd-xkjn9\" (UID: \"fb39235f-bfdb-4ef2-8261-81d1cc578bcf\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:05.006790 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.006765 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb39235f-bfdb-4ef2-8261-81d1cc578bcf-cert\") pod \"lws-controller-manager-b48576bd-xkjn9\" (UID: \"fb39235f-bfdb-4ef2-8261-81d1cc578bcf\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:05.013268 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.013209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv7sl\" (UniqueName: \"kubernetes.io/projected/fb39235f-bfdb-4ef2-8261-81d1cc578bcf-kube-api-access-vv7sl\") pod \"lws-controller-manager-b48576bd-xkjn9\" (UID: \"fb39235f-bfdb-4ef2-8261-81d1cc578bcf\") " pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:05.072806 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.072769 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:05.330887 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.330855 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9"] Jun 09 12:41:05.333001 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:41:05.332975 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb39235f_bfdb_4ef2_8261_81d1cc578bcf.slice/crio-2bfc3d33f9dbb9f6a8a4b15d5984cd35bdfe10365ea5a3396995aadd17698599 WatchSource:0}: Error finding container 2bfc3d33f9dbb9f6a8a4b15d5984cd35bdfe10365ea5a3396995aadd17698599: Status 404 returned error can't find the container with id 2bfc3d33f9dbb9f6a8a4b15d5984cd35bdfe10365ea5a3396995aadd17698599 Jun 09 12:41:05.571725 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.571640 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" event={"ID":"0642592f-37d0-473b-88d7-2b1190e34319","Type":"ContainerStarted","Data":"4c7b08e57de635dc5bce17e037b9f8646e6c486688213be1b006d5d3e9002675"} Jun 09 12:41:05.572768 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.572745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" event={"ID":"fb39235f-bfdb-4ef2-8261-81d1cc578bcf","Type":"ContainerStarted","Data":"2bfc3d33f9dbb9f6a8a4b15d5984cd35bdfe10365ea5a3396995aadd17698599"} Jun 09 12:41:05.591435 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:05.591390 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79dfc5c477-sbpmq" podStartSLOduration=1.7922798009999998 podStartE2EDuration="4.591375855s" totalImagesPullingTime="2.799096054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:05.589470028 +0000 UTC m=+563.431501092" watchObservedRunningTime="2026-06-09 12:41:05.591375855 +0000 UTC m=+563.433406913" Jun 09 12:41:08.585339 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:08.585302 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" event={"ID":"fb39235f-bfdb-4ef2-8261-81d1cc578bcf","Type":"ContainerStarted","Data":"64657578697b8eb31140f03e788feae1b62e19c907e2abd2c0089ef7c010b5a9"} Jun 09 12:41:08.585814 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:08.585432 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:08.618375 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:08.618307 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" podStartSLOduration=2.375223234 podStartE2EDuration="4.618290236s" totalImagesPullingTime="2.243067002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:08.617010442 +0000 UTC m=+566.459041507" watchObservedRunningTime="2026-06-09 12:41:08.618290236 +0000 UTC m=+566.460321300" Jun 09 12:41:19.590797 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:19.590768 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b48576bd-xkjn9" Jun 09 12:41:42.573989 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:42.573961 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbzkh_8114e26e-e0ed-4d9f-b952-91d24ef77fe6/ovn-acl-logging/0.log" Jun 09 12:41:42.574478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:41:42.574441 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbzkh_8114e26e-e0ed-4d9f-b952-91d24ef77fe6/ovn-acl-logging/0.log" Jun 09 12:42:42.230800 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.230769 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56"] Jun 09 12:42:42.232961 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.232945 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" Jun 09 12:42:42.235489 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.235462 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 12:42:42.235600 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.235509 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 12:42:42.240227 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.240208 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:42:42.240321 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.240253 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9zch8\"" Jun 09 12:42:42.240413 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.240350 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:42:42.251730 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.251705 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56"] Jun 09 12:42:42.329820 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.329780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b50c885-2410-4615-9aac-157c21795353-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cwv56\" (UID: \"6b50c885-2410-4615-9aac-157c21795353\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" Jun 09 12:42:42.330129 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.330108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv95x\" (UniqueName: \"kubernetes.io/projected/6b50c885-2410-4615-9aac-157c21795353-kube-api-access-dv95x\") pod \"kuadrant-console-plugin-66b5774985-cwv56\" (UID: \"6b50c885-2410-4615-9aac-157c21795353\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" Jun 09 12:42:42.330382 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.330346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b50c885-2410-4615-9aac-157c21795353-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cwv56\" (UID: \"6b50c885-2410-4615-9aac-157c21795353\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" Jun 09 12:42:42.431774 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.431745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b50c885-2410-4615-9aac-157c21795353-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cwv56\" (UID: \"6b50c885-2410-4615-9aac-157c21795353\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" Jun 09 12:42:42.431935 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.431783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b50c885-2410-4615-9aac-157c21795353-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cwv56\" (UID: \"6b50c885-2410-4615-9aac-157c21795353\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" Jun 09 12:42:42.431935 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.431811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv95x\" (UniqueName: \"kubernetes.io/projected/6b50c885-2410-4615-9aac-157c21795353-kube-api-access-dv95x\") pod \"kuadrant-console-plugin-66b5774985-cwv56\" (UID: \"6b50c885-2410-4615-9aac-157c21795353\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" Jun 09 12:42:42.432405 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.432381 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b50c885-2410-4615-9aac-157c21795353-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cwv56\" (UID: \"6b50c885-2410-4615-9aac-157c21795353\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" Jun 09 12:42:42.434251 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.434231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b50c885-2410-4615-9aac-157c21795353-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cwv56\" (UID: \"6b50c885-2410-4615-9aac-157c21795353\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" Jun 09 12:42:42.443857 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.443833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv95x\" (UniqueName: \"kubernetes.io/projected/6b50c885-2410-4615-9aac-157c21795353-kube-api-access-dv95x\") pod \"kuadrant-console-plugin-66b5774985-cwv56\" (UID: \"6b50c885-2410-4615-9aac-157c21795353\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" Jun 09 12:42:42.544807 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.544725 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9zch8\"" Jun 09 12:42:42.552401 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.552377 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" Jun 09 12:42:42.689595 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.689565 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56"] Jun 09 12:42:42.692529 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:42:42.692492 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b50c885_2410_4615_9aac_157c21795353.slice/crio-f1a9c0a0b03b04d49b3aca90b21d7f696d624f538618146953fcff9388de12a2 WatchSource:0}: Error finding container f1a9c0a0b03b04d49b3aca90b21d7f696d624f538618146953fcff9388de12a2: Status 404 returned error can't find the container with id f1a9c0a0b03b04d49b3aca90b21d7f696d624f538618146953fcff9388de12a2 Jun 09 12:42:42.934420 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:42:42.934391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" event={"ID":"6b50c885-2410-4615-9aac-157c21795353","Type":"ContainerStarted","Data":"f1a9c0a0b03b04d49b3aca90b21d7f696d624f538618146953fcff9388de12a2"} Jun 09 12:43:06.033830 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:06.033786 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" event={"ID":"6b50c885-2410-4615-9aac-157c21795353","Type":"ContainerStarted","Data":"ac17f6daac2020ce2baa28741cc8a9cc986d3c39af15b1217c26ca355d6ec74d"} Jun 09 12:43:06.061726 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:06.061676 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cwv56" podStartSLOduration=1.264241329 podStartE2EDuration="24.061660924s" totalImagesPullingTime="22.797419595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:43:06.060499709 +0000 UTC m=+683.902530797" watchObservedRunningTime="2026-06-09 12:43:06.061660924 +0000 UTC m=+683.903691987" Jun 09 12:43:25.466819 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:25.466784 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zghfv"] Jun 09 12:43:26.047684 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:26.047643 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zghfv"] Jun 09 12:43:26.047684 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:26.047693 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zghfv"] Jun 09 12:43:26.047935 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:26.047777 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" Jun 09 12:43:26.050634 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:26.050610 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 12:43:26.116038 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:26.116003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5bb32d57-bf8b-4271-aba7-0da847d1183d-config-file\") pod \"limitador-limitador-64c94fd64f-zghfv\" (UID: \"5bb32d57-bf8b-4271-aba7-0da847d1183d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" Jun 09 12:43:26.116220 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:26.116102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn6hw\" (UniqueName: \"kubernetes.io/projected/5bb32d57-bf8b-4271-aba7-0da847d1183d-kube-api-access-kn6hw\") pod \"limitador-limitador-64c94fd64f-zghfv\" (UID: \"5bb32d57-bf8b-4271-aba7-0da847d1183d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" Jun 09 12:43:26.217027 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:26.216992 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5bb32d57-bf8b-4271-aba7-0da847d1183d-config-file\") pod \"limitador-limitador-64c94fd64f-zghfv\" (UID: \"5bb32d57-bf8b-4271-aba7-0da847d1183d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" Jun 09 12:43:26.217203 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:26.217037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn6hw\" (UniqueName: \"kubernetes.io/projected/5bb32d57-bf8b-4271-aba7-0da847d1183d-kube-api-access-kn6hw\") pod \"limitador-limitador-64c94fd64f-zghfv\" (UID: \"5bb32d57-bf8b-4271-aba7-0da847d1183d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" Jun 09 12:43:26.217672 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:26.217651 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5bb32d57-bf8b-4271-aba7-0da847d1183d-config-file\") pod \"limitador-limitador-64c94fd64f-zghfv\" (UID: \"5bb32d57-bf8b-4271-aba7-0da847d1183d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" Jun 09 12:43:26.226959 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:26.226934 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn6hw\" (UniqueName: \"kubernetes.io/projected/5bb32d57-bf8b-4271-aba7-0da847d1183d-kube-api-access-kn6hw\") pod \"limitador-limitador-64c94fd64f-zghfv\" (UID: \"5bb32d57-bf8b-4271-aba7-0da847d1183d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" Jun 09 12:43:26.358278 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:26.358201 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" Jun 09 12:43:26.674266 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:26.674239 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zghfv"] Jun 09 12:43:26.676810 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:43:26.676781 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb32d57_bf8b_4271_aba7_0da847d1183d.slice/crio-6ad36903c2da52deec53820a53910d949abea750d14a6cb39c8d5153df3cda1b WatchSource:0}: Error finding container 6ad36903c2da52deec53820a53910d949abea750d14a6cb39c8d5153df3cda1b: Status 404 returned error can't find the container with id 6ad36903c2da52deec53820a53910d949abea750d14a6cb39c8d5153df3cda1b Jun 09 12:43:27.122549 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:27.122520 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" event={"ID":"5bb32d57-bf8b-4271-aba7-0da847d1183d","Type":"ContainerStarted","Data":"6ad36903c2da52deec53820a53910d949abea750d14a6cb39c8d5153df3cda1b"} Jun 09 12:43:31.144629 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:31.144592 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" event={"ID":"5bb32d57-bf8b-4271-aba7-0da847d1183d","Type":"ContainerStarted","Data":"db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c"} Jun 09 12:43:31.145065 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:31.144693 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" Jun 09 12:43:31.175852 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:31.175806 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" podStartSLOduration=2.407828642 podStartE2EDuration="6.175793108s" totalImagesPullingTime="3.767964466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:43:31.175337496 +0000 UTC m=+709.017368561" watchObservedRunningTime="2026-06-09 12:43:31.175793108 +0000 UTC m=+709.017824215" Jun 09 12:43:42.150891 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:42.150816 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" Jun 09 12:43:42.785114 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:42.785082 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zghfv"] Jun 09 12:43:42.785275 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:42.785241 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" podUID="5bb32d57-bf8b-4271-aba7-0da847d1183d" containerName="limitador" containerID="cri-o://db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c" gracePeriod=30 Jun 09 12:43:43.330803 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:43.330780 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" Jun 09 12:43:43.467983 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:43.467951 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn6hw\" (UniqueName: \"kubernetes.io/projected/5bb32d57-bf8b-4271-aba7-0da847d1183d-kube-api-access-kn6hw\") pod \"5bb32d57-bf8b-4271-aba7-0da847d1183d\" (UID: \"5bb32d57-bf8b-4271-aba7-0da847d1183d\") " Jun 09 12:43:43.468148 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:43.468001 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5bb32d57-bf8b-4271-aba7-0da847d1183d-config-file\") pod \"5bb32d57-bf8b-4271-aba7-0da847d1183d\" (UID: \"5bb32d57-bf8b-4271-aba7-0da847d1183d\") " Jun 09 12:43:43.468397 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:43.468347 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bb32d57-bf8b-4271-aba7-0da847d1183d-config-file" (OuterVolumeSpecName: "config-file") pod "5bb32d57-bf8b-4271-aba7-0da847d1183d" (UID: "5bb32d57-bf8b-4271-aba7-0da847d1183d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:43:43.470247 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:43.470221 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bb32d57-bf8b-4271-aba7-0da847d1183d-kube-api-access-kn6hw" (OuterVolumeSpecName: "kube-api-access-kn6hw") pod "5bb32d57-bf8b-4271-aba7-0da847d1183d" (UID: "5bb32d57-bf8b-4271-aba7-0da847d1183d"). InnerVolumeSpecName "kube-api-access-kn6hw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:43:43.568615 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:43.568581 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn6hw\" (UniqueName: \"kubernetes.io/projected/5bb32d57-bf8b-4271-aba7-0da847d1183d-kube-api-access-kn6hw\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:43:43.568615 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:43.568609 2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5bb32d57-bf8b-4271-aba7-0da847d1183d-config-file\") on node \"ip-10-0-141-52.ec2.internal\" DevicePath \"\"" Jun 09 12:43:44.200017 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:44.199980 2577 generic.go:356] "Generic (PLEG): container finished" podID="5bb32d57-bf8b-4271-aba7-0da847d1183d" containerID="db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c" exitCode=0 Jun 09 12:43:44.200198 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:44.200025 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" Jun 09 12:43:44.200198 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:44.200067 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" event={"ID":"5bb32d57-bf8b-4271-aba7-0da847d1183d","Type":"ContainerDied","Data":"db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c"} Jun 09 12:43:44.200198 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:44.200117 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zghfv" event={"ID":"5bb32d57-bf8b-4271-aba7-0da847d1183d","Type":"ContainerDied","Data":"6ad36903c2da52deec53820a53910d949abea750d14a6cb39c8d5153df3cda1b"} Jun 09 12:43:44.200198 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:44.200139 2577 scope.go:117] "RemoveContainer" containerID="db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c" Jun 09 12:43:44.213438 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:44.213418 2577 scope.go:117] "RemoveContainer" containerID="db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c" Jun 09 12:43:44.213712 ip-10-0-141-52 kubenswrapper[2577]: E0609 12:43:44.213692 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c\": container with ID starting with db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c not found: ID does not exist" containerID="db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c" Jun 09 12:43:44.213787 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:44.213719 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c"} err="failed to get container status \"db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c\": rpc error: code = NotFound desc = could not find container \"db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c\": container with ID starting with db8f438d17eecb87da45619863b7e3de169d72b3d68fb3f978711867a974a07c not found: ID does not exist" Jun 09 12:43:44.227190 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:44.227169 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zghfv"] Jun 09 12:43:44.235854 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:44.235833 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zghfv"] Jun 09 12:43:44.609054 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:44.608980 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bb32d57-bf8b-4271-aba7-0da847d1183d" path="/var/lib/kubelet/pods/5bb32d57-bf8b-4271-aba7-0da847d1183d/volumes" Jun 09 12:43:46.541494 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.541460 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-jfr7c"] Jun 09 12:43:46.541985 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.541967 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bb32d57-bf8b-4271-aba7-0da847d1183d" containerName="limitador" Jun 09 12:43:46.542031 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.541988 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bb32d57-bf8b-4271-aba7-0da847d1183d" containerName="limitador" Jun 09 12:43:46.542090 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.542079 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bb32d57-bf8b-4271-aba7-0da847d1183d" containerName="limitador" Jun 09 12:43:46.546091 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.546069 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-jfr7c" Jun 09 12:43:46.548976 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.548956 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 09 12:43:46.549087 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.548992 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rbmrz\"" Jun 09 12:43:46.553641 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.553618 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-jfr7c"] Jun 09 12:43:46.591646 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.591615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/67973d01-9967-4ada-83b1-b886cb03fe1b-data\") pod \"postgres-69fb4594cf-jfr7c\" (UID: \"67973d01-9967-4ada-83b1-b886cb03fe1b\") " pod="opendatahub/postgres-69fb4594cf-jfr7c" Jun 09 12:43:46.591806 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.591707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wj58\" (UniqueName: \"kubernetes.io/projected/67973d01-9967-4ada-83b1-b886cb03fe1b-kube-api-access-6wj58\") pod \"postgres-69fb4594cf-jfr7c\" (UID: \"67973d01-9967-4ada-83b1-b886cb03fe1b\") " pod="opendatahub/postgres-69fb4594cf-jfr7c" Jun 09 12:43:46.692503 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.692458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wj58\" (UniqueName: \"kubernetes.io/projected/67973d01-9967-4ada-83b1-b886cb03fe1b-kube-api-access-6wj58\") pod \"postgres-69fb4594cf-jfr7c\" (UID: \"67973d01-9967-4ada-83b1-b886cb03fe1b\") " pod="opendatahub/postgres-69fb4594cf-jfr7c" Jun 09 12:43:46.692693 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.692550 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/67973d01-9967-4ada-83b1-b886cb03fe1b-data\") pod \"postgres-69fb4594cf-jfr7c\" (UID: \"67973d01-9967-4ada-83b1-b886cb03fe1b\") " pod="opendatahub/postgres-69fb4594cf-jfr7c" Jun 09 12:43:46.692925 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.692903 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/67973d01-9967-4ada-83b1-b886cb03fe1b-data\") pod \"postgres-69fb4594cf-jfr7c\" (UID: \"67973d01-9967-4ada-83b1-b886cb03fe1b\") " pod="opendatahub/postgres-69fb4594cf-jfr7c" Jun 09 12:43:46.701115 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.701078 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wj58\" (UniqueName: \"kubernetes.io/projected/67973d01-9967-4ada-83b1-b886cb03fe1b-kube-api-access-6wj58\") pod \"postgres-69fb4594cf-jfr7c\" (UID: \"67973d01-9967-4ada-83b1-b886cb03fe1b\") " pod="opendatahub/postgres-69fb4594cf-jfr7c" Jun 09 12:43:46.857273 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.857186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-jfr7c" Jun 09 12:43:46.985905 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:46.985796 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-jfr7c"] Jun 09 12:43:46.988613 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:43:46.988589 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67973d01_9967_4ada_83b1_b886cb03fe1b.slice/crio-a2b32ed59906e729942ba32aa25a2d9e8169ef194c8688bdfdf1204f039cf792 WatchSource:0}: Error finding container a2b32ed59906e729942ba32aa25a2d9e8169ef194c8688bdfdf1204f039cf792: Status 404 returned error can't find the container with id a2b32ed59906e729942ba32aa25a2d9e8169ef194c8688bdfdf1204f039cf792 Jun 09 12:43:47.213709 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:47.213678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-jfr7c" event={"ID":"67973d01-9967-4ada-83b1-b886cb03fe1b","Type":"ContainerStarted","Data":"a2b32ed59906e729942ba32aa25a2d9e8169ef194c8688bdfdf1204f039cf792"} Jun 09 12:43:51.232938 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:51.232900 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-jfr7c" event={"ID":"67973d01-9967-4ada-83b1-b886cb03fe1b","Type":"ContainerStarted","Data":"1f8aa6bafa1035b7bd798febb96945ac598a3a43acdae018de867e9439e085d0"} Jun 09 12:43:51.233316 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:51.232961 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-jfr7c" Jun 09 12:43:51.252128 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:51.252081 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-jfr7c" podStartSLOduration=2.028108267 podStartE2EDuration="5.252065651s" totalImagesPullingTime="3.223957384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:43:51.250697249 +0000 UTC m=+729.092728331" watchObservedRunningTime="2026-06-09 12:43:51.252065651 +0000 UTC m=+729.094096752" Jun 09 12:43:57.276867 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:43:57.276841 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-jfr7c" Jun 09 12:44:07.563574 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:07.563541 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-n858h"] Jun 09 12:44:07.566590 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:07.566575 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-n858h" Jun 09 12:44:07.571399 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:07.571381 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 12:44:07.572399 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:07.572382 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-wcnt8\"" Jun 09 12:44:07.572474 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:07.572399 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 12:44:07.589015 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:07.588990 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-n858h"] Jun 09 12:44:07.674748 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:07.674707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27m62\" (UniqueName: \"kubernetes.io/projected/c3dfcb44-c9d7-40b0-898f-c9b1a0dbb3d6-kube-api-access-27m62\") pod \"keycloak-operator-d67dbbb48-n858h\" (UID: \"c3dfcb44-c9d7-40b0-898f-c9b1a0dbb3d6\") " pod="keycloak-system/keycloak-operator-d67dbbb48-n858h" Jun 09 12:44:07.775866 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:07.775827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27m62\" (UniqueName: \"kubernetes.io/projected/c3dfcb44-c9d7-40b0-898f-c9b1a0dbb3d6-kube-api-access-27m62\") pod \"keycloak-operator-d67dbbb48-n858h\" (UID: \"c3dfcb44-c9d7-40b0-898f-c9b1a0dbb3d6\") " pod="keycloak-system/keycloak-operator-d67dbbb48-n858h" Jun 09 12:44:07.786217 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:07.786194 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27m62\" (UniqueName: \"kubernetes.io/projected/c3dfcb44-c9d7-40b0-898f-c9b1a0dbb3d6-kube-api-access-27m62\") pod \"keycloak-operator-d67dbbb48-n858h\" (UID: \"c3dfcb44-c9d7-40b0-898f-c9b1a0dbb3d6\") " pod="keycloak-system/keycloak-operator-d67dbbb48-n858h" Jun 09 12:44:07.876997 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:07.876917 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-n858h" Jun 09 12:44:08.012525 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:08.012491 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-n858h"] Jun 09 12:44:08.015448 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:44:08.015422 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3dfcb44_c9d7_40b0_898f_c9b1a0dbb3d6.slice/crio-850e34089be538732e4d60c8cc80e83497108f32ad59a369c2682271e05e0215 WatchSource:0}: Error finding container 850e34089be538732e4d60c8cc80e83497108f32ad59a369c2682271e05e0215: Status 404 returned error can't find the container with id 850e34089be538732e4d60c8cc80e83497108f32ad59a369c2682271e05e0215 Jun 09 12:44:08.308915 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:08.308883 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-n858h" event={"ID":"c3dfcb44-c9d7-40b0-898f-c9b1a0dbb3d6","Type":"ContainerStarted","Data":"850e34089be538732e4d60c8cc80e83497108f32ad59a369c2682271e05e0215"} Jun 09 12:44:14.340912 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:14.340815 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-n858h" event={"ID":"c3dfcb44-c9d7-40b0-898f-c9b1a0dbb3d6","Type":"ContainerStarted","Data":"475b25f0c3f7479872e9d40d49142e5e8d66487067a6caa5ee1e132513cff695"} Jun 09 12:44:14.363741 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:44:14.363695 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-n858h" podStartSLOduration=1.326318371 podStartE2EDuration="7.363679201s" totalImagesPullingTime="6.03736083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:44:14.362522619 +0000 UTC m=+752.204553683" watchObservedRunningTime="2026-06-09 12:44:14.363679201 +0000 UTC m=+752.205710266" Jun 09 12:46:42.598134 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:46:42.598055 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbzkh_8114e26e-e0ed-4d9f-b952-91d24ef77fe6/ovn-acl-logging/0.log" Jun 09 12:46:42.600510 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:46:42.600481 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbzkh_8114e26e-e0ed-4d9f-b952-91d24ef77fe6/ovn-acl-logging/0.log" Jun 09 12:47:11.866348 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.866311 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh"] Jun 09 12:47:11.870702 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.870671 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:11.886439 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.886411 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 12:47:11.886569 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.886460 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 09 12:47:11.886569 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.886477 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 12:47:11.886569 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.886539 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ghvsf\"" Jun 09 12:47:11.935141 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.935106 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh"] Jun 09 12:47:11.939422 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.939397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3598617-99de-40f5-8617-2dfdb581928a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:11.939543 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.939445 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3598617-99de-40f5-8617-2dfdb581928a-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:11.939605 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.939534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3598617-99de-40f5-8617-2dfdb581928a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:11.939666 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.939611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e3598617-99de-40f5-8617-2dfdb581928a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:11.939666 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.939644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3598617-99de-40f5-8617-2dfdb581928a-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:11.939743 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:11.939688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vghqc\" (UniqueName: \"kubernetes.io/projected/e3598617-99de-40f5-8617-2dfdb581928a-kube-api-access-vghqc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.040599 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.040562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3598617-99de-40f5-8617-2dfdb581928a-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.040771 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.040609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3598617-99de-40f5-8617-2dfdb581928a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.040771 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.040641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e3598617-99de-40f5-8617-2dfdb581928a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.040771 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.040662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3598617-99de-40f5-8617-2dfdb581928a-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.040771 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.040683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghqc\" (UniqueName: \"kubernetes.io/projected/e3598617-99de-40f5-8617-2dfdb581928a-kube-api-access-vghqc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.040771 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.040712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3598617-99de-40f5-8617-2dfdb581928a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.041032 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.040995 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3598617-99de-40f5-8617-2dfdb581928a-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.041032 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.041011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3598617-99de-40f5-8617-2dfdb581928a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.041108 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.041066 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e3598617-99de-40f5-8617-2dfdb581928a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.042884 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.042857 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3598617-99de-40f5-8617-2dfdb581928a-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.043146 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.043128 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3598617-99de-40f5-8617-2dfdb581928a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.052121 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.052101 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vghqc\" (UniqueName: \"kubernetes.io/projected/e3598617-99de-40f5-8617-2dfdb581928a-kube-api-access-vghqc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh\" (UID: \"e3598617-99de-40f5-8617-2dfdb581928a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.180447 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.180412 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:47:12.350791 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.350766 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh"] Jun 09 12:47:12.352641 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:47:12.352604 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3598617_99de_40f5_8617_2dfdb581928a.slice/crio-2479423a09633b40d8a0bc5661ee3e0805e66ea31ceaa9fa73d082ca7b097e2e WatchSource:0}: Error finding container 2479423a09633b40d8a0bc5661ee3e0805e66ea31ceaa9fa73d082ca7b097e2e: Status 404 returned error can't find the container with id 2479423a09633b40d8a0bc5661ee3e0805e66ea31ceaa9fa73d082ca7b097e2e Jun 09 12:47:12.354565 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:12.354551 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:47:13.068267 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:13.068235 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" event={"ID":"e3598617-99de-40f5-8617-2dfdb581928a","Type":"ContainerStarted","Data":"2479423a09633b40d8a0bc5661ee3e0805e66ea31ceaa9fa73d082ca7b097e2e"} Jun 09 12:47:16.090669 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:47:16.090578 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" event={"ID":"e3598617-99de-40f5-8617-2dfdb581928a","Type":"ContainerStarted","Data":"263980f4af5647ee97939635651907a2775b0dd16f95a64edbdb8013231046de"} Jun 09 12:48:03.297348 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.297271 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np"] Jun 09 12:48:03.299525 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.299506 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.320410 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.320386 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 09 12:48:03.347661 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.347637 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np"] Jun 09 12:48:03.394292 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.394262 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.394440 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.394300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p98fm\" (UniqueName: \"kubernetes.io/projected/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-kube-api-access-p98fm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.394440 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.394332 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.394440 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.394401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.394560 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.394457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.394560 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.394475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.495221 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.495184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.495428 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.495226 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p98fm\" (UniqueName: \"kubernetes.io/projected/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-kube-api-access-p98fm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.495428 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.495260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.495428 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.495278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.495428 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.495308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.495428 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.495323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.501732 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.496104 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.501732 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.496132 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.501732 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.496189 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.501732 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.499231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.503450 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.503431 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.534709 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.534683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p98fm\" (UniqueName: \"kubernetes.io/projected/8a7a87e4-ea7a-4f0f-8146-af31eaf86b18-kube-api-access-p98fm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-fd2np\" (UID: \"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.608427 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.608314 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:03.780649 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:03.780613 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np"] Jun 09 12:48:03.783534 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:48:03.783505 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7a87e4_ea7a_4f0f_8146_af31eaf86b18.slice/crio-3ccbc16f42db2ae8fbfe411b38ca25b7c02e776fb03620e109825359542dc71c WatchSource:0}: Error finding container 3ccbc16f42db2ae8fbfe411b38ca25b7c02e776fb03620e109825359542dc71c: Status 404 returned error can't find the container with id 3ccbc16f42db2ae8fbfe411b38ca25b7c02e776fb03620e109825359542dc71c Jun 09 12:48:04.286295 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:04.286256 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" event={"ID":"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18","Type":"ContainerStarted","Data":"2a9727a9e80763fc2acc67cc14cd6805c4a6b9ee8efcfb098889ca840a487dc1"} Jun 09 12:48:04.286479 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:04.286308 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" event={"ID":"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18","Type":"ContainerStarted","Data":"3ccbc16f42db2ae8fbfe411b38ca25b7c02e776fb03620e109825359542dc71c"} Jun 09 12:48:05.291207 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:05.291175 2577 generic.go:356] "Generic (PLEG): container finished" podID="8a7a87e4-ea7a-4f0f-8146-af31eaf86b18" containerID="2a9727a9e80763fc2acc67cc14cd6805c4a6b9ee8efcfb098889ca840a487dc1" exitCode=0 Jun 09 12:48:05.291632 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:05.291258 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" event={"ID":"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18","Type":"ContainerDied","Data":"2a9727a9e80763fc2acc67cc14cd6805c4a6b9ee8efcfb098889ca840a487dc1"} Jun 09 12:48:08.306037 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:08.306001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" event={"ID":"8a7a87e4-ea7a-4f0f-8146-af31eaf86b18","Type":"ContainerStarted","Data":"2a3f3e2aa324c3888c7137d07776c4ae218504c691953ceaa95c3db69f809d24"} Jun 09 12:48:08.345874 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:08.345827 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" podStartSLOduration=1.920384393 podStartE2EDuration="5.345812763s" totalImagesPullingTime="2.168952138s" totalInitContainerRuntime="1.256476232s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:48:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:48:08.344666622 +0000 UTC m=+986.186697685" watchObservedRunningTime="2026-06-09 12:48:08.345812763 +0000 UTC m=+986.187843837" Jun 09 12:48:10.315617 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:10.315585 2577 generic.go:356] "Generic (PLEG): container finished" podID="e3598617-99de-40f5-8617-2dfdb581928a" containerID="263980f4af5647ee97939635651907a2775b0dd16f95a64edbdb8013231046de" exitCode=0 Jun 09 12:48:10.315992 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:10.315661 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" event={"ID":"e3598617-99de-40f5-8617-2dfdb581928a","Type":"ContainerDied","Data":"263980f4af5647ee97939635651907a2775b0dd16f95a64edbdb8013231046de"} Jun 09 12:48:12.325114 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:12.325083 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" event={"ID":"e3598617-99de-40f5-8617-2dfdb581928a","Type":"ContainerStarted","Data":"aa1e8ac7002a629e13f51e76ca32eaf0932f434ccff8bbf1491a6a99c55f9b74"} Jun 09 12:48:13.608816 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:13.608783 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:13.608816 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:13.608823 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:13.621399 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:13.621352 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:13.660974 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:13.660913 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" podStartSLOduration=4.544235502 podStartE2EDuration="1m2.660894908s" totalImagesPullingTime="4.414899395s" totalInitContainerRuntime="53.701760011s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:47:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:48:12.366818448 +0000 UTC m=+990.208849512" watchObservedRunningTime="2026-06-09 12:48:13.660894908 +0000 UTC m=+991.502925973" Jun 09 12:48:14.344619 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:14.344585 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-fd2np" Jun 09 12:48:22.181456 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:22.181410 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:48:22.181872 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:22.181473 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:48:22.193520 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:22.193500 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:48:22.378241 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:48:22.378214 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh" Jun 09 12:51:42.625545 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:42.625519 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbzkh_8114e26e-e0ed-4d9f-b952-91d24ef77fe6/ovn-acl-logging/0.log" Jun 09 12:51:42.627218 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:42.627196 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbzkh_8114e26e-e0ed-4d9f-b952-91d24ef77fe6/ovn-acl-logging/0.log" Jun 09 12:51:45.970194 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:45.970160 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4c856db4-8mw7r_ccd920d1-b253-4521-8646-a88a321dacc4/copy-manifests/0.log" Jun 09 12:51:45.982937 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:45.982886 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4c856db4-8mw7r_ccd920d1-b253-4521-8646-a88a321dacc4/manager/0.log" Jun 09 12:51:46.257169 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:46.257083 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-jfr7c_67973d01-9967-4ada-83b1-b886cb03fe1b/postgres/0.log" Jun 09 12:51:48.043200 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:48.043172 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cwv56_6b50c885-2410-4615-9aac-157c21795353/kuadrant-console-plugin/0.log" Jun 09 12:51:49.255624 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:49.255592 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79dfc5c477-sbpmq_0642592f-37d0-473b-88d7-2b1190e34319/kube-auth-proxy/0.log" Jun 09 12:51:50.343729 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:50.343704 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh_e3598617-99de-40f5-8617-2dfdb581928a/storage-initializer/0.log" Jun 09 12:51:50.352474 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:50.352452 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-vc9sh_e3598617-99de-40f5-8617-2dfdb581928a/main/0.log" Jun 09 12:51:50.731119 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:50.731090 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-fd2np_8a7a87e4-ea7a-4f0f-8146-af31eaf86b18/storage-initializer/0.log" Jun 09 12:51:50.742203 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:50.742165 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-fd2np_8a7a87e4-ea7a-4f0f-8146-af31eaf86b18/main/0.log" Jun 09 12:51:58.626724 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:58.626693 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l4lmg_ae3ae62f-afb3-4025-ab11-5a27262a37b9/global-pull-secret-syncer/0.log" Jun 09 12:51:58.758431 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:58.758353 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cjwvz_7bb52492-ccd4-4eae-b38a-cc4a6df5c20c/konnectivity-agent/0.log" Jun 09 12:51:58.862018 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:51:58.861992 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-52.ec2.internal_890bf00dd14a920e517744df78149aac/haproxy/0.log" Jun 09 12:52:03.520944 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:03.520917 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cwv56_6b50c885-2410-4615-9aac-157c21795353/kuadrant-console-plugin/0.log" Jun 09 12:52:05.816926 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:05.816841 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79557d5bb8-tj4sb_7a1ef022-2398-40ce-86be-1bbb549f4d9f/metrics-server/0.log" Jun 09 12:52:05.848202 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:05.848171 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-vppdw_aa08a173-646f-4046-afbf-9f5db2d7dba1/monitoring-plugin/0.log" Jun 09 12:52:05.882296 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:05.882267 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6nhwt_fe0b0928-9723-4f89-9aff-815cbb18fe23/node-exporter/0.log" Jun 09 12:52:05.908272 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:05.908243 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6nhwt_fe0b0928-9723-4f89-9aff-815cbb18fe23/kube-rbac-proxy/0.log" Jun 09 12:52:05.935335 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:05.935313 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6nhwt_fe0b0928-9723-4f89-9aff-815cbb18fe23/init-textfile/0.log" Jun 09 12:52:06.159478 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:06.159379 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wg65s_c7e96915-99b5-4deb-bd7d-2b180025348c/kube-rbac-proxy-main/0.log" Jun 09 12:52:06.184186 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:06.184159 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wg65s_c7e96915-99b5-4deb-bd7d-2b180025348c/kube-rbac-proxy-self/0.log" Jun 09 12:52:06.212492 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:06.212459 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wg65s_c7e96915-99b5-4deb-bd7d-2b180025348c/openshift-state-metrics/0.log" Jun 09 12:52:06.259698 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:06.259653 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58cd1d00-f894-45b9-84a3-ad8f36187a7c/prometheus/0.log" Jun 09 12:52:06.285052 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:06.285024 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58cd1d00-f894-45b9-84a3-ad8f36187a7c/config-reloader/0.log" Jun 09 12:52:06.310605 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:06.310579 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58cd1d00-f894-45b9-84a3-ad8f36187a7c/thanos-sidecar/0.log" Jun 09 12:52:06.337077 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:06.337047 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58cd1d00-f894-45b9-84a3-ad8f36187a7c/kube-rbac-proxy-web/0.log" Jun 09 12:52:06.374822 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:06.374794 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58cd1d00-f894-45b9-84a3-ad8f36187a7c/kube-rbac-proxy/0.log" Jun 09 12:52:06.398990 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:06.398962 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58cd1d00-f894-45b9-84a3-ad8f36187a7c/kube-rbac-proxy-thanos/0.log" Jun 09 12:52:06.424746 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:06.424726 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_58cd1d00-f894-45b9-84a3-ad8f36187a7c/init-config-reloader/0.log" Jun 09 12:52:08.831876 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.831837 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m"] Jun 09 12:52:08.835378 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.835344 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.838262 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.838235 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m2w5j\"/\"kube-root-ca.crt\"" Jun 09 12:52:08.838375 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.838296 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m2w5j\"/\"openshift-service-ca.crt\"" Jun 09 12:52:08.839471 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.839451 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m2w5j\"/\"default-dockercfg-pv9dm\"" Jun 09 12:52:08.844796 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.844773 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m"] Jun 09 12:52:08.884354 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.884325 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/def91f78-e75d-42ba-932c-eb5800940729-lib-modules\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.884500 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.884382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l2bj\" (UniqueName: \"kubernetes.io/projected/def91f78-e75d-42ba-932c-eb5800940729-kube-api-access-5l2bj\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.884500 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.884468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/def91f78-e75d-42ba-932c-eb5800940729-podres\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.884576 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.884513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/def91f78-e75d-42ba-932c-eb5800940729-proc\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.884576 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.884550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def91f78-e75d-42ba-932c-eb5800940729-sys\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.985855 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.985818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/def91f78-e75d-42ba-932c-eb5800940729-podres\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.986016 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.985991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/def91f78-e75d-42ba-932c-eb5800940729-proc\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.986016 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.985994 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/def91f78-e75d-42ba-932c-eb5800940729-podres\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.986090 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.986053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def91f78-e75d-42ba-932c-eb5800940729-sys\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.986090 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.986064 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/def91f78-e75d-42ba-932c-eb5800940729-proc\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.986090 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.986085 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/def91f78-e75d-42ba-932c-eb5800940729-lib-modules\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.986182 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.986105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l2bj\" (UniqueName: \"kubernetes.io/projected/def91f78-e75d-42ba-932c-eb5800940729-kube-api-access-5l2bj\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.986182 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.986121 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/def91f78-e75d-42ba-932c-eb5800940729-sys\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.986246 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.986206 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/def91f78-e75d-42ba-932c-eb5800940729-lib-modules\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:08.995231 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:08.995212 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l2bj\" (UniqueName: \"kubernetes.io/projected/def91f78-e75d-42ba-932c-eb5800940729-kube-api-access-5l2bj\") pod \"perf-node-gather-daemonset-vc78m\" (UID: \"def91f78-e75d-42ba-932c-eb5800940729\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:09.146381 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:09.146276 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:09.276618 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:09.276499 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m"] Jun 09 12:52:09.279132 ip-10-0-141-52 kubenswrapper[2577]: W0609 12:52:09.279100 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddef91f78_e75d_42ba_932c_eb5800940729.slice/crio-4d87b9782f0f7b93ebde232c44d509e88046a4e00fe38b8f20ea005e5924f1f8 WatchSource:0}: Error finding container 4d87b9782f0f7b93ebde232c44d509e88046a4e00fe38b8f20ea005e5924f1f8: Status 404 returned error can't find the container with id 4d87b9782f0f7b93ebde232c44d509e88046a4e00fe38b8f20ea005e5924f1f8 Jun 09 12:52:09.341610 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:09.341585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" event={"ID":"def91f78-e75d-42ba-932c-eb5800940729","Type":"ContainerStarted","Data":"4d87b9782f0f7b93ebde232c44d509e88046a4e00fe38b8f20ea005e5924f1f8"} Jun 09 12:52:10.346915 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:10.346874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" event={"ID":"def91f78-e75d-42ba-932c-eb5800940729","Type":"ContainerStarted","Data":"6d843716da340401a5a981192e3bbf45f158f06d237a41a761541a2a25c77d40"} Jun 09 12:52:10.347399 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:10.346955 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:10.366750 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:10.366649 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" podStartSLOduration=2.366627663 podStartE2EDuration="2.366627663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:52:10.366140271 +0000 UTC m=+1228.208171364" watchObservedRunningTime="2026-06-09 12:52:10.366627663 +0000 UTC m=+1228.208658729" Jun 09 12:52:11.286686 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:11.286656 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pl5db_787ebe7b-fb40-4d91-9945-4c922c2ad486/dns/0.log" Jun 09 12:52:11.314251 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:11.314225 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pl5db_787ebe7b-fb40-4d91-9945-4c922c2ad486/kube-rbac-proxy/0.log" Jun 09 12:52:11.424505 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:11.424480 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7hnl_3a1ecc72-45f1-4e73-944f-91aab54f0209/dns-node-resolver/0.log" Jun 09 12:52:12.126803 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:12.126776 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tgr7c_686ef415-ee65-4648-8eff-2443ddb85bf8/node-ca/0.log" Jun 09 12:52:13.294905 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:13.294879 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79dfc5c477-sbpmq_0642592f-37d0-473b-88d7-2b1190e34319/kube-auth-proxy/0.log" Jun 09 12:52:14.116458 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:14.116430 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-shdsj_f2aab8e0-280c-4fac-b243-1b63e88d0b67/serve-healthcheck-canary/0.log" Jun 09 12:52:14.714608 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:14.714578 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6kczz_122ca31d-a569-42c4-bb20-f3cbc6a0eedc/kube-rbac-proxy/0.log" Jun 09 12:52:14.742100 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:14.742072 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6kczz_122ca31d-a569-42c4-bb20-f3cbc6a0eedc/exporter/0.log" Jun 09 12:52:14.768737 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:14.768706 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6kczz_122ca31d-a569-42c4-bb20-f3cbc6a0eedc/extractor/0.log" Jun 09 12:52:16.361149 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:16.361122 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-vc78m" Jun 09 12:52:17.891341 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:17.891310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4c856db4-8mw7r_ccd920d1-b253-4521-8646-a88a321dacc4/manager/0.log" Jun 09 12:52:17.921062 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:17.921039 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4c856db4-8mw7r_ccd920d1-b253-4521-8646-a88a321dacc4/copy-manifests/0.log" Jun 09 12:52:18.047102 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:18.047074 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-jfr7c_67973d01-9967-4ada-83b1-b886cb03fe1b/postgres/0.log" Jun 09 12:52:19.753172 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:19.753141 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b48576bd-xkjn9_fb39235f-bfdb-4ef2-8261-81d1cc578bcf/manager/0.log" Jun 09 12:52:22.749476 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:22.749451 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79dfc5c477-sbpmq_0642592f-37d0-473b-88d7-2b1190e34319/kube-auth-proxy/0.log" Jun 09 12:52:24.005140 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:24.005114 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79dfc5c477-sbpmq_0642592f-37d0-473b-88d7-2b1190e34319/kube-auth-proxy/0.log" Jun 09 12:52:25.861968 ip-10-0-141-52 kubenswrapper[2577]: I0609 12:52:25.861937 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79dfc5c477-sbpmq_0642592f-37d0-473b-88d7-2b1190e34319/kube-auth-proxy/0.log"