Jun 03 21:59:56.413385 ip-10-0-138-139 systemd[1]: Starting Kubernetes Kubelet... Jun 03 21:59:56.790441 ip-10-0-138-139 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:59:56.790441 ip-10-0-138-139 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 21:59:56.790441 ip-10-0-138-139 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:59:56.790441 ip-10-0-138-139 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 21:59:56.790441 ip-10-0-138-139 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:59:56.791121 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.790458 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 21:59:56.796412 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796395 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:59:56.796412 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796411 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796415 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796418 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796421 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796424 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796426 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796429 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796432 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796435 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796437 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796440 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796442 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796444 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796447 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796451 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796453 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796456 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796458 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796460 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796463 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:59:56.796485 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796465 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796468 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796470 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796474 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796476 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796479 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796482 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796484 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796487 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796490 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796492 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796495 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796498 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796500 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796503 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796506 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796508 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796510 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796513 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796515 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:59:56.796959 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796518 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796521 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796524 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796527 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796529 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796532 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796534 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796537 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796539 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796541 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796546 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796551 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796555 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796558 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796562 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796565 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796568 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796572 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:59:56.797452 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796575 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796578 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796581 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796584 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796587 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796590 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796592 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796594 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796597 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796599 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796602 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796604 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796607 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796609 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796612 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796614 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796618 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796621 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796623 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796626 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:59:56.797899 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796629 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796631 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796634 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796636 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796638 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796642 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796645 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796647 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796650 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796652 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796655 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796658 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796660 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796663 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796665 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796668 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796670 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796673 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.796675 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797381 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:59:56.798393 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797387 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797390 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797393 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797396 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797398 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797401 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797404 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797406 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797409 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797412 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797414 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797417 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797421 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797423 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797426 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797428 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797431 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797434 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797437 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797440 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:59:56.798852 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797442 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797445 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797447 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797450 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797452 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797455 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797457 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797460 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797463 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797465 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797468 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797470 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797473 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797475 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797479 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797483 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797485 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797488 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797490 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797493 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:59:56.799410 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797495 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797497 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797500 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797503 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797507 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797509 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797511 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797514 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797516 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797519 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797522 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797525 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797528 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797530 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797532 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797535 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797537 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797540 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797542 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797547 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:59:56.799888 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797549 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797552 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797554 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797557 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797559 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797562 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797564 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797568 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797570 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797573 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797575 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797578 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797581 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797583 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797585 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797592 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797594 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797597 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797599 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:59:56.800384 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797601 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797604 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797607 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797609 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797613 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797617 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797621 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797624 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797627 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797630 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797632 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797635 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797639 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797642 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797646 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797648 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797651 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.797654 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798040 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:59:56.800842 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798059 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798063 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798066 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798070 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798074 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798077 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798080 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798082 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798085 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798088 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798091 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798094 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798097 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798100 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798102 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798105 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798108 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798111 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798113 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:59:56.801390 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798116 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798118 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798121 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798124 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798126 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798128 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798131 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798133 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798136 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798139 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798141 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798143 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798146 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798148 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798151 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798154 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798156 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798159 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798161 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798164 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:59:56.801870 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798166 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798168 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798171 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798174 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798176 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798178 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798181 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798183 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798186 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798188 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798190 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798193 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798195 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798198 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798200 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798202 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798205 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798208 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798212 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:59:56.802392 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798215 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798217 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798221 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798224 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798226 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798229 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798231 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798234 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798237 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798239 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798242 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798244 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798246 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798249 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798252 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798255 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798258 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798264 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798267 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798269 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:59:56.802846 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798272 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798274 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798277 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798279 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798282 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798285 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798288 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798291 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798294 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798296 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798299 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798301 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798304 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798306 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798309 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798311 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798314 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798316 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798318 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798387 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798394 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 21:59:56.803350 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798400 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798405 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798409 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798412 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798416 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798421 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798425 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798427 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798431 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798440 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798444 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798447 2578 flags.go:64] FLAG: --cgroup-root="" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798449 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798452 2578 flags.go:64] FLAG: --client-ca-file="" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798455 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798458 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798465 2578 flags.go:64] FLAG: --cluster-domain="" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798468 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798471 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798474 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798477 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798481 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798483 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 21:59:56.803858 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798486 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798490 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798493 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798496 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798499 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798502 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798505 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798508 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798511 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798514 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798517 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798520 2578 flags.go:64] FLAG: --enable-server="true" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798522 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798526 2578 flags.go:64] FLAG: --event-burst="100" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798529 2578 flags.go:64] FLAG: --event-qps="50" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798532 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798535 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798538 2578 flags.go:64] FLAG: --eviction-hard="" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798542 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798545 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798548 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798551 2578 flags.go:64] FLAG: --eviction-soft="" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798554 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798557 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798560 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 21:59:56.804422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798563 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798565 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798568 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798571 2578 flags.go:64] FLAG: --feature-gates="" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798574 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798577 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798580 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798583 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798586 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798589 2578 flags.go:64] FLAG: --help="false" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798592 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-138-139.ec2.internal" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798595 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798598 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798600 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798604 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798607 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798609 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798612 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798615 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798617 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798620 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798627 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798629 2578 flags.go:64] FLAG: --kube-reserved="" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798632 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 21:59:56.805002 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798636 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798639 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798642 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798645 2578 flags.go:64] FLAG: --lock-file="" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798647 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798650 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798653 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798659 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798661 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798664 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798667 2578 flags.go:64] FLAG: --logging-format="text" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798669 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798673 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798675 2578 flags.go:64] FLAG: --manifest-url="" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798678 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798688 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798691 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798695 2578 flags.go:64] FLAG: --max-pods="110" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798698 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798701 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798703 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798706 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798709 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798712 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798715 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 21:59:56.805641 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798722 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798725 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798728 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798730 2578 flags.go:64] FLAG: --pod-cidr="" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798735 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798740 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798748 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798751 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798754 2578 flags.go:64] FLAG: --port="10250" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798757 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798759 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08cf4bd93bf1bf0d6" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798763 2578 flags.go:64] FLAG: --qos-reserved="" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798766 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798769 2578 flags.go:64] FLAG: --register-node="true" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798772 2578 flags.go:64] FLAG: --register-with-taints="" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798776 2578 flags.go:64] FLAG: --registry-burst="10" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798778 2578 flags.go:64] FLAG: --registry-qps="5" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798781 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798784 2578 flags.go:64] FLAG: --reserved-memory="" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798787 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798790 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798793 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798795 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798798 2578 flags.go:64] FLAG: --runonce="false" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798801 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 21:59:56.806262 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798804 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798807 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798809 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798812 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798815 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798817 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798820 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798823 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798826 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798828 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798831 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798834 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798838 2578 flags.go:64] FLAG: --system-cgroups="" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798842 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798847 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798850 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798852 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798857 2578 flags.go:64] FLAG: --tls-min-version="" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798861 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798864 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798867 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798870 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798873 2578 flags.go:64] FLAG: --v="2" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798877 2578 flags.go:64] FLAG: --version="false" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798881 2578 flags.go:64] FLAG: --vmodule="" Jun 03 21:59:56.806870 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798885 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.798888 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.798999 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799002 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799005 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799008 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799011 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799014 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799017 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799019 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799022 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799024 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799027 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799029 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799033 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799036 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799038 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799041 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799043 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799065 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:59:56.807522 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799071 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799076 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799080 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799083 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799085 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799088 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799091 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799094 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799097 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799100 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799102 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799105 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799107 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799110 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799112 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799115 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799117 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799120 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799122 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799125 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:59:56.808010 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799127 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799130 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799133 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799135 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799138 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799140 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799142 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799145 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799147 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799150 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799153 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799157 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799161 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799163 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799166 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799169 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799171 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799173 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799176 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799179 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:59:56.808619 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799181 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799184 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799187 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799189 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799192 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799194 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799197 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799199 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799201 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799204 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799206 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799209 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799211 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799213 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799218 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799221 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799224 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799226 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799229 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:59:56.809108 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799232 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799234 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799237 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799239 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799243 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799247 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799249 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799252 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799254 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799258 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799261 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799264 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799267 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799269 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799272 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799275 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799277 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799280 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799282 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:59:56.809564 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799285 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.799287 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.799927 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.806532 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.806636 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.806654 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.806660 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806735 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806740 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806744 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806747 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806750 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806752 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806755 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:59:56.810032 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806759 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806763 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806766 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806769 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806771 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806774 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806776 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806779 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806781 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806784 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806787 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806790 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806792 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806795 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806798 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806800 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806803 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806805 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806808 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806810 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:59:56.810394 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806813 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806815 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806818 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806821 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806824 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806826 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806829 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806831 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806834 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806836 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806839 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806842 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806845 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806847 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806850 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806852 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806855 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806857 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806859 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806862 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:59:56.810879 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806865 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806868 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806871 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806874 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806876 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806879 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806883 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806885 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806888 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806891 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806893 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806896 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806900 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806903 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806907 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806910 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806913 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806916 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806918 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:59:56.811376 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806921 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806923 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806926 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806928 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806932 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806935 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806937 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806940 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806942 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806945 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806947 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806950 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806952 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806954 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806957 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806959 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806962 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806964 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806966 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:59:56.811826 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806969 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806972 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806974 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806977 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806979 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806981 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806984 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806986 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806989 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806991 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806994 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806996 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.806999 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.807004 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807144 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:59:56.812301 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807149 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807151 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807154 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807157 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807160 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807162 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807165 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807168 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807170 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807173 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807176 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807179 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807181 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807185 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807189 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807191 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807194 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807196 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807199 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:59:56.812673 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807202 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807204 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807207 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807209 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807211 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807214 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807217 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807219 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807221 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807224 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807226 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807229 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807231 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807233 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807236 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807238 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807240 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807243 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807245 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807248 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:59:56.813210 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807250 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807252 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807255 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807257 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807260 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807262 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807264 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807267 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807269 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807271 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807274 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807276 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807279 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807281 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807284 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807286 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807289 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807291 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807294 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807296 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:59:56.813686 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807299 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807301 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807303 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807306 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807308 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807311 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807313 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807315 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807318 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807320 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807323 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807325 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807328 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807330 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807332 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807335 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807338 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807342 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807345 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:59:56.814225 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807348 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807351 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807354 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807357 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807359 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807361 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807364 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807367 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807369 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807372 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807375 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807377 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807380 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807382 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807385 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807387 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807389 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807392 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:59:56.814687 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:56.807394 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:59:56.815124 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.807399 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:59:56.815124 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.807498 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 21:59:56.815124 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.809348 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 21:59:56.815124 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.810553 2578 server.go:1019] "Starting client certificate rotation" Jun 03 21:59:56.815124 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.810663 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 21:59:56.815124 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.810697 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 21:59:56.815124 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.813242 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 21:59:56.827109 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.827086 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 21:59:56.840195 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.840178 2578 log.go:25] "Validated CRI v1 runtime API" Jun 03 21:59:56.842827 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.842806 2578 log.go:25] "Validated CRI v1 image API" Jun 03 21:59:56.843786 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.843769 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 21:59:56.847164 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.847144 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 83e8c800-2f69-4233-b897-42befd699c56:/dev/nvme0n1p3 978928aa-0221-4e91-aa72-ee48497e73bc:/dev/nvme0n1p4] Jun 03 21:59:56.847256 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.847162 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 21:59:56.849178 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.849160 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 21:59:56.852574 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.852460 2578 manager.go:216] Machine: {Timestamp:2026-06-03 21:59:56.850944526 +0000 UTC m=+0.325825643 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099704 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec299eaed0b8073a18efdac4bd922c1d SystemUUID:ec299eae-d0b8-073a-18ef-dac4bd922c1d BootID:e3896aeb-1c93-4ee4-9bd2-36b1971c0f8e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4a:81:a5:ac:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4a:81:a5:ac:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:4e:55:cf:3e:21 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 21:59:56.852574 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.852564 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 21:59:56.852703 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.852691 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 21:59:56.855422 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.855390 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 21:59:56.855570 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.855425 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 21:59:56.856041 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.856032 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 21:59:56.856089 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.856045 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 21:59:56.856089 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.856068 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 21:59:56.857376 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.857364 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 21:59:56.858108 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.858097 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 21:59:56.860668 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.860656 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 03 21:59:56.860796 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.860787 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 21:59:56.860831 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.860818 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 03 21:59:56.860831 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.860830 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 21:59:56.860885 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.860843 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 21:59:56.860885 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.860853 2578 kubelet.go:398] "Adding apiserver pod source" Jun 03 21:59:56.860885 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.860861 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 21:59:56.861253 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.861242 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 21:59:56.861291 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.861260 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 21:59:56.867708 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.867690 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 21:59:56.868941 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.868923 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 21:59:56.869022 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.868962 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 21:59:56.869529 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.869515 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 21:59:56.869588 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.869535 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 21:59:56.869588 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.869543 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 21:59:56.869588 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.869551 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 21:59:56.869588 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.869562 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 21:59:56.869588 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.869571 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 21:59:56.869952 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.869941 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 21:59:56.870006 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.869955 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 21:59:56.870006 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.869966 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 21:59:56.870006 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.869975 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 21:59:56.870006 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.870000 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 21:59:56.870151 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.870013 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 21:59:56.870729 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.870717 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 21:59:56.870776 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.870732 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 21:59:56.871805 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.871785 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tcqv6" Jun 03 21:59:56.873855 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.873840 2578 server.go:1268] "Started kubelet" Jun 03 21:59:56.873925 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.873901 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 21:59:56.874012 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.873925 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 21:59:56.874077 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.874062 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 21:59:56.874756 ip-10-0-138-139 systemd[1]: Started Kubernetes Kubelet. Jun 03 21:59:56.876183 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.876166 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 21:59:56.876335 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.876311 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 21:59:56.876512 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:56.876313 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 21:59:56.876685 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:56.876652 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 21:59:56.877948 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.877929 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 03 21:59:56.880481 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.880460 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tcqv6" Jun 03 21:59:56.881452 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:56.881431 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 21:59:56.883707 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:56.882804 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-139.ec2.internal.18b5b1243bb8ec41 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-139.ec2.internal,UID:ip-10-0-138-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-139.ec2.internal,},FirstTimestamp:2026-06-03 21:59:56.873813057 +0000 UTC m=+0.348694173,LastTimestamp:2026-06-03 21:59:56.873813057 +0000 UTC m=+0.348694173,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-139.ec2.internal,}" Jun 03 21:59:56.889312 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.889295 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 21:59:56.889396 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.889319 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 21:59:56.889448 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:56.889402 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found" Jun 03 21:59:56.889927 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.889909 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 21:59:56.889927 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.889928 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 21:59:56.890101 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.890085 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 21:59:56.890229 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.890211 2578 factory.go:55] Registering systemd factory Jun 03 21:59:56.890330 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.890289 2578 factory.go:223] Registration of the systemd container factory successfully Jun 03 21:59:56.890432 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.890300 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 03 21:59:56.890506 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.890497 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 03 21:59:56.890755 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.890740 2578 factory.go:153] Registering CRI-O factory Jun 03 21:59:56.890823 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.890759 2578 factory.go:223] Registration of the crio container factory successfully Jun 03 21:59:56.890823 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.890809 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 21:59:56.890916 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.890833 2578 factory.go:103] Registering Raw factory Jun 03 21:59:56.890916 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.890848 2578 manager.go:1196] Started watching for new ooms in manager Jun 03 21:59:56.891255 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.891242 2578 manager.go:349] Starting recovery of all containers Jun 03 21:59:56.894280 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.894257 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:59:56.898490 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:56.898465 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-139.ec2.internal\" not found" node="ip-10-0-138-139.ec2.internal" Jun 03 21:59:56.899835 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.899816 2578 manager.go:354] Recovery completed Jun 03 21:59:56.904360 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.904338 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:59:56.906286 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.906269 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:59:56.906360 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.906294 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:59:56.906360 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.906303 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:59:56.906984 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.906972 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 21:59:56.906984 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.906983 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 21:59:56.907079 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.906999 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 03 21:59:56.907334 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.907321 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:59:56.907964 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.907948 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:59:56.908063 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.907972 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:59:56.908063 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.907984 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:59:56.908156 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.908074 2578 policy_none.go:49] "None policy: Start" Jun 03 21:59:56.908156 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.908088 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 21:59:56.908156 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.908100 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 21:59:56.909135 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.909124 2578 policy_none.go:47] "Start" Jun 03 21:59:56.952325 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.952310 2578 manager.go:337] "Starting Device Plugin manager" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:56.952378 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.952392 2578 server.go:87] "Starting device plugin registration server" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.952661 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.952674 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.952759 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.952837 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.952848 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:56.953907 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:56.953960 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-139.ec2.internal\" not found" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.964886 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.966245 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.966287 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.966310 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 21:59:56.967625 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:56.966387 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 21:59:56.969497 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:56.969480 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:59:57.053678 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.053597 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:59:57.054626 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.054609 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:59:57.054723 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.054639 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:59:57.054723 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.054651 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:59:57.054723 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.054674 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.066696 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.066678 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.066785 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.066701 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-139.ec2.internal\": node \"ip-10-0-138-139.ec2.internal\" not found" Jun 03 21:59:57.066785 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.066771 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal"] Jun 03 21:59:57.066849 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.066837 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:59:57.067660 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.067646 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:59:57.067718 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.067673 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:59:57.067718 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.067684 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:59:57.069908 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.069895 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:59:57.070037 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.070020 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.070093 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.070078 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:59:57.070797 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.070780 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:59:57.070898 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.070808 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:59:57.070898 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.070858 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:59:57.070898 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.070870 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:59:57.071041 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.070905 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:59:57.071041 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.070920 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:59:57.072968 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.072952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.073065 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.072979 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:59:57.073725 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.073703 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:59:57.073787 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.073736 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:59:57.073787 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.073746 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:59:57.088064 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.088025 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found" Jun 03 21:59:57.092425 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.092398 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b812aca86e0ab34230683409af57a592-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal\" (UID: \"b812aca86e0ab34230683409af57a592\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.092525 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.092437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b812aca86e0ab34230683409af57a592-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal\" (UID: \"b812aca86e0ab34230683409af57a592\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.092525 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.092469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/55770dce513cfd126cc2cf19f107bfda-config\") pod \"kube-apiserver-proxy-ip-10-0-138-139.ec2.internal\" (UID: \"55770dce513cfd126cc2cf19f107bfda\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.104823 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.104801 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-139.ec2.internal\" not found" node="ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.109380 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.109363 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-139.ec2.internal\" not found" node="ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.188697 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.188668 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found" Jun 03 21:59:57.193458 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.193438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b812aca86e0ab34230683409af57a592-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal\" (UID: \"b812aca86e0ab34230683409af57a592\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.193520 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.193465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/55770dce513cfd126cc2cf19f107bfda-config\") pod \"kube-apiserver-proxy-ip-10-0-138-139.ec2.internal\" (UID: \"55770dce513cfd126cc2cf19f107bfda\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.193520 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.193481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b812aca86e0ab34230683409af57a592-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal\" (UID: \"b812aca86e0ab34230683409af57a592\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.193600 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.193525 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b812aca86e0ab34230683409af57a592-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal\" (UID: \"b812aca86e0ab34230683409af57a592\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.193600 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.193534 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b812aca86e0ab34230683409af57a592-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal\" (UID: \"b812aca86e0ab34230683409af57a592\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.193600 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.193549 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/55770dce513cfd126cc2cf19f107bfda-config\") pod \"kube-apiserver-proxy-ip-10-0-138-139.ec2.internal\" (UID: \"55770dce513cfd126cc2cf19f107bfda\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.288923 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.288880 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found" Jun 03 21:59:57.389636 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.389566 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found" Jun 03 21:59:57.408912 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.408895 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.415257 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.415234 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.490333 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.490280 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found" Jun 03 21:59:57.590666 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.590614 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found" Jun 03 21:59:57.691307 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.691216 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found" Jun 03 21:59:57.791530 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.791504 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found" Jun 03 21:59:57.809817 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.809796 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 21:59:57.809974 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.809955 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 21:59:57.810030 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.809974 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 21:59:57.849895 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.849869 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:59:57.861656 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.861622 2578 apiserver.go:52] "Watching apiserver" Jun 03 21:59:57.874952 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.874929 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 21:59:57.875785 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.875766 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-582tg","kube-system/konnectivity-agent-7qh9f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr","openshift-cluster-node-tuning-operator/tuned-q7sws","openshift-dns/node-resolver-w2kgw","openshift-multus/network-metrics-daemon-4wpm2","openshift-network-operator/iptables-alerter-vtnlf","openshift-image-registry/node-ca-tvm2z","openshift-multus/multus-additional-cni-plugins-n6qb8","openshift-multus/multus-pq28l","openshift-network-diagnostics/network-check-target-97gxk","openshift-ovn-kubernetes/ovnkube-node-46r9m"] Jun 03 21:59:57.877699 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.877677 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 21:59:57.877764 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.877748 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 21:59:57.879479 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.879459 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7qh9f" Jun 03 21:59:57.881018 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.880992 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:57.881878 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.881854 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 21:59:57.881968 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.881949 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kwhcj\"" Jun 03 21:59:57.882172 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.882155 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 21:59:57.883008 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.882988 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.883159 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.883140 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 21:59:57.883595 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.883540 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 21:59:57.883876 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.883860 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w78f8\"" Jun 03 21:59:57.884110 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.884072 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 21:59:57.884863 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.884846 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:59:57.884968 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.884952 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 21:59:57.885376 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.885360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w2kgw" Jun 03 21:59:57.885474 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.885445 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vjcxz\"" Jun 03 21:59:57.887022 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.887006 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 21:59:57.887171 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.887155 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 21:59:57.887291 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.887279 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h479m\"" Jun 03 21:59:57.887564 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.887537 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 21:59:57.887658 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.887603 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 21:59:57.889603 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.889586 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 21:59:57.889603 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.889601 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.889754 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.889621 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vtnlf" Jun 03 21:59:57.889754 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.889624 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 21:54:56 +0000 UTC" deadline="2027-12-14 14:18:52.684643317 +0000 UTC" Jun 03 21:59:57.889754 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.889671 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13408h18m54.794976901s" Jun 03 21:59:57.891692 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.891676 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 21:59:57.891785 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.891747 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 21:59:57.891785 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.891770 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:59:57.891785 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.891779 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2ndtq\"" Jun 03 21:59:57.892431 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.892416 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tvm2z" Jun 03 21:59:57.894169 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.894155 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 21:59:57.894497 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.894480 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 21:59:57.894562 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.894535 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nchl2\"" Jun 03 21:59:57.894620 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.894480 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 21:59:57.895145 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.895131 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:57.896971 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.896802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/513cb310-b56c-4ff7-bb64-11b039711b95-hosts-file\") pod \"node-resolver-w2kgw\" (UID: \"513cb310-b56c-4ff7-bb64-11b039711b95\") " pod="openshift-dns/node-resolver-w2kgw" Jun 03 21:59:57.896971 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.896833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/513cb310-b56c-4ff7-bb64-11b039711b95-tmp-dir\") pod \"node-resolver-w2kgw\" (UID: \"513cb310-b56c-4ff7-bb64-11b039711b95\") " pod="openshift-dns/node-resolver-w2kgw" Jun 03 21:59:57.896971 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.896861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-registration-dir\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:57.896971 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.896885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-sysctl-d\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.896971 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.896924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-sysctl-conf\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.896971 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.896956 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-var-lib-kubelet\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.897269 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.896985 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djtfd\" (UniqueName: \"kubernetes.io/projected/c23c08fc-365a-4285-ba77-582a9f9a1dd9-kube-api-access-djtfd\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.897269 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91b3edf3-9583-4b87-886e-64c5cab5b548-host-slash\") pod \"iptables-alerter-vtnlf\" (UID: \"91b3edf3-9583-4b87-886e-64c5cab5b548\") " pod="openshift-network-operator/iptables-alerter-vtnlf" Jun 03 21:59:57.897269 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hll5v\" (UniqueName: \"kubernetes.io/projected/91b3edf3-9583-4b87-886e-64c5cab5b548-kube-api-access-hll5v\") pod \"iptables-alerter-vtnlf\" (UID: \"91b3edf3-9583-4b87-886e-64c5cab5b548\") " pod="openshift-network-operator/iptables-alerter-vtnlf" Jun 03 21:59:57.897269 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96dec97d-dd0e-49f2-94ac-4a0b54fd4d28-agent-certs\") pod \"konnectivity-agent-7qh9f\" (UID: \"96dec97d-dd0e-49f2-94ac-4a0b54fd4d28\") " pod="kube-system/konnectivity-agent-7qh9f" Jun 03 21:59:57.897269 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-socket-dir\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:57.897269 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-systemd\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.897269 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-sys\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.897269 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96dec97d-dd0e-49f2-94ac-4a0b54fd4d28-konnectivity-ca\") pod \"konnectivity-agent-7qh9f\" (UID: \"96dec97d-dd0e-49f2-94ac-4a0b54fd4d28\") " pod="kube-system/konnectivity-agent-7qh9f" Jun 03 21:59:57.897269 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:57.897269 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-etc-selinux\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:57.897269 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897226 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897321 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aee1e2a7-6e76-4a8e-9890-183c5b4be52e-host\") pod \"node-ca-tvm2z\" (UID: \"aee1e2a7-6e76-4a8e-9890-183c5b4be52e\") " pod="openshift-image-registry/node-ca-tvm2z" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aee1e2a7-6e76-4a8e-9890-183c5b4be52e-serviceca\") pod \"node-ca-tvm2z\" (UID: \"aee1e2a7-6e76-4a8e-9890-183c5b4be52e\") " pod="openshift-image-registry/node-ca-tvm2z" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8ljt\" (UniqueName: \"kubernetes.io/projected/aee1e2a7-6e76-4a8e-9890-183c5b4be52e-kube-api-access-c8ljt\") pod \"node-ca-tvm2z\" (UID: \"aee1e2a7-6e76-4a8e-9890-183c5b4be52e\") " pod="openshift-image-registry/node-ca-tvm2z" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-sysconfig\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897478 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-host\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d4d176ad-9a2b-473b-bd39-3a91857755e1-kubelet-config\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-modprobe-d\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pq28l" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-kubernetes\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897594 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-run\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-lib-modules\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-tuned\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d4d176ad-9a2b-473b-bd39-3a91857755e1-dbus\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jlgt\" (UniqueName: \"kubernetes.io/projected/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-kube-api-access-4jlgt\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897759 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ws8z4\"" Jun 03 21:59:57.897824 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 21:59:57.898410 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s279x\" (UniqueName: \"kubernetes.io/projected/bc891b78-9de2-441d-9e93-86bcded1ab6e-kube-api-access-s279x\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 21:59:57.898410 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897824 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 21:59:57.898410 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897863 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rx27\" (UniqueName: \"kubernetes.io/projected/513cb310-b56c-4ff7-bb64-11b039711b95-kube-api-access-8rx27\") pod \"node-resolver-w2kgw\" (UID: \"513cb310-b56c-4ff7-bb64-11b039711b95\") " pod="openshift-dns/node-resolver-w2kgw" Jun 03 21:59:57.898410 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91b3edf3-9583-4b87-886e-64c5cab5b548-iptables-alerter-script\") pod \"iptables-alerter-vtnlf\" (UID: \"91b3edf3-9583-4b87-886e-64c5cab5b548\") " pod="openshift-network-operator/iptables-alerter-vtnlf" Jun 03 21:59:57.898410 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 21:59:57.898410 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.897986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-device-dir\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:57.898410 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.898010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-sys-fs\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:57.898410 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.898036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c23c08fc-365a-4285-ba77-582a9f9a1dd9-tmp\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.899528 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.899509 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 21:59:57.899583 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.899546 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 21:59:57.899625 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.899576 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 21:59:57.899958 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.899936 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nz5kh\"" Jun 03 21:59:57.900071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.900040 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 21:59:57.900142 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.900113 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" Jun 03 21:59:57.901943 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.901925 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal"] Jun 03 21:59:57.902133 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.902119 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:57.904316 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.904295 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 21:59:57.904403 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.904314 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 21:59:57.904403 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.904313 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 21:59:57.904403 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.904393 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 21:59:57.904536 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.904431 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 21:59:57.904622 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.904605 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hckb5\"" Jun 03 21:59:57.904656 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.904633 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 21:59:57.905614 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.905592 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 21:59:57.910594 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.910578 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 21:59:57.910701 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.910687 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal"] Jun 03 21:59:57.927237 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.927213 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-crl4g" Jun 03 21:59:57.933282 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.933266 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-crl4g" Jun 03 21:59:57.957273 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:57.957112 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb812aca86e0ab34230683409af57a592.slice/crio-d120ab9a77da51b1e7be9b0f6973d9f3a5d181e738ef309153a1edf36795894d WatchSource:0}: Error finding container d120ab9a77da51b1e7be9b0f6973d9f3a5d181e738ef309153a1edf36795894d: Status 404 returned error can't find the container with id d120ab9a77da51b1e7be9b0f6973d9f3a5d181e738ef309153a1edf36795894d Jun 03 21:59:57.957526 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:57.957508 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55770dce513cfd126cc2cf19f107bfda.slice/crio-2777eaa96dfd8032ed4984d4bb68e3d5bf982feaec01e30bde5a8488224d9074 WatchSource:0}: Error finding container 2777eaa96dfd8032ed4984d4bb68e3d5bf982feaec01e30bde5a8488224d9074: Status 404 returned error can't find the container with id 2777eaa96dfd8032ed4984d4bb68e3d5bf982feaec01e30bde5a8488224d9074 Jun 03 21:59:57.961082 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.961060 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:59:57.969764 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.969724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal" event={"ID":"55770dce513cfd126cc2cf19f107bfda","Type":"ContainerStarted","Data":"2777eaa96dfd8032ed4984d4bb68e3d5bf982feaec01e30bde5a8488224d9074"} Jun 03 21:59:57.971016 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.970990 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" event={"ID":"b812aca86e0ab34230683409af57a592","Type":"ContainerStarted","Data":"d120ab9a77da51b1e7be9b0f6973d9f3a5d181e738ef309153a1edf36795894d"} Jun 03 21:59:57.990891 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.990874 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 21:59:57.998608 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-systemd-units\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:57.998706 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-slash\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:57.998706 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:57.998706 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998643 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/138fe142-a354-430d-ba62-07913e04eb71-multus-daemon-config\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:57.998706 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-multus-cni-dir\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:57.998706 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-sysctl-conf\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.998869 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-socket-dir\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:57.998869 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998742 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-var-lib-cni-multus\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:57.998869 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-kubelet\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:57.998869 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-cni-bin\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:57.998869 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d475ec59-ef91-43eb-a554-dca9dc1e7571-ovnkube-script-lib\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:57.998869 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:57.998869 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-cnibin\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:57.998869 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-run-k8s-cni-cncf-io\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:57.998869 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998842 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-sysctl-conf\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.998869 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998852 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-systemd\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.998869 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-socket-dir\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:57.999219 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96dec97d-dd0e-49f2-94ac-4a0b54fd4d28-konnectivity-ca\") pod \"konnectivity-agent-7qh9f\" (UID: \"96dec97d-dd0e-49f2-94ac-4a0b54fd4d28\") " pod="kube-system/konnectivity-agent-7qh9f" Jun 03 21:59:57.999219 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998913 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-systemd\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.999219 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.998920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-etc-selinux\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:57.999219 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999020 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aee1e2a7-6e76-4a8e-9890-183c5b4be52e-serviceca\") pod \"node-ca-tvm2z\" (UID: \"aee1e2a7-6e76-4a8e-9890-183c5b4be52e\") " pod="openshift-image-registry/node-ca-tvm2z" Jun 03 21:59:57.999219 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999033 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-etc-selinux\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:57.999219 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d475ec59-ef91-43eb-a554-dca9dc1e7571-env-overrides\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:57.999219 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-sysconfig\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.999219 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-host\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.999219 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htjm5\" (UniqueName: \"kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5\") pod \"network-check-target-97gxk\" (UID: \"027116fa-8b61-40cb-b594-b30abc3ed3d3\") " pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999247 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-sysconfig\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-cni-netd\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d475ec59-ef91-43eb-a554-dca9dc1e7571-ovn-node-metrics-cert\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999264 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-host\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-run\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999365 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-run\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-lib-modules\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d4d176ad-9a2b-473b-bd39-3a91857755e1-dbus\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7nxp\" (UniqueName: \"kubernetes.io/projected/d475ec59-ef91-43eb-a554-dca9dc1e7571-kube-api-access-v7nxp\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999436 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96dec97d-dd0e-49f2-94ac-4a0b54fd4d28-konnectivity-ca\") pod \"konnectivity-agent-7qh9f\" (UID: \"96dec97d-dd0e-49f2-94ac-4a0b54fd4d28\") " pod="kube-system/konnectivity-agent-7qh9f" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s279x\" (UniqueName: \"kubernetes.io/projected/bc891b78-9de2-441d-9e93-86bcded1ab6e-kube-api-access-s279x\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d4d176ad-9a2b-473b-bd39-3a91857755e1-dbus\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999487 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aee1e2a7-6e76-4a8e-9890-183c5b4be52e-serviceca\") pod \"node-ca-tvm2z\" (UID: \"aee1e2a7-6e76-4a8e-9890-183c5b4be52e\") " pod="openshift-image-registry/node-ca-tvm2z" Jun 03 21:59:57.999512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-hostroot\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999516 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-lib-modules\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-run-netns\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91b3edf3-9583-4b87-886e-64c5cab5b548-iptables-alerter-script\") pod \"iptables-alerter-vtnlf\" (UID: \"91b3edf3-9583-4b87-886e-64c5cab5b548\") " pod="openshift-network-operator/iptables-alerter-vtnlf" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-device-dir\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-cnibin\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-run-netns\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-run-systemd\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-node-log\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.999658 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c23c08fc-365a-4285-ba77-582a9f9a1dd9-tmp\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999703 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-device-dir\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:57.999721 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret podName:d4d176ad-9a2b-473b-bd39-3a91857755e1 nodeName:}" failed. No retries permitted until 2026-06-03 21:59:58.499701963 +0000 UTC m=+1.974583092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret") pod "global-pull-secret-syncer-582tg" (UID: "d4d176ad-9a2b-473b-bd39-3a91857755e1") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/513cb310-b56c-4ff7-bb64-11b039711b95-hosts-file\") pod \"node-resolver-w2kgw\" (UID: \"513cb310-b56c-4ff7-bb64-11b039711b95\") " pod="openshift-dns/node-resolver-w2kgw" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999762 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/513cb310-b56c-4ff7-bb64-11b039711b95-tmp-dir\") pod \"node-resolver-w2kgw\" (UID: \"513cb310-b56c-4ff7-bb64-11b039711b95\") " pod="openshift-dns/node-resolver-w2kgw" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999774 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/513cb310-b56c-4ff7-bb64-11b039711b95-hosts-file\") pod \"node-resolver-w2kgw\" (UID: \"513cb310-b56c-4ff7-bb64-11b039711b95\") " pod="openshift-dns/node-resolver-w2kgw" Jun 03 21:59:58.000327 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-os-release\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/138fe142-a354-430d-ba62-07913e04eb71-cni-binary-copy\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999878 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d475ec59-ef91-43eb-a554-dca9dc1e7571-ovnkube-config\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:57.999976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-registration-dir\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-system-cni-dir\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91b3edf3-9583-4b87-886e-64c5cab5b548-iptables-alerter-script\") pod \"iptables-alerter-vtnlf\" (UID: \"91b3edf3-9583-4b87-886e-64c5cab5b548\") " pod="openshift-network-operator/iptables-alerter-vtnlf" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-os-release\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000067 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/513cb310-b56c-4ff7-bb64-11b039711b95-tmp-dir\") pod \"node-resolver-w2kgw\" (UID: \"513cb310-b56c-4ff7-bb64-11b039711b95\") " pod="openshift-dns/node-resolver-w2kgw" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-multus-socket-dir-parent\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000083 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-registration-dir\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-etc-openvswitch\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000089 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-system-cni-dir\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-sysctl-d\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-var-lib-kubelet\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.001088 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djtfd\" (UniqueName: \"kubernetes.io/projected/c23c08fc-365a-4285-ba77-582a9f9a1dd9-kube-api-access-djtfd\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91b3edf3-9583-4b87-886e-64c5cab5b548-host-slash\") pod \"iptables-alerter-vtnlf\" (UID: \"91b3edf3-9583-4b87-886e-64c5cab5b548\") " pod="openshift-network-operator/iptables-alerter-vtnlf" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000310 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hll5v\" (UniqueName: \"kubernetes.io/projected/91b3edf3-9583-4b87-886e-64c5cab5b548-kube-api-access-hll5v\") pod \"iptables-alerter-vtnlf\" (UID: \"91b3edf3-9583-4b87-886e-64c5cab5b548\") " pod="openshift-network-operator/iptables-alerter-vtnlf" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000316 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-var-lib-kubelet\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96dec97d-dd0e-49f2-94ac-4a0b54fd4d28-agent-certs\") pod \"konnectivity-agent-7qh9f\" (UID: \"96dec97d-dd0e-49f2-94ac-4a0b54fd4d28\") " pod="kube-system/konnectivity-agent-7qh9f" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000357 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-sysctl-d\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ljt\" (UniqueName: \"kubernetes.io/projected/aee1e2a7-6e76-4a8e-9890-183c5b4be52e-kube-api-access-c8ljt\") pod \"node-ca-tvm2z\" (UID: \"aee1e2a7-6e76-4a8e-9890-183c5b4be52e\") " pod="openshift-image-registry/node-ca-tvm2z" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000368 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91b3edf3-9583-4b87-886e-64c5cab5b548-host-slash\") pod \"iptables-alerter-vtnlf\" (UID: \"91b3edf3-9583-4b87-886e-64c5cab5b548\") " pod="openshift-network-operator/iptables-alerter-vtnlf" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-sys\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000591 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-sys\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000633 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aee1e2a7-6e76-4a8e-9890-183c5b4be52e-host\") pod \"node-ca-tvm2z\" (UID: \"aee1e2a7-6e76-4a8e-9890-183c5b4be52e\") " pod="openshift-image-registry/node-ca-tvm2z" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000712 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d4d176ad-9a2b-473b-bd39-3a91857755e1-kubelet-config\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-etc-kubernetes\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-run-ovn\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aee1e2a7-6e76-4a8e-9890-183c5b4be52e-host\") pod \"node-ca-tvm2z\" (UID: \"aee1e2a7-6e76-4a8e-9890-183c5b4be52e\") " pod="openshift-image-registry/node-ca-tvm2z" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d4d176ad-9a2b-473b-bd39-3a91857755e1-kubelet-config\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 21:59:58.001724 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-modprobe-d\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-kubernetes\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-tuned\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jlgt\" (UniqueName: \"kubernetes.io/projected/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-kube-api-access-4jlgt\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000896 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-modprobe-d\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000918 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-kubernetes\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7wbp\" (UniqueName: \"kubernetes.io/projected/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-kube-api-access-d7wbp\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-run-ovn-kubernetes\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.000993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.001134 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.001113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-var-lib-cni-bin\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.001182 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs podName:bc891b78-9de2-441d-9e93-86bcded1ab6e nodeName:}" failed. No retries permitted until 2026-06-03 21:59:58.501166796 +0000 UTC m=+1.976047915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs") pod "network-metrics-daemon-4wpm2" (UID: "bc891b78-9de2-441d-9e93-86bcded1ab6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.001226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-run-multus-certs\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.001252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-var-lib-openvswitch\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.001277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-log-socket\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.001303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rx27\" (UniqueName: \"kubernetes.io/projected/513cb310-b56c-4ff7-bb64-11b039711b95-kube-api-access-8rx27\") pod \"node-resolver-w2kgw\" (UID: \"513cb310-b56c-4ff7-bb64-11b039711b95\") " pod="openshift-dns/node-resolver-w2kgw" Jun 03 21:59:58.002230 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.001327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-sys-fs\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:58.002716 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.001353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-var-lib-kubelet\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.002716 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.001375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-multus-conf-dir\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.002716 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.001399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b96z\" (UniqueName: \"kubernetes.io/projected/138fe142-a354-430d-ba62-07913e04eb71-kube-api-access-9b96z\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.002716 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.001423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-run-openvswitch\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.002716 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.001466 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-sys-fs\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:58.002963 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.002941 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c23c08fc-365a-4285-ba77-582a9f9a1dd9-etc-tuned\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.003035 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.002987 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c23c08fc-365a-4285-ba77-582a9f9a1dd9-tmp\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.003238 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.003222 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96dec97d-dd0e-49f2-94ac-4a0b54fd4d28-agent-certs\") pod \"konnectivity-agent-7qh9f\" (UID: \"96dec97d-dd0e-49f2-94ac-4a0b54fd4d28\") " pod="kube-system/konnectivity-agent-7qh9f" Jun 03 21:59:58.012494 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.012470 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s279x\" (UniqueName: \"kubernetes.io/projected/bc891b78-9de2-441d-9e93-86bcded1ab6e-kube-api-access-s279x\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 21:59:58.012673 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.012658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djtfd\" (UniqueName: \"kubernetes.io/projected/c23c08fc-365a-4285-ba77-582a9f9a1dd9-kube-api-access-djtfd\") pod \"tuned-q7sws\" (UID: \"c23c08fc-365a-4285-ba77-582a9f9a1dd9\") " pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.013506 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.013476 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8ljt\" (UniqueName: \"kubernetes.io/projected/aee1e2a7-6e76-4a8e-9890-183c5b4be52e-kube-api-access-c8ljt\") pod \"node-ca-tvm2z\" (UID: \"aee1e2a7-6e76-4a8e-9890-183c5b4be52e\") " pod="openshift-image-registry/node-ca-tvm2z" Jun 03 21:59:58.013703 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.013678 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rx27\" (UniqueName: \"kubernetes.io/projected/513cb310-b56c-4ff7-bb64-11b039711b95-kube-api-access-8rx27\") pod \"node-resolver-w2kgw\" (UID: \"513cb310-b56c-4ff7-bb64-11b039711b95\") " pod="openshift-dns/node-resolver-w2kgw" Jun 03 21:59:58.013746 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.013712 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hll5v\" (UniqueName: \"kubernetes.io/projected/91b3edf3-9583-4b87-886e-64c5cab5b548-kube-api-access-hll5v\") pod \"iptables-alerter-vtnlf\" (UID: \"91b3edf3-9583-4b87-886e-64c5cab5b548\") " pod="openshift-network-operator/iptables-alerter-vtnlf" Jun 03 21:59:58.013780 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.013758 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jlgt\" (UniqueName: \"kubernetes.io/projected/5daa0f0b-48cc-45c2-a4c4-c80b212619fb-kube-api-access-4jlgt\") pod \"aws-ebs-csi-driver-node-856rr\" (UID: \"5daa0f0b-48cc-45c2-a4c4-c80b212619fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:58.101830 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.101795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-etc-kubernetes\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.101830 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.101831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-run-ovn\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.101857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7wbp\" (UniqueName: \"kubernetes.io/projected/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-kube-api-access-d7wbp\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.101881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-run-ovn-kubernetes\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.101906 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-run-ovn\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.101908 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-etc-kubernetes\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.101912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-var-lib-cni-bin\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.101945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-run-ovn-kubernetes\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.101967 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-run-multus-certs\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.101950 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-var-lib-cni-bin\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.101992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-run-multus-certs\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.101996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-var-lib-openvswitch\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-log-socket\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102027 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-var-lib-openvswitch\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102071 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-var-lib-kubelet\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-multus-conf-dir\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102103 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-log-socket\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102129 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-multus-conf-dir\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102129 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-var-lib-kubelet\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b96z\" (UniqueName: \"kubernetes.io/projected/138fe142-a354-430d-ba62-07913e04eb71-kube-api-access-9b96z\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-run-openvswitch\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-systemd-units\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-slash\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102213 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-run-openvswitch\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102224 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-slash\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102237 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-systemd-units\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/138fe142-a354-430d-ba62-07913e04eb71-multus-daemon-config\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-multus-cni-dir\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-var-lib-cni-multus\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-kubelet\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102393 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-multus-cni-dir\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.102638 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-cni-bin\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102435 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-var-lib-cni-multus\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d475ec59-ef91-43eb-a554-dca9dc1e7571-ovnkube-script-lib\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102453 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-kubelet\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-cnibin\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102489 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-cni-bin\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-run-k8s-cni-cncf-io\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d475ec59-ef91-43eb-a554-dca9dc1e7571-env-overrides\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-cnibin\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjm5\" (UniqueName: \"kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5\") pod \"network-check-target-97gxk\" (UID: \"027116fa-8b61-40cb-b594-b30abc3ed3d3\") " pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-run-k8s-cni-cncf-io\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-cni-netd\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d475ec59-ef91-43eb-a554-dca9dc1e7571-ovn-node-metrics-cert\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102705 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-cni-netd\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.103461 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7nxp\" (UniqueName: \"kubernetes.io/projected/d475ec59-ef91-43eb-a554-dca9dc1e7571-kube-api-access-v7nxp\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-hostroot\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-run-netns\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-cnibin\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-run-netns\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-run-systemd\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-node-log\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-os-release\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-cnibin\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102930 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/138fe142-a354-430d-ba62-07913e04eb71-multus-daemon-config\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.102999 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-os-release\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103007 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-hostroot\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/138fe142-a354-430d-ba62-07913e04eb71-cni-binary-copy\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-run-netns\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103080 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-host-run-netns\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103113 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-node-log\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103115 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d475ec59-ef91-43eb-a554-dca9dc1e7571-ovnkube-script-lib\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103118 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103151 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-run-systemd\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d475ec59-ef91-43eb-a554-dca9dc1e7571-ovnkube-config\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-system-cni-dir\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-os-release\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-multus-socket-dir-parent\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103262 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-system-cni-dir\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-etc-openvswitch\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103294 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-os-release\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-system-cni-dir\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d475ec59-ef91-43eb-a554-dca9dc1e7571-etc-openvswitch\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103354 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-system-cni-dir\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/138fe142-a354-430d-ba62-07913e04eb71-multus-socket-dir-parent\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103459 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/138fe142-a354-430d-ba62-07913e04eb71-cni-binary-copy\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.104627 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.105113 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103609 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d475ec59-ef91-43eb-a554-dca9dc1e7571-env-overrides\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.105113 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.103627 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d475ec59-ef91-43eb-a554-dca9dc1e7571-ovnkube-config\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.105551 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.105536 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d475ec59-ef91-43eb-a554-dca9dc1e7571-ovn-node-metrics-cert\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.108752 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.108732 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:59:58.108752 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.108752 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:59:58.108945 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.108761 2578 projected.go:196] Error preparing data for projected volume kube-api-access-htjm5 for pod openshift-network-diagnostics/network-check-target-97gxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:59:58.108945 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.108808 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5 podName:027116fa-8b61-40cb-b594-b30abc3ed3d3 nodeName:}" failed. No retries permitted until 2026-06-03 21:59:58.608796139 +0000 UTC m=+2.083677256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-htjm5" (UniqueName: "kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5") pod "network-check-target-97gxk" (UID: "027116fa-8b61-40cb-b594-b30abc3ed3d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:59:58.109894 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.109869 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b96z\" (UniqueName: \"kubernetes.io/projected/138fe142-a354-430d-ba62-07913e04eb71-kube-api-access-9b96z\") pod \"multus-pq28l\" (UID: \"138fe142-a354-430d-ba62-07913e04eb71\") " pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.110416 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.110399 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7nxp\" (UniqueName: \"kubernetes.io/projected/d475ec59-ef91-43eb-a554-dca9dc1e7571-kube-api-access-v7nxp\") pod \"ovnkube-node-46r9m\" (UID: \"d475ec59-ef91-43eb-a554-dca9dc1e7571\") " pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.110679 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.110660 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7wbp\" (UniqueName: \"kubernetes.io/projected/c3e06f1b-89bb-4bfa-8e12-3f252e64f255-kube-api-access-d7wbp\") pod \"multus-additional-cni-plugins-n6qb8\" (UID: \"c3e06f1b-89bb-4bfa-8e12-3f252e64f255\") " pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.205156 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.205035 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:59:58.207012 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.206990 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7qh9f" Jun 03 21:59:58.217082 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:58.217042 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96dec97d_dd0e_49f2_94ac_4a0b54fd4d28.slice/crio-d63f140e09b8c5ab48f288e2414689a3bdcf46490426f75c4df28d6414ddb71f WatchSource:0}: Error finding container d63f140e09b8c5ab48f288e2414689a3bdcf46490426f75c4df28d6414ddb71f: Status 404 returned error can't find the container with id d63f140e09b8c5ab48f288e2414689a3bdcf46490426f75c4df28d6414ddb71f Jun 03 21:59:58.220478 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.220461 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" Jun 03 21:59:58.228363 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:58.228338 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5daa0f0b_48cc_45c2_a4c4_c80b212619fb.slice/crio-ee3721d57972362d3417484e9a4b95f0736c48be5e81d511a8f4d6a63af33c57 WatchSource:0}: Error finding container ee3721d57972362d3417484e9a4b95f0736c48be5e81d511a8f4d6a63af33c57: Status 404 returned error can't find the container with id ee3721d57972362d3417484e9a4b95f0736c48be5e81d511a8f4d6a63af33c57 Jun 03 21:59:58.238251 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.238231 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q7sws" Jun 03 21:59:58.247173 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:58.247152 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23c08fc_365a_4285_ba77_582a9f9a1dd9.slice/crio-2cbd493e7b1f68a136049e03730051b82870f4ebeac39ad7856f29dd10848f2e WatchSource:0}: Error finding container 2cbd493e7b1f68a136049e03730051b82870f4ebeac39ad7856f29dd10848f2e: Status 404 returned error can't find the container with id 2cbd493e7b1f68a136049e03730051b82870f4ebeac39ad7856f29dd10848f2e Jun 03 21:59:58.258177 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.258160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w2kgw" Jun 03 21:59:58.264883 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.264863 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vtnlf" Jun 03 21:59:58.266667 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:58.266645 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513cb310_b56c_4ff7_bb64_11b039711b95.slice/crio-fc36ef83a58f228a86309b48fa38c77be18bbaf6e629f8af7e72940294dbb1cc WatchSource:0}: Error finding container fc36ef83a58f228a86309b48fa38c77be18bbaf6e629f8af7e72940294dbb1cc: Status 404 returned error can't find the container with id fc36ef83a58f228a86309b48fa38c77be18bbaf6e629f8af7e72940294dbb1cc Jun 03 21:59:58.270636 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.270617 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tvm2z" Jun 03 21:59:58.273366 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:58.273347 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b3edf3_9583_4b87_886e_64c5cab5b548.slice/crio-d2a9559d8fb298645a6fafdfa681f805c9a56c41b795b5325189e7e5463dddd8 WatchSource:0}: Error finding container d2a9559d8fb298645a6fafdfa681f805c9a56c41b795b5325189e7e5463dddd8: Status 404 returned error can't find the container with id d2a9559d8fb298645a6fafdfa681f805c9a56c41b795b5325189e7e5463dddd8 Jun 03 21:59:58.276551 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.276488 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n6qb8" Jun 03 21:59:58.279572 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:58.279550 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee1e2a7_6e76_4a8e_9890_183c5b4be52e.slice/crio-53c26230cb8b9c49aab7c211b5528ffa55377c9a1af8b2c45488e4bae4eb75fb WatchSource:0}: Error finding container 53c26230cb8b9c49aab7c211b5528ffa55377c9a1af8b2c45488e4bae4eb75fb: Status 404 returned error can't find the container with id 53c26230cb8b9c49aab7c211b5528ffa55377c9a1af8b2c45488e4bae4eb75fb Jun 03 21:59:58.282802 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.282786 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pq28l" Jun 03 21:59:58.286512 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.286447 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 21:59:58.286737 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:58.286717 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e06f1b_89bb_4bfa_8e12_3f252e64f255.slice/crio-55f5eb06453d3ed252fa97526b6d287b45446698c6f96f65e123fe169d979d42 WatchSource:0}: Error finding container 55f5eb06453d3ed252fa97526b6d287b45446698c6f96f65e123fe169d979d42: Status 404 returned error can't find the container with id 55f5eb06453d3ed252fa97526b6d287b45446698c6f96f65e123fe169d979d42 Jun 03 21:59:58.293701 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:58.293676 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138fe142_a354_430d_ba62_07913e04eb71.slice/crio-f69ca511f190c3028412606323612ae74878d9157db9b48a37fd168040f798f7 WatchSource:0}: Error finding container f69ca511f190c3028412606323612ae74878d9157db9b48a37fd168040f798f7: Status 404 returned error can't find the container with id f69ca511f190c3028412606323612ae74878d9157db9b48a37fd168040f798f7 Jun 03 21:59:58.297168 ip-10-0-138-139 kubenswrapper[2578]: W0603 21:59:58.297150 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd475ec59_ef91_43eb_a554_dca9dc1e7571.slice/crio-8ae39e216b75b6266b767534226625ccf552a59e8e2bcf48e23ffe62cfb89235 WatchSource:0}: Error finding container 8ae39e216b75b6266b767534226625ccf552a59e8e2bcf48e23ffe62cfb89235: Status 404 returned error can't find the container with id 8ae39e216b75b6266b767534226625ccf552a59e8e2bcf48e23ffe62cfb89235 Jun 03 21:59:58.506070 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.505946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 21:59:58.506070 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.506016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 21:59:58.506298 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.506156 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:59:58.506298 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.506220 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs podName:bc891b78-9de2-441d-9e93-86bcded1ab6e nodeName:}" failed. No retries permitted until 2026-06-03 21:59:59.506200616 +0000 UTC m=+2.981081722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs") pod "network-metrics-daemon-4wpm2" (UID: "bc891b78-9de2-441d-9e93-86bcded1ab6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:59:58.506406 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.506374 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:59:58.506453 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.506436 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret podName:d4d176ad-9a2b-473b-bd39-3a91857755e1 nodeName:}" failed. No retries permitted until 2026-06-03 21:59:59.506418815 +0000 UTC m=+2.981299941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret") pod "global-pull-secret-syncer-582tg" (UID: "d4d176ad-9a2b-473b-bd39-3a91857755e1") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:59:58.707722 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.707683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjm5\" (UniqueName: \"kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5\") pod \"network-check-target-97gxk\" (UID: \"027116fa-8b61-40cb-b594-b30abc3ed3d3\") " pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 21:59:58.707996 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.707954 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:59:58.707996 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.707979 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:59:58.707996 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.707992 2578 projected.go:196] Error preparing data for projected volume kube-api-access-htjm5 for pod openshift-network-diagnostics/network-check-target-97gxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:59:58.708215 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:58.708109 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5 podName:027116fa-8b61-40cb-b594-b30abc3ed3d3 nodeName:}" failed. No retries permitted until 2026-06-03 21:59:59.708032742 +0000 UTC m=+3.182913863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-htjm5" (UniqueName: "kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5") pod "network-check-target-97gxk" (UID: "027116fa-8b61-40cb-b594-b30abc3ed3d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:59:58.736269 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.736208 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:59:58.937733 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.937562 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 21:54:57 +0000 UTC" deadline="2027-11-27 19:19:09.226629982 +0000 UTC" Jun 03 21:59:58.937733 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.937618 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13005h19m10.28901607s" Jun 03 21:59:58.996893 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:58.996811 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6qb8" event={"ID":"c3e06f1b-89bb-4bfa-8e12-3f252e64f255","Type":"ContainerStarted","Data":"55f5eb06453d3ed252fa97526b6d287b45446698c6f96f65e123fe169d979d42"} Jun 03 21:59:59.011988 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.011947 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w2kgw" event={"ID":"513cb310-b56c-4ff7-bb64-11b039711b95","Type":"ContainerStarted","Data":"fc36ef83a58f228a86309b48fa38c77be18bbaf6e629f8af7e72940294dbb1cc"} Jun 03 21:59:59.028933 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.028766 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" event={"ID":"5daa0f0b-48cc-45c2-a4c4-c80b212619fb","Type":"ContainerStarted","Data":"ee3721d57972362d3417484e9a4b95f0736c48be5e81d511a8f4d6a63af33c57"} Jun 03 21:59:59.065632 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.065594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7qh9f" event={"ID":"96dec97d-dd0e-49f2-94ac-4a0b54fd4d28","Type":"ContainerStarted","Data":"d63f140e09b8c5ab48f288e2414689a3bdcf46490426f75c4df28d6414ddb71f"} Jun 03 21:59:59.070934 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.070870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tvm2z" event={"ID":"aee1e2a7-6e76-4a8e-9890-183c5b4be52e","Type":"ContainerStarted","Data":"53c26230cb8b9c49aab7c211b5528ffa55377c9a1af8b2c45488e4bae4eb75fb"} Jun 03 21:59:59.076361 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.076326 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vtnlf" event={"ID":"91b3edf3-9583-4b87-886e-64c5cab5b548","Type":"ContainerStarted","Data":"d2a9559d8fb298645a6fafdfa681f805c9a56c41b795b5325189e7e5463dddd8"} Jun 03 21:59:59.089817 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.089734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q7sws" event={"ID":"c23c08fc-365a-4285-ba77-582a9f9a1dd9","Type":"ContainerStarted","Data":"2cbd493e7b1f68a136049e03730051b82870f4ebeac39ad7856f29dd10848f2e"} Jun 03 21:59:59.108331 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.108276 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" event={"ID":"d475ec59-ef91-43eb-a554-dca9dc1e7571","Type":"ContainerStarted","Data":"8ae39e216b75b6266b767534226625ccf552a59e8e2bcf48e23ffe62cfb89235"} Jun 03 21:59:59.111481 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.111447 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pq28l" event={"ID":"138fe142-a354-430d-ba62-07913e04eb71","Type":"ContainerStarted","Data":"f69ca511f190c3028412606323612ae74878d9157db9b48a37fd168040f798f7"} Jun 03 21:59:59.163705 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.163671 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:59:59.520181 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.520137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 21:59:59.520344 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.520219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 21:59:59.520393 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:59.520363 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:59:59.520446 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:59.520431 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs podName:bc891b78-9de2-441d-9e93-86bcded1ab6e nodeName:}" failed. No retries permitted until 2026-06-03 22:00:01.520411148 +0000 UTC m=+4.995292254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs") pod "network-metrics-daemon-4wpm2" (UID: "bc891b78-9de2-441d-9e93-86bcded1ab6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:59:59.520847 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:59.520825 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:59:59.520928 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:59.520891 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret podName:d4d176ad-9a2b-473b-bd39-3a91857755e1 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:01.520875711 +0000 UTC m=+4.995756829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret") pod "global-pull-secret-syncer-582tg" (UID: "d4d176ad-9a2b-473b-bd39-3a91857755e1") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:59:59.722116 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.722076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjm5\" (UniqueName: \"kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5\") pod \"network-check-target-97gxk\" (UID: \"027116fa-8b61-40cb-b594-b30abc3ed3d3\") " pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 21:59:59.722322 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:59.722312 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:59:59.722391 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:59.722331 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:59:59.722391 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:59.722345 2578 projected.go:196] Error preparing data for projected volume kube-api-access-htjm5 for pod openshift-network-diagnostics/network-check-target-97gxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:59:59.722489 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:59.722404 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5 podName:027116fa-8b61-40cb-b594-b30abc3ed3d3 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:01.72238522 +0000 UTC m=+5.197266325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-htjm5" (UniqueName: "kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5") pod "network-check-target-97gxk" (UID: "027116fa-8b61-40cb-b594-b30abc3ed3d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:59:59.938020 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.937915 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 21:54:57 +0000 UTC" deadline="2028-03-12 13:10:53.7771383 +0000 UTC" Jun 03 21:59:59.938020 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.937958 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15543h10m53.839185139s" Jun 03 21:59:59.967534 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.967502 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 21:59:59.967709 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:59.967623 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 21:59:59.968083 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.968035 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 21:59:59.968204 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:59.968148 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 21:59:59.968276 ip-10-0-138-139 kubenswrapper[2578]: I0603 21:59:59.968216 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 21:59:59.968324 ip-10-0-138-139 kubenswrapper[2578]: E0603 21:59:59.968298 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:01.542559 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:01.542520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:01.543025 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:01.542588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:01.543025 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:01.542705 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:00:01.543025 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:01.542724 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:00:01.543025 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:01.542766 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret podName:d4d176ad-9a2b-473b-bd39-3a91857755e1 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:05.542747648 +0000 UTC m=+9.017628757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret") pod "global-pull-secret-syncer-582tg" (UID: "d4d176ad-9a2b-473b-bd39-3a91857755e1") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:00:01.543025 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:01.542791 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs podName:bc891b78-9de2-441d-9e93-86bcded1ab6e nodeName:}" failed. No retries permitted until 2026-06-03 22:00:05.542774188 +0000 UTC m=+9.017655295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs") pod "network-metrics-daemon-4wpm2" (UID: "bc891b78-9de2-441d-9e93-86bcded1ab6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:00:01.744093 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:01.744041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjm5\" (UniqueName: \"kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5\") pod \"network-check-target-97gxk\" (UID: \"027116fa-8b61-40cb-b594-b30abc3ed3d3\") " pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:01.744275 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:01.744210 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:00:01.744275 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:01.744231 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:00:01.744275 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:01.744244 2578 projected.go:196] Error preparing data for projected volume kube-api-access-htjm5 for pod openshift-network-diagnostics/network-check-target-97gxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:00:01.744458 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:01.744296 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5 podName:027116fa-8b61-40cb-b594-b30abc3ed3d3 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:05.744277975 +0000 UTC m=+9.219159080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-htjm5" (UniqueName: "kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5") pod "network-check-target-97gxk" (UID: "027116fa-8b61-40cb-b594-b30abc3ed3d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:00:01.967420 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:01.967343 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:01.967569 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:01.967475 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:01.967569 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:01.967537 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:01.967667 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:01.967611 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:01.967667 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:01.967657 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:01.968081 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:01.967734 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:03.967405 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:03.967367 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:03.967863 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:03.967495 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:03.967955 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:03.967931 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:03.968094 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:03.968031 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:03.968160 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:03.968101 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:03.968220 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:03.968164 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:05.579571 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:05.579527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:05.579980 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:05.579592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:05.579980 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:05.579710 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:00:05.579980 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:05.579770 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs podName:bc891b78-9de2-441d-9e93-86bcded1ab6e nodeName:}" failed. No retries permitted until 2026-06-03 22:00:13.579749637 +0000 UTC m=+17.054630744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs") pod "network-metrics-daemon-4wpm2" (UID: "bc891b78-9de2-441d-9e93-86bcded1ab6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:00:05.580210 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:05.580193 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:00:05.580272 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:05.580248 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret podName:d4d176ad-9a2b-473b-bd39-3a91857755e1 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:13.580231021 +0000 UTC m=+17.055112127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret") pod "global-pull-secret-syncer-582tg" (UID: "d4d176ad-9a2b-473b-bd39-3a91857755e1") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:00:05.781946 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:05.781903 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjm5\" (UniqueName: \"kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5\") pod \"network-check-target-97gxk\" (UID: \"027116fa-8b61-40cb-b594-b30abc3ed3d3\") " pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:05.782179 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:05.782092 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:00:05.782179 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:05.782110 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:00:05.782179 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:05.782121 2578 projected.go:196] Error preparing data for projected volume kube-api-access-htjm5 for pod openshift-network-diagnostics/network-check-target-97gxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:00:05.782179 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:05.782177 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5 podName:027116fa-8b61-40cb-b594-b30abc3ed3d3 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:13.782157548 +0000 UTC m=+17.257038672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-htjm5" (UniqueName: "kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5") pod "network-check-target-97gxk" (UID: "027116fa-8b61-40cb-b594-b30abc3ed3d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:00:05.966884 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:05.966762 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:05.966884 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:05.966813 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:05.967156 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:05.966953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:05.967156 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:05.966964 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:05.967156 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:05.967086 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:05.967334 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:05.967240 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:07.967302 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:07.967263 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:07.967302 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:07.967282 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:07.967302 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:07.967277 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:07.968012 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:07.967405 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:07.968012 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:07.967461 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:07.968012 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:07.967499 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:09.967182 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:09.967142 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:09.967640 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:09.967149 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:09.967640 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:09.967284 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:09.967640 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:09.967159 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:09.967640 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:09.967365 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:09.967640 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:09.967452 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:11.967605 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:11.967143 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:11.967605 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:11.967175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:11.967605 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:11.967175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:11.967605 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:11.967254 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:11.967605 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:11.967354 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:11.967605 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:11.967438 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:13.639229 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:13.639191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:13.639724 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:13.639257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:13.639724 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:13.639366 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:00:13.639724 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:13.639423 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:00:13.639724 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:13.639438 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret podName:d4d176ad-9a2b-473b-bd39-3a91857755e1 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:29.639418169 +0000 UTC m=+33.114299277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret") pod "global-pull-secret-syncer-582tg" (UID: "d4d176ad-9a2b-473b-bd39-3a91857755e1") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:00:13.639724 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:13.639483 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs podName:bc891b78-9de2-441d-9e93-86bcded1ab6e nodeName:}" failed. No retries permitted until 2026-06-03 22:00:29.639464607 +0000 UTC m=+33.114345728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs") pod "network-metrics-daemon-4wpm2" (UID: "bc891b78-9de2-441d-9e93-86bcded1ab6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:00:13.840324 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:13.840232 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjm5\" (UniqueName: \"kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5\") pod \"network-check-target-97gxk\" (UID: \"027116fa-8b61-40cb-b594-b30abc3ed3d3\") " pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:13.840470 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:13.840415 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:00:13.840470 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:13.840444 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:00:13.840470 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:13.840459 2578 projected.go:196] Error preparing data for projected volume kube-api-access-htjm5 for pod openshift-network-diagnostics/network-check-target-97gxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:00:13.840610 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:13.840531 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5 podName:027116fa-8b61-40cb-b594-b30abc3ed3d3 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:29.840508967 +0000 UTC m=+33.315390073 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-htjm5" (UniqueName: "kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5") pod "network-check-target-97gxk" (UID: "027116fa-8b61-40cb-b594-b30abc3ed3d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:00:13.967202 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:13.967165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:13.967366 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:13.967211 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:13.967366 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:13.967279 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:13.967366 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:13.967294 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:13.967366 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:13.967354 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:13.967503 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:13.967431 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:15.967080 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:15.967033 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:15.967528 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:15.967033 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:15.967528 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:15.967152 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:15.967528 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:15.967033 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:15.967528 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:15.967243 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:15.967528 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:15.967333 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:17.967244 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:17.967217 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:17.967580 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:17.967243 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:17.967580 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:17.967246 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:17.967580 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:17.967336 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:17.967580 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:17.967398 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:17.967580 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:17.967495 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:18.151741 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:18.151562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" event={"ID":"d475ec59-ef91-43eb-a554-dca9dc1e7571","Type":"ContainerStarted","Data":"4d432876fa6ff6ccaffe6730d7601530edd634dd5569aad825012955060d7e88"} Jun 03 22:00:18.152719 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:18.152697 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pq28l" event={"ID":"138fe142-a354-430d-ba62-07913e04eb71","Type":"ContainerStarted","Data":"bee88db74ebff09d9beaee1a2d8d038ca89e006dd22c7704f5513e69c93662a1"} Jun 03 22:00:18.155953 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:18.155919 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal" event={"ID":"55770dce513cfd126cc2cf19f107bfda","Type":"ContainerStarted","Data":"ca88d7ec0ea0ee699b246d4d2c1c37e2477aee0cfef01ad84a9c73759a4c0320"} Jun 03 22:00:18.157467 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:18.157449 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q7sws" event={"ID":"c23c08fc-365a-4285-ba77-582a9f9a1dd9","Type":"ContainerStarted","Data":"13732e17b78968074756bfd9277d94ad4b229369e03a83609021906a24c260eb"} Jun 03 22:00:18.170879 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:18.170789 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pq28l" podStartSLOduration=1.7118068480000002 podStartE2EDuration="21.170775293s" totalImagesPullingTime="19.458968445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:18.170418555 +0000 UTC m=+21.645299681" watchObservedRunningTime="2026-06-03 22:00:18.170775293 +0000 UTC m=+21.645656419" Jun 03 22:00:18.189230 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:18.189188 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal" podStartSLOduration=21.189173418 podStartE2EDuration="21.189173418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:18.18890643 +0000 UTC m=+21.663787535" watchObservedRunningTime="2026-06-03 22:00:18.189173418 +0000 UTC m=+21.664054543" Jun 03 22:00:18.206822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:18.206781 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q7sws" podStartSLOduration=1.703212889 podStartE2EDuration="21.206766647s" totalImagesPullingTime="19.503553758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:18.206337845 +0000 UTC m=+21.681218981" watchObservedRunningTime="2026-06-03 22:00:18.206766647 +0000 UTC m=+21.681647773" Jun 03 22:00:19.162936 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:19.162784 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/ovn-acl-logging/0.log" Jun 03 22:00:19.163643 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:19.163262 2578 generic.go:356] "Generic (PLEG): container finished" podID="d475ec59-ef91-43eb-a554-dca9dc1e7571" containerID="87c02277f06aa23ba3affa4e773354dad8d8ee89eff88cb1eb7bac18f84f8fbf" exitCode=1 Jun 03 22:00:19.163643 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:19.163358 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" event={"ID":"d475ec59-ef91-43eb-a554-dca9dc1e7571","Type":"ContainerStarted","Data":"ae986e9ef76200ab6c291c128178fe4962af94d05e009d41dc8aadb575923f05"} Jun 03 22:00:19.163643 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:19.163425 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" event={"ID":"d475ec59-ef91-43eb-a554-dca9dc1e7571","Type":"ContainerStarted","Data":"d878e1bc22f0981e1f1951c8a07bf65dedf9cdaec3ae8630341b12b491a0fd39"} Jun 03 22:00:19.163643 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:19.163462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" event={"ID":"d475ec59-ef91-43eb-a554-dca9dc1e7571","Type":"ContainerStarted","Data":"ff60cccb06b806e78a9be19a229ec53e869f10a5589d12c18501003fcb38d99e"} Jun 03 22:00:19.163643 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:19.163489 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" event={"ID":"d475ec59-ef91-43eb-a554-dca9dc1e7571","Type":"ContainerStarted","Data":"667eb6c390ce542a1e9e0b6b9e9b2df87fb4ddf1ddfd98a7ab019bf3d759ef86"} Jun 03 22:00:19.163643 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:19.163516 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" event={"ID":"d475ec59-ef91-43eb-a554-dca9dc1e7571","Type":"ContainerDied","Data":"87c02277f06aa23ba3affa4e773354dad8d8ee89eff88cb1eb7bac18f84f8fbf"} Jun 03 22:00:19.966665 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:19.966627 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:19.966665 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:19.966653 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:19.966952 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:19.966663 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:19.966952 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:19.966753 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:19.966952 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:19.966829 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:19.966952 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:19.966910 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:20.167279 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.167243 2578 generic.go:356] "Generic (PLEG): container finished" podID="c3e06f1b-89bb-4bfa-8e12-3f252e64f255" containerID="96da51f578d743827415e2ad2807ed396b9887b7baa5ec0a8344fe9ab9e24b40" exitCode=0 Jun 03 22:00:20.167715 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.167314 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6qb8" event={"ID":"c3e06f1b-89bb-4bfa-8e12-3f252e64f255","Type":"ContainerDied","Data":"96da51f578d743827415e2ad2807ed396b9887b7baa5ec0a8344fe9ab9e24b40"} Jun 03 22:00:20.168779 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.168757 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w2kgw" event={"ID":"513cb310-b56c-4ff7-bb64-11b039711b95","Type":"ContainerStarted","Data":"4ac0f04be52ccfc689730582279f4c4ae58cc847542189fde39d222282a6f1d6"} Jun 03 22:00:20.170141 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.170119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" event={"ID":"5daa0f0b-48cc-45c2-a4c4-c80b212619fb","Type":"ContainerStarted","Data":"ff5ede6170748af37c48855e1a27a69fe169e8623fd56b862394b873e5f1043a"} Jun 03 22:00:20.173303 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.173279 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7qh9f" event={"ID":"96dec97d-dd0e-49f2-94ac-4a0b54fd4d28","Type":"ContainerStarted","Data":"4f4db04915ce007efc3f7c1a9448960b79effc5b9d48e27ce071d0aa78914760"} Jun 03 22:00:20.174823 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.174805 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tvm2z" event={"ID":"aee1e2a7-6e76-4a8e-9890-183c5b4be52e","Type":"ContainerStarted","Data":"e68276abc94f793f6fd6f141061332207037288ab187031b58577118d91a9acf"} Jun 03 22:00:20.176109 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.176083 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vtnlf" event={"ID":"91b3edf3-9583-4b87-886e-64c5cab5b548","Type":"ContainerStarted","Data":"98fbfc3a1808b89a430e2a3151f45f42640dae419a39c70d4486cbf6b47cd737"} Jun 03 22:00:20.177460 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.177438 2578 generic.go:356] "Generic (PLEG): container finished" podID="b812aca86e0ab34230683409af57a592" containerID="de469301dde717d433c13f2f1cd1cf2079dde7c556795f5e545b1034a5ef3d9a" exitCode=0 Jun 03 22:00:20.177552 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.177482 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" event={"ID":"b812aca86e0ab34230683409af57a592","Type":"ContainerDied","Data":"de469301dde717d433c13f2f1cd1cf2079dde7c556795f5e545b1034a5ef3d9a"} Jun 03 22:00:20.214930 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.214890 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w2kgw" podStartSLOduration=3.756049741 podStartE2EDuration="23.214869509s" totalImagesPullingTime="19.458819768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:20.201607846 +0000 UTC m=+23.676488972" watchObservedRunningTime="2026-06-03 22:00:20.214869509 +0000 UTC m=+23.689750636" Jun 03 22:00:20.215070 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.215027 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vtnlf" podStartSLOduration=3.824818262 podStartE2EDuration="23.215018294s" totalImagesPullingTime="19.390200032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:20.214319322 +0000 UTC m=+23.689200450" watchObservedRunningTime="2026-06-03 22:00:20.215018294 +0000 UTC m=+23.689899421" Jun 03 22:00:20.242747 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.242691 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7qh9f" podStartSLOduration=3.794900784 podStartE2EDuration="23.242670446s" totalImagesPullingTime="19.447769662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:20.228509241 +0000 UTC m=+23.703390370" watchObservedRunningTime="2026-06-03 22:00:20.242670446 +0000 UTC m=+23.717551574" Jun 03 22:00:20.243104 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.243075 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tvm2z" podStartSLOduration=4.207991065 podStartE2EDuration="23.243066813s" totalImagesPullingTime="19.035075748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:20.242206999 +0000 UTC m=+23.717088126" watchObservedRunningTime="2026-06-03 22:00:20.243066813 +0000 UTC m=+23.717947930" Jun 03 22:00:20.311609 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.311576 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 22:00:20.967009 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.966787 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T22:00:20.311592245Z","UUID":"8eac8370-60e4-4bf5-9b8f-ac03a1d92b65","Handler":null,"Name":"","Endpoint":""} Jun 03 22:00:20.968367 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.968347 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 22:00:20.968468 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:20.968389 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 22:00:21.181721 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:21.181681 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" event={"ID":"5daa0f0b-48cc-45c2-a4c4-c80b212619fb","Type":"ContainerStarted","Data":"c84bfdff477afef6f01bdafc521d83a23b69a2805a31a7eb86ef8f7fba8f675e"} Jun 03 22:00:21.186877 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:21.186847 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" event={"ID":"b812aca86e0ab34230683409af57a592","Type":"ContainerStarted","Data":"e1dc70cb27ce542ab8b3ac2114f90eb742a25a6cc799a9696b94b899e04d540f"} Jun 03 22:00:21.190578 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:21.190526 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/ovn-acl-logging/0.log" Jun 03 22:00:21.191084 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:21.191040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" event={"ID":"d475ec59-ef91-43eb-a554-dca9dc1e7571","Type":"ContainerStarted","Data":"159b38842a0e62bf3bbd99ae86efe92e86290537347f95bad6824f826223854a"} Jun 03 22:00:21.202362 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:21.202305 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" podStartSLOduration=24.202290874 podStartE2EDuration="24.202290874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:21.202149035 +0000 UTC m=+24.677030163" watchObservedRunningTime="2026-06-03 22:00:21.202290874 +0000 UTC m=+24.677172000" Jun 03 22:00:21.966797 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:21.966762 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:21.966797 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:21.966783 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:21.967025 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:21.966778 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:21.967025 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:21.966899 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:21.967165 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:21.967015 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:21.967165 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:21.967120 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:22.196144 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:22.196104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" event={"ID":"5daa0f0b-48cc-45c2-a4c4-c80b212619fb","Type":"ContainerStarted","Data":"a183c6a6156c2560b0f4044073227c16234fafd1518bef0e02641aa8f1df39a8"} Jun 03 22:00:22.451616 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:22.451581 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7qh9f" Jun 03 22:00:22.452283 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:22.452256 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7qh9f" Jun 03 22:00:22.467683 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:22.467640 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-856rr" podStartSLOduration=3.961455305 podStartE2EDuration="25.467624809s" totalImagesPullingTime="21.506169504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:22.217219705 +0000 UTC m=+25.692100832" watchObservedRunningTime="2026-06-03 22:00:22.467624809 +0000 UTC m=+25.942505935" Jun 03 22:00:23.050362 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:23.050328 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:23.137723 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:23.137685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:23.967303 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:23.967259 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:23.968017 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:23.967282 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:23.968017 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:23.967377 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:23.968017 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:23.967414 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:23.968017 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:23.967520 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:23.968017 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:23.967593 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:24.045644 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:24.045608 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7qh9f" Jun 03 22:00:24.046331 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:24.046308 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7qh9f" Jun 03 22:00:24.110297 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:24.110261 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:25.206338 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:25.206177 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/ovn-acl-logging/0.log" Jun 03 22:00:25.206922 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:25.206705 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" event={"ID":"d475ec59-ef91-43eb-a554-dca9dc1e7571","Type":"ContainerStarted","Data":"b1738beb36d61e4d27ad9c5f5ccdee3460a6d259f9307cdfb78d7a16b310fcf5"} Jun 03 22:00:25.207127 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:25.207036 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 22:00:25.207259 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:25.207150 2578 scope.go:117] "RemoveContainer" containerID="87c02277f06aa23ba3affa4e773354dad8d8ee89eff88cb1eb7bac18f84f8fbf" Jun 03 22:00:25.208844 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:25.208816 2578 generic.go:356] "Generic (PLEG): container finished" podID="c3e06f1b-89bb-4bfa-8e12-3f252e64f255" containerID="80881713a7cdace13f87ce0705ee4a8bd1bea7470739be5303d8f342bd4ea8aa" exitCode=0 Jun 03 22:00:25.208947 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:25.208843 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6qb8" event={"ID":"c3e06f1b-89bb-4bfa-8e12-3f252e64f255","Type":"ContainerDied","Data":"80881713a7cdace13f87ce0705ee4a8bd1bea7470739be5303d8f342bd4ea8aa"} Jun 03 22:00:25.224441 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:25.224419 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 22:00:25.966690 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:25.966659 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:25.966864 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:25.966777 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:25.966864 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:25.966786 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:25.966864 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:25.966815 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:25.967012 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:25.966930 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:25.967083 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:25.967025 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:26.216005 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.215974 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/ovn-acl-logging/0.log" Jun 03 22:00:26.216445 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.216384 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" event={"ID":"d475ec59-ef91-43eb-a554-dca9dc1e7571","Type":"ContainerStarted","Data":"6af54351b401c31fa0bc73a10a6494eeec2a64c350bf8d73d72ef9490dc62ebb"} Jun 03 22:00:26.216741 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.216690 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 22:00:26.216846 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.216831 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 22:00:26.218871 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.218844 2578 generic.go:356] "Generic (PLEG): container finished" podID="c3e06f1b-89bb-4bfa-8e12-3f252e64f255" containerID="d1df8fe769f4b90971bf3dac3ea56b97399bac4e71af21a991095c0e2f6fbdd7" exitCode=0 Jun 03 22:00:26.218997 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.218898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6qb8" event={"ID":"c3e06f1b-89bb-4bfa-8e12-3f252e64f255","Type":"ContainerDied","Data":"d1df8fe769f4b90971bf3dac3ea56b97399bac4e71af21a991095c0e2f6fbdd7"} Jun 03 22:00:26.233489 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.233465 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 22:00:26.244870 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.244825 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" podStartSLOduration=9.740003462 podStartE2EDuration="29.244807742s" totalImagesPullingTime="19.50480428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:26.244132497 +0000 UTC m=+29.719013624" watchObservedRunningTime="2026-06-03 22:00:26.244807742 +0000 UTC m=+29.719688849" Jun 03 22:00:26.482946 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.482841 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-582tg"] Jun 03 22:00:26.483126 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.482965 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:26.483126 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:26.483085 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:26.486253 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.486222 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-97gxk"] Jun 03 22:00:26.486429 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.486337 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:26.486489 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:26.486437 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:26.486889 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.486860 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4wpm2"] Jun 03 22:00:26.486984 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:26.486960 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:26.487109 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:26.487090 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:27.223720 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:27.223677 2578 generic.go:356] "Generic (PLEG): container finished" podID="c3e06f1b-89bb-4bfa-8e12-3f252e64f255" containerID="14e3f0665f306995ab24dbb2b5613f01121df508adc2d9e670b58ce895c622d8" exitCode=0 Jun 03 22:00:27.224462 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:27.223744 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6qb8" event={"ID":"c3e06f1b-89bb-4bfa-8e12-3f252e64f255","Type":"ContainerDied","Data":"14e3f0665f306995ab24dbb2b5613f01121df508adc2d9e670b58ce895c622d8"} Jun 03 22:00:27.329655 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:27.329623 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:27.382225 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:27.382153 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:27.440702 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:27.440668 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:27.967548 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:27.967510 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:27.967548 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:27.967535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:27.967771 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:27.967535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:27.967771 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:27.967642 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:27.967771 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:27.967710 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:27.967884 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:27.967826 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:28.406946 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:28.406914 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:28.505089 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:28.505017 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:29.407750 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:29.407710 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:29.531694 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:29.531658 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:29.654421 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:29.654183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:29.654609 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:29.654466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:29.654609 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:29.654360 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 22:00:29.654609 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:29.654590 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret podName:d4d176ad-9a2b-473b-bd39-3a91857755e1 nodeName:}" failed. No retries permitted until 2026-06-03 22:01:01.654562739 +0000 UTC m=+65.129443848 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret") pod "global-pull-secret-syncer-582tg" (UID: "d4d176ad-9a2b-473b-bd39-3a91857755e1") : object "kube-system"/"original-pull-secret" not registered Jun 03 22:00:29.654609 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:29.654607 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:00:29.654805 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:29.654659 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs podName:bc891b78-9de2-441d-9e93-86bcded1ab6e nodeName:}" failed. No retries permitted until 2026-06-03 22:01:01.654642269 +0000 UTC m=+65.129523376 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs") pod "network-metrics-daemon-4wpm2" (UID: "bc891b78-9de2-441d-9e93-86bcded1ab6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 22:00:29.856065 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:29.856011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjm5\" (UniqueName: \"kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5\") pod \"network-check-target-97gxk\" (UID: \"027116fa-8b61-40cb-b594-b30abc3ed3d3\") " pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:29.856239 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:29.856191 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 22:00:29.856239 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:29.856213 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 22:00:29.856239 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:29.856225 2578 projected.go:196] Error preparing data for projected volume kube-api-access-htjm5 for pod openshift-network-diagnostics/network-check-target-97gxk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:00:29.856358 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:29.856301 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5 podName:027116fa-8b61-40cb-b594-b30abc3ed3d3 nodeName:}" failed. No retries permitted until 2026-06-03 22:01:01.856279857 +0000 UTC m=+65.331160979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-htjm5" (UniqueName: "kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5") pod "network-check-target-97gxk" (UID: "027116fa-8b61-40cb-b594-b30abc3ed3d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 22:00:29.967101 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:29.967067 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:29.967276 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:29.967068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:29.967276 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:29.967192 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-97gxk" podUID="027116fa-8b61-40cb-b594-b30abc3ed3d3" Jun 03 22:00:29.967276 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:29.967069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:29.967408 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:29.967287 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-582tg" podUID="d4d176ad-9a2b-473b-bd39-3a91857755e1" Jun 03 22:00:29.967408 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:29.967323 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:00:30.378951 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.378918 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeReady" Jun 03 22:00:30.379125 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.379094 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 22:00:30.423692 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.423653 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xtjwm"] Jun 03 22:00:30.455261 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.455226 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xm9zn"] Jun 03 22:00:30.455410 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.455373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:30.460108 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.460081 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 22:00:30.460255 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.460208 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jdgjb\"" Jun 03 22:00:30.460255 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.460246 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 22:00:30.473231 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.473205 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xtjwm"] Jun 03 22:00:30.473349 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.473246 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xm9zn"] Jun 03 22:00:30.473401 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.473340 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xm9zn" Jun 03 22:00:30.476143 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.476123 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 22:00:30.477109 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.477085 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 22:00:30.477109 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.477104 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 22:00:30.477521 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.477504 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ckdjp\"" Jun 03 22:00:30.561269 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.561232 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d4e60f-af44-4ecd-9436-9cc2cea58767-tmp-dir\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:30.561269 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.561278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1d4e60f-af44-4ecd-9436-9cc2cea58767-config-volume\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:30.561484 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.561306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:30.561484 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.561374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4nsx\" (UniqueName: \"kubernetes.io/projected/d1d4e60f-af44-4ecd-9436-9cc2cea58767-kube-api-access-g4nsx\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:30.561484 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.561465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9db704ae-7d04-41da-825d-5a8db00b8fb8-cert\") pod \"ingress-canary-xm9zn\" (UID: \"9db704ae-7d04-41da-825d-5a8db00b8fb8\") " pod="openshift-ingress-canary/ingress-canary-xm9zn" Jun 03 22:00:30.561581 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.561502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfnbm\" (UniqueName: \"kubernetes.io/projected/9db704ae-7d04-41da-825d-5a8db00b8fb8-kube-api-access-cfnbm\") pod \"ingress-canary-xm9zn\" (UID: \"9db704ae-7d04-41da-825d-5a8db00b8fb8\") " pod="openshift-ingress-canary/ingress-canary-xm9zn" Jun 03 22:00:30.613488 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.613431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:30.662401 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.662359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d4e60f-af44-4ecd-9436-9cc2cea58767-tmp-dir\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:30.662555 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.662412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1d4e60f-af44-4ecd-9436-9cc2cea58767-config-volume\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:30.662607 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.662557 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:30.662665 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.662633 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4nsx\" (UniqueName: \"kubernetes.io/projected/d1d4e60f-af44-4ecd-9436-9cc2cea58767-kube-api-access-g4nsx\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:30.662713 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.662685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9db704ae-7d04-41da-825d-5a8db00b8fb8-cert\") pod \"ingress-canary-xm9zn\" (UID: \"9db704ae-7d04-41da-825d-5a8db00b8fb8\") " pod="openshift-ingress-canary/ingress-canary-xm9zn" Jun 03 22:00:30.662761 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.662710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfnbm\" (UniqueName: \"kubernetes.io/projected/9db704ae-7d04-41da-825d-5a8db00b8fb8-kube-api-access-cfnbm\") pod \"ingress-canary-xm9zn\" (UID: \"9db704ae-7d04-41da-825d-5a8db00b8fb8\") " pod="openshift-ingress-canary/ingress-canary-xm9zn" Jun 03 22:00:30.662761 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.662725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d4e60f-af44-4ecd-9436-9cc2cea58767-tmp-dir\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:30.662850 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:30.662823 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:00:30.662904 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:30.662892 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls podName:d1d4e60f-af44-4ecd-9436-9cc2cea58767 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:31.162874867 +0000 UTC m=+34.637755974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls") pod "dns-default-xtjwm" (UID: "d1d4e60f-af44-4ecd-9436-9cc2cea58767") : secret "dns-default-metrics-tls" not found Jun 03 22:00:30.663094 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.663070 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1d4e60f-af44-4ecd-9436-9cc2cea58767-config-volume\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:30.667371 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.667347 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9db704ae-7d04-41da-825d-5a8db00b8fb8-cert\") pod \"ingress-canary-xm9zn\" (UID: \"9db704ae-7d04-41da-825d-5a8db00b8fb8\") " pod="openshift-ingress-canary/ingress-canary-xm9zn" Jun 03 22:00:30.671276 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.671247 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfnbm\" (UniqueName: \"kubernetes.io/projected/9db704ae-7d04-41da-825d-5a8db00b8fb8-kube-api-access-cfnbm\") pod \"ingress-canary-xm9zn\" (UID: \"9db704ae-7d04-41da-825d-5a8db00b8fb8\") " pod="openshift-ingress-canary/ingress-canary-xm9zn" Jun 03 22:00:30.671357 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.671274 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4nsx\" (UniqueName: \"kubernetes.io/projected/d1d4e60f-af44-4ecd-9436-9cc2cea58767-kube-api-access-g4nsx\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:30.714222 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.714183 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:30.782390 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:30.782347 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xm9zn" Jun 03 22:00:31.166295 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:31.165782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:31.166295 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:31.165921 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:00:31.166295 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:31.165990 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls podName:d1d4e60f-af44-4ecd-9436-9cc2cea58767 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:32.165970731 +0000 UTC m=+35.640851841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls") pod "dns-default-xtjwm" (UID: "d1d4e60f-af44-4ecd-9436-9cc2cea58767") : secret "dns-default-metrics-tls" not found Jun 03 22:00:31.260149 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:31.260111 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xm9zn"] Jun 03 22:00:31.265167 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:00:31.265142 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db704ae_7d04_41da_825d_5a8db00b8fb8.slice/crio-be996462d93975b89885119b0903e2407a74663a7f2694a5b3b0ccd8bd8d4823 WatchSource:0}: Error finding container be996462d93975b89885119b0903e2407a74663a7f2694a5b3b0ccd8bd8d4823: Status 404 returned error can't find the container with id be996462d93975b89885119b0903e2407a74663a7f2694a5b3b0ccd8bd8d4823 Jun 03 22:00:31.967292 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:31.967212 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:00:31.967292 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:31.967242 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:00:31.967292 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:31.967248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:00:31.970675 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:31.970652 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 22:00:31.970797 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:31.970652 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 22:00:31.970797 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:31.970658 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 22:00:31.970939 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:31.970918 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z6v52\"" Jun 03 22:00:31.970939 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:31.970923 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gghsx\"" Jun 03 22:00:31.971100 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:31.971010 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 22:00:32.174332 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:32.174289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:32.174506 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:32.174419 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:00:32.174506 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:32.174478 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls podName:d1d4e60f-af44-4ecd-9436-9cc2cea58767 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:34.174461138 +0000 UTC m=+37.649342243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls") pod "dns-default-xtjwm" (UID: "d1d4e60f-af44-4ecd-9436-9cc2cea58767") : secret "dns-default-metrics-tls" not found Jun 03 22:00:32.239860 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:32.239780 2578 generic.go:356] "Generic (PLEG): container finished" podID="c3e06f1b-89bb-4bfa-8e12-3f252e64f255" containerID="0f074f8be21831a01062410a4837132808d7e544c67d6908bd9030b75b6c9bc0" exitCode=0 Jun 03 22:00:32.240030 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:32.239855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6qb8" event={"ID":"c3e06f1b-89bb-4bfa-8e12-3f252e64f255","Type":"ContainerDied","Data":"0f074f8be21831a01062410a4837132808d7e544c67d6908bd9030b75b6c9bc0"} Jun 03 22:00:32.241125 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:32.241099 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xm9zn" event={"ID":"9db704ae-7d04-41da-825d-5a8db00b8fb8","Type":"ContainerStarted","Data":"be996462d93975b89885119b0903e2407a74663a7f2694a5b3b0ccd8bd8d4823"} Jun 03 22:00:33.246291 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:33.246114 2578 generic.go:356] "Generic (PLEG): container finished" podID="c3e06f1b-89bb-4bfa-8e12-3f252e64f255" containerID="0b6cf0413c46b41f4be3c70824ac38b0ddfaf7f789dde00f93cc26465450b62a" exitCode=0 Jun 03 22:00:33.246781 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:33.246193 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6qb8" event={"ID":"c3e06f1b-89bb-4bfa-8e12-3f252e64f255","Type":"ContainerDied","Data":"0b6cf0413c46b41f4be3c70824ac38b0ddfaf7f789dde00f93cc26465450b62a"} Jun 03 22:00:33.247808 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:33.247784 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xm9zn" event={"ID":"9db704ae-7d04-41da-825d-5a8db00b8fb8","Type":"ContainerStarted","Data":"af87a5dfd9ba56bc118c77167629381037df7404c9960223554b43418136da4b"} Jun 03 22:00:33.282125 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:33.282073 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xm9zn" podStartSLOduration=1.591249438 podStartE2EDuration="3.282037845s" totalImagesPullingTime="1.690788407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:33.28138913 +0000 UTC m=+36.756270257" watchObservedRunningTime="2026-06-03 22:00:33.282037845 +0000 UTC m=+36.756918973" Jun 03 22:00:33.812783 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:33.812749 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:33.914517 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:33.914482 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:34.189684 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:34.189643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:34.189819 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:34.189803 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:00:34.189918 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:34.189906 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls podName:d1d4e60f-af44-4ecd-9436-9cc2cea58767 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:38.189889271 +0000 UTC m=+41.664770377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls") pod "dns-default-xtjwm" (UID: "d1d4e60f-af44-4ecd-9436-9cc2cea58767") : secret "dns-default-metrics-tls" not found Jun 03 22:00:34.253550 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:34.253513 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6qb8" event={"ID":"c3e06f1b-89bb-4bfa-8e12-3f252e64f255","Type":"ContainerStarted","Data":"3dedf0a55451187a86870453b50b39191d5419272eea11553ef975d0915113b1"} Jun 03 22:00:34.280120 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:34.280066 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n6qb8" podStartSLOduration=8.482503506 podStartE2EDuration="37.280033876s" totalImagesPullingTime="28.79753037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:34.278654361 +0000 UTC m=+37.753535488" watchObservedRunningTime="2026-06-03 22:00:34.280033876 +0000 UTC m=+37.754915001" Jun 03 22:00:34.414791 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:34.414759 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:34.506627 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:34.506551 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:36.119260 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:36.119175 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:36.218865 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:36.218826 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:38.216985 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:38.216947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:38.217469 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:38.217108 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:00:38.217469 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:38.217169 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls podName:d1d4e60f-af44-4ecd-9436-9cc2cea58767 nodeName:}" failed. No retries permitted until 2026-06-03 22:00:46.217152339 +0000 UTC m=+49.692033442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls") pod "dns-default-xtjwm" (UID: "d1d4e60f-af44-4ecd-9436-9cc2cea58767") : secret "dns-default-metrics-tls" not found Jun 03 22:00:40.794715 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:40.794683 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:40.860165 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:40.860132 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:44.495067 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:44.495002 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:44.546278 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:44.546238 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:45.617564 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:45.617527 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:45.685925 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:45.685894 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:46.273797 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:46.273762 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:00:46.273965 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:46.273880 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:00:46.273965 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:00:46.273946 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls podName:d1d4e60f-af44-4ecd-9436-9cc2cea58767 nodeName:}" failed. No retries permitted until 2026-06-03 22:01:02.273931517 +0000 UTC m=+65.748812622 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls") pod "dns-default-xtjwm" (UID: "d1d4e60f-af44-4ecd-9436-9cc2cea58767") : secret "dns-default-metrics-tls" not found Jun 03 22:00:49.301712 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:49.301678 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:49.353964 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:49.353914 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:58.238726 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:58.238696 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-46r9m" Jun 03 22:00:58.389331 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:58.389301 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:00:58.440541 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:00:58.440506 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:01:01.686144 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:01.686089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:01:01.686550 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:01.686160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:01:01.688508 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:01.688485 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 22:01:01.688624 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:01.688494 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 22:01:01.696521 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:01:01.696497 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 22:01:01.696596 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:01:01.696579 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs podName:bc891b78-9de2-441d-9e93-86bcded1ab6e nodeName:}" failed. No retries permitted until 2026-06-03 22:02:05.69656088 +0000 UTC m=+129.171441985 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs") pod "network-metrics-daemon-4wpm2" (UID: "bc891b78-9de2-441d-9e93-86bcded1ab6e") : secret "metrics-daemon-secret" not found Jun 03 22:01:01.699769 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:01.699747 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d176ad-9a2b-473b-bd39-3a91857755e1-original-pull-secret\") pod \"global-pull-secret-syncer-582tg\" (UID: \"d4d176ad-9a2b-473b-bd39-3a91857755e1\") " pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:01:01.887587 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:01.887554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htjm5\" (UniqueName: \"kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5\") pod \"network-check-target-97gxk\" (UID: \"027116fa-8b61-40cb-b594-b30abc3ed3d3\") " pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:01:01.890473 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:01.890453 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 22:01:01.900287 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:01.900270 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 22:01:01.910624 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:01.910606 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htjm5\" (UniqueName: \"kubernetes.io/projected/027116fa-8b61-40cb-b594-b30abc3ed3d3-kube-api-access-htjm5\") pod \"network-check-target-97gxk\" (UID: \"027116fa-8b61-40cb-b594-b30abc3ed3d3\") " pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:01:01.979410 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:01.979322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-582tg" Jun 03 22:01:01.994800 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:01.994775 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gghsx\"" Jun 03 22:01:02.002924 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:02.002894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:01:02.108967 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:02.108933 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-582tg"] Jun 03 22:01:02.112104 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:01:02.112076 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d176ad_9a2b_473b_bd39_3a91857755e1.slice/crio-0461eb4377c16573668933260274bdf67cdc428013e78d92fed1a80c92dd910b WatchSource:0}: Error finding container 0461eb4377c16573668933260274bdf67cdc428013e78d92fed1a80c92dd910b: Status 404 returned error can't find the container with id 0461eb4377c16573668933260274bdf67cdc428013e78d92fed1a80c92dd910b Jun 03 22:01:02.132541 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:02.132515 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-97gxk"] Jun 03 22:01:02.135204 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:01:02.135181 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027116fa_8b61_40cb_b594_b30abc3ed3d3.slice/crio-5bfc71b1a5b53265bd1100751132a393cd2a4fd1dd724cf42e07db7368759d91 WatchSource:0}: Error finding container 5bfc71b1a5b53265bd1100751132a393cd2a4fd1dd724cf42e07db7368759d91: Status 404 returned error can't find the container with id 5bfc71b1a5b53265bd1100751132a393cd2a4fd1dd724cf42e07db7368759d91 Jun 03 22:01:02.290599 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:02.290529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:01:02.290742 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:01:02.290650 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:01:02.290742 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:01:02.290713 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls podName:d1d4e60f-af44-4ecd-9436-9cc2cea58767 nodeName:}" failed. No retries permitted until 2026-06-03 22:01:34.290697899 +0000 UTC m=+97.765579003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls") pod "dns-default-xtjwm" (UID: "d1d4e60f-af44-4ecd-9436-9cc2cea58767") : secret "dns-default-metrics-tls" not found Jun 03 22:01:02.317682 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:02.317639 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-97gxk" event={"ID":"027116fa-8b61-40cb-b594-b30abc3ed3d3","Type":"ContainerStarted","Data":"5bfc71b1a5b53265bd1100751132a393cd2a4fd1dd724cf42e07db7368759d91"} Jun 03 22:01:02.318658 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:02.318639 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-582tg" event={"ID":"d4d176ad-9a2b-473b-bd39-3a91857755e1","Type":"ContainerStarted","Data":"0461eb4377c16573668933260274bdf67cdc428013e78d92fed1a80c92dd910b"} Jun 03 22:01:04.360113 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.360081 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5"] Jun 03 22:01:04.399903 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.395938 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5"] Jun 03 22:01:04.399903 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.396086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.400150 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.400095 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 22:01:04.400150 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.400106 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 22:01:04.400255 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.400165 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 22:01:04.402929 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.402613 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 22:01:04.402929 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.402818 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 22:01:04.403117 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.402936 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 22:01:04.403117 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.403028 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 22:01:04.507806 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.507761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c337ed3-85de-4869-9ffe-70aa635649b5-ca\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.507968 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.507815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5c337ed3-85de-4869-9ffe-70aa635649b5-hub\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.507968 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.507911 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c337ed3-85de-4869-9ffe-70aa635649b5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.507968 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.507955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5c337ed3-85de-4869-9ffe-70aa635649b5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.508200 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.508030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c337ed3-85de-4869-9ffe-70aa635649b5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.508200 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.508080 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ss9p\" (UniqueName: \"kubernetes.io/projected/5c337ed3-85de-4869-9ffe-70aa635649b5-kube-api-access-4ss9p\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.608767 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.608727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c337ed3-85de-4869-9ffe-70aa635649b5-ca\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.608767 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.608773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5c337ed3-85de-4869-9ffe-70aa635649b5-hub\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.608971 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.608813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c337ed3-85de-4869-9ffe-70aa635649b5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.608971 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.608839 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5c337ed3-85de-4869-9ffe-70aa635649b5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.608971 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.608882 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c337ed3-85de-4869-9ffe-70aa635649b5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.608971 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.608911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ss9p\" (UniqueName: \"kubernetes.io/projected/5c337ed3-85de-4869-9ffe-70aa635649b5-kube-api-access-4ss9p\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.610159 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.610089 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c337ed3-85de-4869-9ffe-70aa635649b5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.612333 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.612304 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c337ed3-85de-4869-9ffe-70aa635649b5-ca\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.612333 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.612322 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5c337ed3-85de-4869-9ffe-70aa635649b5-hub\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.612539 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.612507 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c337ed3-85de-4869-9ffe-70aa635649b5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.612769 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.612742 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5c337ed3-85de-4869-9ffe-70aa635649b5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.618008 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.617983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ss9p\" (UniqueName: \"kubernetes.io/projected/5c337ed3-85de-4869-9ffe-70aa635649b5-kube-api-access-4ss9p\") pod \"cluster-proxy-proxy-agent-6ccd6bdd44-j52l5\" (UID: \"5c337ed3-85de-4869-9ffe-70aa635649b5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:04.718976 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:04.718939 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:01:05.441196 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:05.441157 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:01:05.541455 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:05.541420 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:01:05.597923 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:05.597869 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:01:06.806701 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:06.806644 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5"] Jun 03 22:01:06.811537 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:01:06.811507 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c337ed3_85de_4869_9ffe_70aa635649b5.slice/crio-935bacd856c0970dd904209d4803c0a495d5fb040527867fe4df8da2a22f67c6 WatchSource:0}: Error finding container 935bacd856c0970dd904209d4803c0a495d5fb040527867fe4df8da2a22f67c6: Status 404 returned error can't find the container with id 935bacd856c0970dd904209d4803c0a495d5fb040527867fe4df8da2a22f67c6 Jun 03 22:01:07.335029 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:07.334988 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-97gxk" event={"ID":"027116fa-8b61-40cb-b594-b30abc3ed3d3","Type":"ContainerStarted","Data":"da50feb7745b84b00007af1a681a8c089c77d9e45c8a1e7c5730e350db0d93aa"} Jun 03 22:01:07.335250 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:07.335108 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:01:07.336212 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:07.336178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" event={"ID":"5c337ed3-85de-4869-9ffe-70aa635649b5","Type":"ContainerStarted","Data":"935bacd856c0970dd904209d4803c0a495d5fb040527867fe4df8da2a22f67c6"} Jun 03 22:01:07.337422 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:07.337402 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-582tg" event={"ID":"d4d176ad-9a2b-473b-bd39-3a91857755e1","Type":"ContainerStarted","Data":"5094b6053f348958e52de366ce73f0601a449717b958d07ff62b641811c4c64a"} Jun 03 22:01:07.351569 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:07.351520 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-97gxk" podStartSLOduration=65.825818772 podStartE2EDuration="1m10.351506357s" totalImagesPullingTime="4.525687585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:01:07.350804677 +0000 UTC m=+70.825685803" watchObservedRunningTime="2026-06-03 22:01:07.351506357 +0000 UTC m=+70.826387483" Jun 03 22:01:07.366211 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:07.366166 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-582tg" podStartSLOduration=65.807339555 podStartE2EDuration="1m10.366152221s" totalImagesPullingTime="4.558812666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:01:07.365685561 +0000 UTC m=+70.840566688" watchObservedRunningTime="2026-06-03 22:01:07.366152221 +0000 UTC m=+70.841033386" Jun 03 22:01:11.351248 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:11.351209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" event={"ID":"5c337ed3-85de-4869-9ffe-70aa635649b5","Type":"ContainerStarted","Data":"11283925673c261865c07dd8f46771a1b3ad0807fb0b277cb6dcb1eafebfaf1d"} Jun 03 22:01:11.351248 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:11.351253 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" event={"ID":"5c337ed3-85de-4869-9ffe-70aa635649b5","Type":"ContainerStarted","Data":"0320b5c17c7dabb1f2d6414f0fc73d656d242b74b4b010f6f83d3dbca5bd2ee0"} Jun 03 22:01:11.351669 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:11.351267 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" event={"ID":"5c337ed3-85de-4869-9ffe-70aa635649b5","Type":"ContainerStarted","Data":"c179bd4a0c9676abec0aecbb5318ef3751e11f848d2ec35ac554035cc66c5c1f"} Jun 03 22:01:11.370680 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:11.370634 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" podStartSLOduration=3.550117416 podStartE2EDuration="7.370621587s" totalImagesPullingTime="3.820504171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:01:11.369589916 +0000 UTC m=+74.844471042" watchObservedRunningTime="2026-06-03 22:01:11.370621587 +0000 UTC m=+74.845502712" Jun 03 22:01:34.322475 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:34.322424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:01:34.322969 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:01:34.322560 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:01:34.322969 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:01:34.322623 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls podName:d1d4e60f-af44-4ecd-9436-9cc2cea58767 nodeName:}" failed. No retries permitted until 2026-06-03 22:02:38.322609321 +0000 UTC m=+161.797490424 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls") pod "dns-default-xtjwm" (UID: "d1d4e60f-af44-4ecd-9436-9cc2cea58767") : secret "dns-default-metrics-tls" not found Jun 03 22:01:38.344880 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:01:38.344849 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-97gxk" Jun 03 22:02:05.740266 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:02:05.740225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:02:05.740748 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:02:05.740338 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 22:02:05.740748 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:02:05.740402 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs podName:bc891b78-9de2-441d-9e93-86bcded1ab6e nodeName:}" failed. No retries permitted until 2026-06-03 22:04:07.740387951 +0000 UTC m=+251.215269054 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs") pod "network-metrics-daemon-4wpm2" (UID: "bc891b78-9de2-441d-9e93-86bcded1ab6e") : secret "metrics-daemon-secret" not found Jun 03 22:02:33.467369 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:02:33.467322 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xtjwm" podUID="d1d4e60f-af44-4ecd-9436-9cc2cea58767" Jun 03 22:02:33.581622 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:02:33.581594 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xtjwm" Jun 03 22:02:34.987178 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:02:34.987133 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:02:38.349025 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:02:38.348946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:02:38.349496 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:02:38.349122 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 22:02:38.349496 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:02:38.349200 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls podName:d1d4e60f-af44-4ecd-9436-9cc2cea58767 nodeName:}" failed. No retries permitted until 2026-06-03 22:04:40.349178486 +0000 UTC m=+283.824059592 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls") pod "dns-default-xtjwm" (UID: "d1d4e60f-af44-4ecd-9436-9cc2cea58767") : secret "dns-default-metrics-tls" not found Jun 03 22:02:46.968922 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:02:46.968877 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:03:39.690339 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:03:39.690302 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:07.766479 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:07.766384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:04:07.766988 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:04:07.766527 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 22:04:07.766988 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:04:07.766621 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs podName:bc891b78-9de2-441d-9e93-86bcded1ab6e nodeName:}" failed. No retries permitted until 2026-06-03 22:06:09.766596131 +0000 UTC m=+373.241477250 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs") pod "network-metrics-daemon-4wpm2" (UID: "bc891b78-9de2-441d-9e93-86bcded1ab6e") : secret "metrics-daemon-secret" not found Jun 03 22:04:16.345617 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:16.345582 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:16.447160 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:16.447131 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:18.900207 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:18.900171 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:18.999669 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:18.999639 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:20.307383 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:20.307348 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:20.439565 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:20.439539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:20.504742 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:20.504714 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:20.876072 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:20.876024 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:20.944398 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:20.944369 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:21.069300 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:21.069267 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:21.167251 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:21.167221 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:21.267636 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:21.267603 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:22.427848 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.427824 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w2kgw_513cb310-b56c-4ff7-bb64-11b039711b95/dns-node-resolver/0.log" Jun 03 22:04:22.745040 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.744961 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-sc5tr"] Jun 03 22:04:22.746823 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.746808 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" Jun 03 22:04:22.749343 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.749326 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 22:04:22.749538 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.749524 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 22:04:22.750134 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.750114 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 22:04:22.750247 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.750119 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5qv8n\"" Jun 03 22:04:22.750247 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.750165 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 22:04:22.757265 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.757240 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-sc5tr"] Jun 03 22:04:22.770280 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.770254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/77493ae6-0d47-4de0-976b-df1528a275d9-signing-cabundle\") pod \"service-ca-7d74d578b8-sc5tr\" (UID: \"77493ae6-0d47-4de0-976b-df1528a275d9\") " pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" Jun 03 22:04:22.770377 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.770296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnzdr\" (UniqueName: \"kubernetes.io/projected/77493ae6-0d47-4de0-976b-df1528a275d9-kube-api-access-qnzdr\") pod \"service-ca-7d74d578b8-sc5tr\" (UID: \"77493ae6-0d47-4de0-976b-df1528a275d9\") " pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" Jun 03 22:04:22.770419 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.770380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/77493ae6-0d47-4de0-976b-df1528a275d9-signing-key\") pod \"service-ca-7d74d578b8-sc5tr\" (UID: \"77493ae6-0d47-4de0-976b-df1528a275d9\") " pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" Jun 03 22:04:22.785040 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.785012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:22.849731 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.849696 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:22.871422 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.871394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/77493ae6-0d47-4de0-976b-df1528a275d9-signing-key\") pod \"service-ca-7d74d578b8-sc5tr\" (UID: \"77493ae6-0d47-4de0-976b-df1528a275d9\") " pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" Jun 03 22:04:22.871520 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.871427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/77493ae6-0d47-4de0-976b-df1528a275d9-signing-cabundle\") pod \"service-ca-7d74d578b8-sc5tr\" (UID: \"77493ae6-0d47-4de0-976b-df1528a275d9\") " pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" Jun 03 22:04:22.871520 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.871458 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzdr\" (UniqueName: \"kubernetes.io/projected/77493ae6-0d47-4de0-976b-df1528a275d9-kube-api-access-qnzdr\") pod \"service-ca-7d74d578b8-sc5tr\" (UID: \"77493ae6-0d47-4de0-976b-df1528a275d9\") " pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" Jun 03 22:04:22.872029 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.872008 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/77493ae6-0d47-4de0-976b-df1528a275d9-signing-cabundle\") pod \"service-ca-7d74d578b8-sc5tr\" (UID: \"77493ae6-0d47-4de0-976b-df1528a275d9\") " pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" Jun 03 22:04:22.873893 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.873872 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/77493ae6-0d47-4de0-976b-df1528a275d9-signing-key\") pod \"service-ca-7d74d578b8-sc5tr\" (UID: \"77493ae6-0d47-4de0-976b-df1528a275d9\") " pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" Jun 03 22:04:22.880035 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:22.880012 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnzdr\" (UniqueName: \"kubernetes.io/projected/77493ae6-0d47-4de0-976b-df1528a275d9-kube-api-access-qnzdr\") pod \"service-ca-7d74d578b8-sc5tr\" (UID: \"77493ae6-0d47-4de0-976b-df1528a275d9\") " pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" Jun 03 22:04:23.060101 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:23.060003 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" Jun 03 22:04:23.066952 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:23.066924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:23.132592 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:23.132553 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:23.181204 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:23.181174 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-sc5tr"] Jun 03 22:04:23.184478 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:04:23.184449 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77493ae6_0d47_4de0_976b_df1528a275d9.slice/crio-9b9d515d4acef30f350ac81f8083b05b29dcfae0b49ac71397c04e502dc5d35c WatchSource:0}: Error finding container 9b9d515d4acef30f350ac81f8083b05b29dcfae0b49ac71397c04e502dc5d35c: Status 404 returned error can't find the container with id 9b9d515d4acef30f350ac81f8083b05b29dcfae0b49ac71397c04e502dc5d35c Jun 03 22:04:23.427616 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:23.427590 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tvm2z_aee1e2a7-6e76-4a8e-9890-183c5b4be52e/node-ca/0.log" Jun 03 22:04:23.822895 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:23.822799 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:23.892364 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:23.892329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" event={"ID":"77493ae6-0d47-4de0-976b-df1528a275d9","Type":"ContainerStarted","Data":"9b9d515d4acef30f350ac81f8083b05b29dcfae0b49ac71397c04e502dc5d35c"} Jun 03 22:04:24.229640 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:24.229609 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xm9zn_9db704ae-7d04-41da-825d-5a8db00b8fb8/serve-healthcheck-canary/0.log" Jun 03 22:04:25.521416 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:25.521385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:25.900785 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:25.900702 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" event={"ID":"77493ae6-0d47-4de0-976b-df1528a275d9","Type":"ContainerStarted","Data":"bd4964dd239912c4faffca44105dcefc4387d486531d64a73c10abd8f03ca1e3"} Jun 03 22:04:25.919157 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:25.919107 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-sc5tr" podStartSLOduration=2.156318965 podStartE2EDuration="3.919092054s" totalImagesPullingTime="1.762773089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:04:25.918278429 +0000 UTC m=+269.393159555" watchObservedRunningTime="2026-06-03 22:04:25.919092054 +0000 UTC m=+269.393973180" Jun 03 22:04:26.624306 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:26.624264 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:26.725450 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:26.725411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:26.825202 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:26.825170 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:26.926966 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:26.926908 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:27.037505 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:27.037461 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:27.593992 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:27.593950 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:27.735768 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:27.735725 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:28.329164 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:28.329129 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:28.530505 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:28.530472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:28.756925 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:28.756893 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:29.130101 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:29.129999 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:29.725405 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:29.725370 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:30.119767 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:30.119686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:30.533901 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:30.533874 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:30.633752 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:30.633721 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:30.733947 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:30.733917 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:30.796295 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:30.796219 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:31.328407 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:31.328374 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:31.755571 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:31.755539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:32.118996 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:32.118911 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:32.318586 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:32.318551 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:32.723005 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:32.722973 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:32.991207 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:32.991115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:33.123418 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:33.123391 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:33.315901 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:33.315803 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:33.743196 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:33.743166 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:33.842151 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:33.842122 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:33.942000 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:33.941967 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:34.319294 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:34.319245 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:34.516696 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:34.516655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:34.917260 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:34.917228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:35.130676 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:35.130645 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:35.258441 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:35.258343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:35.516089 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:35.515985 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:35.945244 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:35.945209 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:36.529703 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:36.529670 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:36.583038 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:04:36.583004 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xtjwm" podUID="d1d4e60f-af44-4ecd-9436-9cc2cea58767" Jun 03 22:04:36.924770 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:36.924732 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:36.931657 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:36.931637 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xtjwm" Jun 03 22:04:37.119659 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:37.119629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:37.347170 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:37.346988 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:40.401850 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:40.401814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:04:40.404258 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:40.404232 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1d4e60f-af44-4ecd-9436-9cc2cea58767-metrics-tls\") pod \"dns-default-xtjwm\" (UID: \"d1d4e60f-af44-4ecd-9436-9cc2cea58767\") " pod="openshift-dns/dns-default-xtjwm" Jun 03 22:04:40.534904 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:40.534871 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jdgjb\"" Jun 03 22:04:40.542934 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:40.542914 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xtjwm" Jun 03 22:04:40.668784 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:40.668740 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xtjwm"] Jun 03 22:04:40.671789 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:04:40.671762 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d4e60f_af44_4ecd_9436_9cc2cea58767.slice/crio-255406e364022a8a7d72c046cd78bd23bcdf978729d22f87972b39ea2c585fde WatchSource:0}: Error finding container 255406e364022a8a7d72c046cd78bd23bcdf978729d22f87972b39ea2c585fde: Status 404 returned error can't find the container with id 255406e364022a8a7d72c046cd78bd23bcdf978729d22f87972b39ea2c585fde Jun 03 22:04:40.943623 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:40.943535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xtjwm" event={"ID":"d1d4e60f-af44-4ecd-9436-9cc2cea58767","Type":"ContainerStarted","Data":"255406e364022a8a7d72c046cd78bd23bcdf978729d22f87972b39ea2c585fde"} Jun 03 22:04:42.950889 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:42.950852 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xtjwm" event={"ID":"d1d4e60f-af44-4ecd-9436-9cc2cea58767","Type":"ContainerStarted","Data":"1ca2a0376d33879a334928550ecf9cc38794a508881475e0f8f92fefd32a0631"} Jun 03 22:04:42.951295 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:42.950902 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xtjwm" event={"ID":"d1d4e60f-af44-4ecd-9436-9cc2cea58767","Type":"ContainerStarted","Data":"17a02b27bc95cc8752c821de7d90e7b26e7c3014e4eb731029a1aa33bc998e36"} Jun 03 22:04:42.951295 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:42.950984 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xtjwm" Jun 03 22:04:42.969952 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:42.969907 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xtjwm" podStartSLOduration=251.39916163 podStartE2EDuration="4m12.969892418s" totalImagesPullingTime="1.570730788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:04:42.969863586 +0000 UTC m=+286.444744714" watchObservedRunningTime="2026-06-03 22:04:42.969892418 +0000 UTC m=+286.444773537" Jun 03 22:04:43.178709 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.178674 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cq2fx"] Jun 03 22:04:43.180780 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.180762 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.183255 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.183173 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 22:04:43.183388 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.183292 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 22:04:43.183388 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.183312 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bb4dc\"" Jun 03 22:04:43.183388 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.183313 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 22:04:43.183388 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.183292 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 22:04:43.197499 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.197477 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cq2fx"] Jun 03 22:04:43.219731 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.219667 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7954f7bdbb-hrp58"] Jun 03 22:04:43.222744 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.222716 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.225333 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.225312 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rb8dk\"" Jun 03 22:04:43.225695 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.225672 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 22:04:43.225812 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.225792 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 22:04:43.225929 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.225914 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 22:04:43.231594 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.231576 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 22:04:43.241351 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.241328 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7954f7bdbb-hrp58"] Jun 03 22:04:43.293112 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.293081 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:43.325485 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a1a20fe-2905-4c96-9319-60159efb2d0e-trusted-ca\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.325633 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/107dea25-c6b1-48cd-80bc-5145bcfe80f3-crio-socket\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.325633 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/107dea25-c6b1-48cd-80bc-5145bcfe80f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.325633 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a1a20fe-2905-4c96-9319-60159efb2d0e-registry-tls\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.325633 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgznr\" (UniqueName: \"kubernetes.io/projected/107dea25-c6b1-48cd-80bc-5145bcfe80f3-kube-api-access-dgznr\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.325633 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a1a20fe-2905-4c96-9319-60159efb2d0e-installation-pull-secrets\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.325811 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325654 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/107dea25-c6b1-48cd-80bc-5145bcfe80f3-data-volume\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.325811 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a1a20fe-2905-4c96-9319-60159efb2d0e-ca-trust-extracted\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.325811 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/107dea25-c6b1-48cd-80bc-5145bcfe80f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.325811 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a1a20fe-2905-4c96-9319-60159efb2d0e-registry-certificates\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.325811 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a1a20fe-2905-4c96-9319-60159efb2d0e-bound-sa-token\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.325811 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln5wn\" (UniqueName: \"kubernetes.io/projected/2a1a20fe-2905-4c96-9319-60159efb2d0e-kube-api-access-ln5wn\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.325988 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.325814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a1a20fe-2905-4c96-9319-60159efb2d0e-image-registry-private-configuration\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.393359 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.393305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:43.427068 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427019 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a1a20fe-2905-4c96-9319-60159efb2d0e-installation-pull-secrets\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.427212 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/107dea25-c6b1-48cd-80bc-5145bcfe80f3-data-volume\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.427212 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a1a20fe-2905-4c96-9319-60159efb2d0e-ca-trust-extracted\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.427212 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/107dea25-c6b1-48cd-80bc-5145bcfe80f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.427212 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a1a20fe-2905-4c96-9319-60159efb2d0e-registry-certificates\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.427212 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a1a20fe-2905-4c96-9319-60159efb2d0e-bound-sa-token\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.427212 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427203 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln5wn\" (UniqueName: \"kubernetes.io/projected/2a1a20fe-2905-4c96-9319-60159efb2d0e-kube-api-access-ln5wn\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.427507 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a1a20fe-2905-4c96-9319-60159efb2d0e-image-registry-private-configuration\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.427507 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a1a20fe-2905-4c96-9319-60159efb2d0e-trusted-ca\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.427507 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/107dea25-c6b1-48cd-80bc-5145bcfe80f3-crio-socket\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.427507 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427479 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/107dea25-c6b1-48cd-80bc-5145bcfe80f3-data-volume\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.427704 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427540 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a1a20fe-2905-4c96-9319-60159efb2d0e-ca-trust-extracted\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.427704 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427563 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/107dea25-c6b1-48cd-80bc-5145bcfe80f3-crio-socket\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.427704 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/107dea25-c6b1-48cd-80bc-5145bcfe80f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.427704 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a1a20fe-2905-4c96-9319-60159efb2d0e-registry-tls\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.427704 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427688 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgznr\" (UniqueName: \"kubernetes.io/projected/107dea25-c6b1-48cd-80bc-5145bcfe80f3-kube-api-access-dgznr\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.428084 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.427890 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/107dea25-c6b1-48cd-80bc-5145bcfe80f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.428152 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.428128 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a1a20fe-2905-4c96-9319-60159efb2d0e-registry-certificates\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.428500 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.428456 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a1a20fe-2905-4c96-9319-60159efb2d0e-trusted-ca\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.430036 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.430009 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a1a20fe-2905-4c96-9319-60159efb2d0e-image-registry-private-configuration\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.430141 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.430128 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/107dea25-c6b1-48cd-80bc-5145bcfe80f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.430677 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.430656 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a1a20fe-2905-4c96-9319-60159efb2d0e-installation-pull-secrets\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.430816 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.430796 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a1a20fe-2905-4c96-9319-60159efb2d0e-registry-tls\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.438637 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.438616 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a1a20fe-2905-4c96-9319-60159efb2d0e-bound-sa-token\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.439515 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.439496 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln5wn\" (UniqueName: \"kubernetes.io/projected/2a1a20fe-2905-4c96-9319-60159efb2d0e-kube-api-access-ln5wn\") pod \"image-registry-7954f7bdbb-hrp58\" (UID: \"2a1a20fe-2905-4c96-9319-60159efb2d0e\") " pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.439837 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.439816 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgznr\" (UniqueName: \"kubernetes.io/projected/107dea25-c6b1-48cd-80bc-5145bcfe80f3-kube-api-access-dgznr\") pod \"insights-runtime-extractor-cq2fx\" (UID: \"107dea25-c6b1-48cd-80bc-5145bcfe80f3\") " pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.489343 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.489268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cq2fx" Jun 03 22:04:43.532990 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.532957 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.623476 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.623388 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cq2fx"] Jun 03 22:04:43.627743 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:04:43.627716 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107dea25_c6b1_48cd_80bc_5145bcfe80f3.slice/crio-6564cccfac03a4cb3f8fcdf0fb78c8352f156e441e00628d175bb89ff3d11f5f WatchSource:0}: Error finding container 6564cccfac03a4cb3f8fcdf0fb78c8352f156e441e00628d175bb89ff3d11f5f: Status 404 returned error can't find the container with id 6564cccfac03a4cb3f8fcdf0fb78c8352f156e441e00628d175bb89ff3d11f5f Jun 03 22:04:43.685224 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.685198 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7954f7bdbb-hrp58"] Jun 03 22:04:43.688637 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:04:43.688607 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a1a20fe_2905_4c96_9319_60159efb2d0e.slice/crio-6150cd163f9cc8f6512cfff5541a68adfbb8c4331fffb8fae8ff40467a8d4dfa WatchSource:0}: Error finding container 6150cd163f9cc8f6512cfff5541a68adfbb8c4331fffb8fae8ff40467a8d4dfa: Status 404 returned error can't find the container with id 6150cd163f9cc8f6512cfff5541a68adfbb8c4331fffb8fae8ff40467a8d4dfa Jun 03 22:04:43.956504 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.956468 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" event={"ID":"2a1a20fe-2905-4c96-9319-60159efb2d0e","Type":"ContainerStarted","Data":"686f76c2746c6815eb495147f1ba38082fd288611dc0f9d994288e42a1c916c1"} Jun 03 22:04:43.956958 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.956522 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" event={"ID":"2a1a20fe-2905-4c96-9319-60159efb2d0e","Type":"ContainerStarted","Data":"6150cd163f9cc8f6512cfff5541a68adfbb8c4331fffb8fae8ff40467a8d4dfa"} Jun 03 22:04:43.956958 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.956571 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:04:43.958107 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.958081 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cq2fx" event={"ID":"107dea25-c6b1-48cd-80bc-5145bcfe80f3","Type":"ContainerStarted","Data":"e4596583736c79a804898fc6612011a5ea74ad0b3287507444e4b8a114a8b5c0"} Jun 03 22:04:43.958246 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.958128 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cq2fx" event={"ID":"107dea25-c6b1-48cd-80bc-5145bcfe80f3","Type":"ContainerStarted","Data":"6564cccfac03a4cb3f8fcdf0fb78c8352f156e441e00628d175bb89ff3d11f5f"} Jun 03 22:04:43.975751 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:43.975695 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" podStartSLOduration=0.975675112 podStartE2EDuration="975.675112ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:04:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:04:43.974682996 +0000 UTC m=+287.449564123" watchObservedRunningTime="2026-06-03 22:04:43.975675112 +0000 UTC m=+287.450556239" Jun 03 22:04:44.963976 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:44.963936 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cq2fx" event={"ID":"107dea25-c6b1-48cd-80bc-5145bcfe80f3","Type":"ContainerStarted","Data":"2fcf0c6b7c126c229e82f54b55c8029dbda569015e4ef9e1235916609fd10690"} Jun 03 22:04:45.969254 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:45.969219 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cq2fx" event={"ID":"107dea25-c6b1-48cd-80bc-5145bcfe80f3","Type":"ContainerStarted","Data":"0afe6c65f5991c0a0bc89726c4fffc1bc8fd6e6a00022b5fa0f385fbed1a93f9"} Jun 03 22:04:45.991933 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:45.991877 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cq2fx" podStartSLOduration=0.829960792 podStartE2EDuration="2.991861814s" totalImagesPullingTime="2.161901022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:04:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:04:45.990570607 +0000 UTC m=+289.465451733" watchObservedRunningTime="2026-06-03 22:04:45.991861814 +0000 UTC m=+289.466742940" Jun 03 22:04:49.970429 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:04:49.970322 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4wpm2" podUID="bc891b78-9de2-441d-9e93-86bcded1ab6e" Jun 03 22:04:50.694355 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:50.694323 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:51.852365 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:51.852330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:52.961084 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:52.961035 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xtjwm" Jun 03 22:04:54.719942 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:54.719899 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" podUID="5c337ed3-85de-4869-9ffe-70aa635649b5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 22:04:54.872137 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:54.872098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:54.951573 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:54.951544 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:55.099893 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:55.099812 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:55.161938 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:55.161900 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:56.813897 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:56.813863 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:56.895408 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:56.895357 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/ovn-acl-logging/0.log" Jun 03 22:04:56.900610 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:56.900587 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/ovn-acl-logging/0.log" Jun 03 22:04:56.902345 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:56.902325 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 22:04:57.198180 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:57.198148 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:57.258610 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:57.258573 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:58.022288 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.022248 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:58.121259 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.121216 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:58.248365 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.248327 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:58.273531 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.273443 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bqtmw"] Jun 03 22:04:58.276562 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.276539 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.279071 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.279033 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 22:04:58.279494 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.279204 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 22:04:58.279494 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.279106 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 22:04:58.279494 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.279065 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-grkgg\"" Jun 03 22:04:58.279728 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.279597 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 22:04:58.279728 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.279675 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 22:04:58.279993 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.279976 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 22:04:58.378509 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.378475 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:58.443499 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.443459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-wtmp\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.443499 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.443504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3abe68d6-f17f-4e52-9119-8e3509517acf-root\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.443732 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.443540 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-tls\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.443732 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.443573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3abe68d6-f17f-4e52-9119-8e3509517acf-metrics-client-ca\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.443732 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.443612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlf2m\" (UniqueName: \"kubernetes.io/projected/3abe68d6-f17f-4e52-9119-8e3509517acf-kube-api-access-zlf2m\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.443732 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.443631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3abe68d6-f17f-4e52-9119-8e3509517acf-sys\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.443732 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.443695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.443892 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.443767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-textfile\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.443892 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.443801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-accelerators-collector-config\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.478037 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.478003 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:58.545198 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlf2m\" (UniqueName: \"kubernetes.io/projected/3abe68d6-f17f-4e52-9119-8e3509517acf-kube-api-access-zlf2m\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.545198 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545146 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3abe68d6-f17f-4e52-9119-8e3509517acf-sys\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.545198 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.545439 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-textfile\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.545439 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-accelerators-collector-config\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.545439 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-wtmp\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.545439 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3abe68d6-f17f-4e52-9119-8e3509517acf-root\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.545439 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-tls\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.545675 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3abe68d6-f17f-4e52-9119-8e3509517acf-metrics-client-ca\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.545675 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545491 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3abe68d6-f17f-4e52-9119-8e3509517acf-root\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.545675 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545506 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-wtmp\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.545675 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545543 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3abe68d6-f17f-4e52-9119-8e3509517acf-sys\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.545675 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545643 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-textfile\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.546022 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545995 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3abe68d6-f17f-4e52-9119-8e3509517acf-metrics-client-ca\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.546151 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.545997 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-accelerators-collector-config\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.547858 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.547830 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-tls\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.548077 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.548038 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3abe68d6-f17f-4e52-9119-8e3509517acf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.553529 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.553508 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlf2m\" (UniqueName: \"kubernetes.io/projected/3abe68d6-f17f-4e52-9119-8e3509517acf-kube-api-access-zlf2m\") pod \"node-exporter-bqtmw\" (UID: \"3abe68d6-f17f-4e52-9119-8e3509517acf\") " pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.577972 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.577940 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:58.586854 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.586834 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bqtmw" Jun 03 22:04:58.597768 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:04:58.597729 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3abe68d6_f17f_4e52_9119_8e3509517acf.slice/crio-9f69ab45e2eafa3216f65c7ad1e881a5f29f2cb0f96aa3874307abacfc3b3bbb WatchSource:0}: Error finding container 9f69ab45e2eafa3216f65c7ad1e881a5f29f2cb0f96aa3874307abacfc3b3bbb: Status 404 returned error can't find the container with id 9f69ab45e2eafa3216f65c7ad1e881a5f29f2cb0f96aa3874307abacfc3b3bbb Jun 03 22:04:58.600175 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.600156 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 22:04:58.680642 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.680591 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:58.782358 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.782326 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:58.888112 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:58.888005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:59.013150 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.013113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bqtmw" event={"ID":"3abe68d6-f17f-4e52-9119-8e3509517acf","Type":"ContainerStarted","Data":"9f69ab45e2eafa3216f65c7ad1e881a5f29f2cb0f96aa3874307abacfc3b3bbb"} Jun 03 22:04:59.267652 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.267617 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:59.353063 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.353013 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:04:59.359910 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.359880 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:04:59.363839 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.363817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.366205 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.366184 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 22:04:59.366329 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.366186 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hhfp7\"" Jun 03 22:04:59.366657 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.366640 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 22:04:59.366822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.366640 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 22:04:59.366902 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.366824 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 22:04:59.366902 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.366862 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 22:04:59.367643 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.367621 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 22:04:59.367855 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.367836 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 22:04:59.367916 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.367869 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 22:04:59.370319 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.368209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 22:04:59.382677 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.382650 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:04:59.454163 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.454347 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.454347 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.454471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.454471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454413 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-config-out\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.454471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454458 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.454596 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.454596 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.454693 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.454693 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-config-volume\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.454693 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-web-config\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.454841 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.454841 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.454751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsdgl\" (UniqueName: \"kubernetes.io/projected/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-kube-api-access-xsdgl\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555434 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsdgl\" (UniqueName: \"kubernetes.io/projected/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-kube-api-access-xsdgl\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555434 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555434 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555434 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555723 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555723 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-config-out\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555723 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555723 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555723 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555723 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555723 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-config-volume\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555723 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-web-config\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.555723 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.555707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.556469 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.556402 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.556602 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.556512 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.556995 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:04:59.556932 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-trusted-ca-bundle podName:a84388a4-3fe5-4243-8c92-f4a2f64ae04e nodeName:}" failed. No retries permitted until 2026-06-03 22:05:00.056907897 +0000 UTC m=+303.531789008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e") : configmap references non-existent config key: ca-bundle.crt Jun 03 22:04:59.558742 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.558713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.559219 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.559195 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.559317 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.559243 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.559543 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.559517 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-config-out\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.559652 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.559521 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-web-config\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.559746 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.559729 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-config-volume\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.559810 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.559770 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.559977 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.559960 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.560608 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.560591 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.563709 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.563677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsdgl\" (UniqueName: \"kubernetes.io/projected/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-kube-api-access-xsdgl\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:04:59.572895 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:04:59.572873 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:00.017819 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:00.017782 2578 generic.go:356] "Generic (PLEG): container finished" podID="3abe68d6-f17f-4e52-9119-8e3509517acf" containerID="eee0e1f6a04e2d258cb2f25dd0870e47e5342ad502fd7bb2cab5f3db6e55f8cc" exitCode=0 Jun 03 22:05:00.017972 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:00.017852 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bqtmw" event={"ID":"3abe68d6-f17f-4e52-9119-8e3509517acf","Type":"ContainerDied","Data":"eee0e1f6a04e2d258cb2f25dd0870e47e5342ad502fd7bb2cab5f3db6e55f8cc"} Jun 03 22:05:00.060013 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:00.059979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:05:00.060842 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:00.060820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:05:00.279192 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:00.279103 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:05:00.419550 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:00.419520 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:05:00.421900 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:05:00.421874 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda84388a4_3fe5_4243_8c92_f4a2f64ae04e.slice/crio-89cecf6b4dfba5cce0b440eeeaed967eee771cf0db726de1b073b80cda01a195 WatchSource:0}: Error finding container 89cecf6b4dfba5cce0b440eeeaed967eee771cf0db726de1b073b80cda01a195: Status 404 returned error can't find the container with id 89cecf6b4dfba5cce0b440eeeaed967eee771cf0db726de1b073b80cda01a195 Jun 03 22:05:01.023016 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:01.022974 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerStarted","Data":"89cecf6b4dfba5cce0b440eeeaed967eee771cf0db726de1b073b80cda01a195"} Jun 03 22:05:01.025072 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:01.025028 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bqtmw" event={"ID":"3abe68d6-f17f-4e52-9119-8e3509517acf","Type":"ContainerStarted","Data":"4f1bbefb2e66e450759cdf6696c8526014f90bfdb506a8fb718fdc201deff628"} Jun 03 22:05:01.025180 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:01.025084 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bqtmw" event={"ID":"3abe68d6-f17f-4e52-9119-8e3509517acf","Type":"ContainerStarted","Data":"a510e0ecf7d0d64b4803ffe0853bf33e5cb1e009e5d582f47dc3bf343481c3f2"} Jun 03 22:05:01.048703 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:01.048643 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bqtmw" podStartSLOduration=2.009630065 podStartE2EDuration="3.048624264s" totalImagesPullingTime="964.93398ms" totalInitContainerRuntime="74.060219ms" isStatefulPod=true podCreationTimestamp="2026-06-03 22:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:05:01.04777053 +0000 UTC m=+304.522651714" watchObservedRunningTime="2026-06-03 22:05:01.048624264 +0000 UTC m=+304.523505390" Jun 03 22:05:01.158649 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:01.158608 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:01.316078 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:01.315986 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:01.426006 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:01.425975 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:01.543439 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:01.543400 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:01.738905 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:01.738869 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:01.995769 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:01.995737 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:02.029350 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.029313 2578 generic.go:356] "Generic (PLEG): container finished" podID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerID="b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2" exitCode=0 Jun 03 22:05:02.029536 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.029397 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerDied","Data":"b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2"} Jun 03 22:05:02.065909 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.065874 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:02.199862 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.199828 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:02.719451 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.719419 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-859d68b648-9vddz"] Jun 03 22:05:02.722431 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.722410 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.725265 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.725245 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-clbrp\"" Jun 03 22:05:02.725373 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.725287 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 22:05:02.725373 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.725287 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 22:05:02.725373 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.725287 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 22:05:02.726095 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.726029 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cp6sg7na6bjp6\"" Jun 03 22:05:02.726201 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.726119 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 22:05:02.735401 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.735370 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-859d68b648-9vddz"] Jun 03 22:05:02.811395 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.811347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:02.884375 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.884335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6e156e23-af8f-4f91-8582-10f8877b6311-secret-metrics-server-client-certs\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.884564 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.884389 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e156e23-af8f-4f91-8582-10f8877b6311-client-ca-bundle\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.884564 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.884427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6e156e23-af8f-4f91-8582-10f8877b6311-secret-metrics-server-tls\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.884564 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.884459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6e156e23-af8f-4f91-8582-10f8877b6311-audit-log\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.884564 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.884507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e156e23-af8f-4f91-8582-10f8877b6311-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.884564 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.884536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6e156e23-af8f-4f91-8582-10f8877b6311-metrics-server-audit-profiles\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.884817 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.884621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp6dz\" (UniqueName: \"kubernetes.io/projected/6e156e23-af8f-4f91-8582-10f8877b6311-kube-api-access-tp6dz\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.967115 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.967083 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:05:02.986067 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.985963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e156e23-af8f-4f91-8582-10f8877b6311-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.986067 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.986001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6e156e23-af8f-4f91-8582-10f8877b6311-metrics-server-audit-profiles\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.986067 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.986061 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp6dz\" (UniqueName: \"kubernetes.io/projected/6e156e23-af8f-4f91-8582-10f8877b6311-kube-api-access-tp6dz\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.986325 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.986125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6e156e23-af8f-4f91-8582-10f8877b6311-secret-metrics-server-client-certs\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.986325 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.986154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e156e23-af8f-4f91-8582-10f8877b6311-client-ca-bundle\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.986325 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.986182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6e156e23-af8f-4f91-8582-10f8877b6311-secret-metrics-server-tls\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.986325 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.986205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6e156e23-af8f-4f91-8582-10f8877b6311-audit-log\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.986759 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.986711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6e156e23-af8f-4f91-8582-10f8877b6311-audit-log\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.986935 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.986805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e156e23-af8f-4f91-8582-10f8877b6311-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.987328 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.987294 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6e156e23-af8f-4f91-8582-10f8877b6311-metrics-server-audit-profiles\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.989310 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.989287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6e156e23-af8f-4f91-8582-10f8877b6311-secret-metrics-server-tls\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.989508 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.989487 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6e156e23-af8f-4f91-8582-10f8877b6311-secret-metrics-server-client-certs\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.989575 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.989553 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e156e23-af8f-4f91-8582-10f8877b6311-client-ca-bundle\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:02.994523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:02.994496 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp6dz\" (UniqueName: \"kubernetes.io/projected/6e156e23-af8f-4f91-8582-10f8877b6311-kube-api-access-tp6dz\") pod \"metrics-server-859d68b648-9vddz\" (UID: \"6e156e23-af8f-4f91-8582-10f8877b6311\") " pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:03.007620 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:03.007594 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:03.033967 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:03.033938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:03.112465 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:03.112294 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:03.204857 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:03.204646 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-859d68b648-9vddz"] Jun 03 22:05:03.208452 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:03.208421 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:03.269310 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:03.269229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:03.439390 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:05:03.439354 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e156e23_af8f_4f91_8582_10f8877b6311.slice/crio-3436841faad9714ab5d96698909c927e043ae16fddd34fddcaa403368d6b5efa WatchSource:0}: Error finding container 3436841faad9714ab5d96698909c927e043ae16fddd34fddcaa403368d6b5efa: Status 404 returned error can't find the container with id 3436841faad9714ab5d96698909c927e043ae16fddd34fddcaa403368d6b5efa Jun 03 22:05:03.531989 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:03.531966 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:04.041958 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.041874 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerStarted","Data":"92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a"} Jun 03 22:05:04.042407 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.041962 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerStarted","Data":"62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158"} Jun 03 22:05:04.042407 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.042003 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerStarted","Data":"f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed"} Jun 03 22:05:04.042407 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.042040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerStarted","Data":"7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f"} Jun 03 22:05:04.042407 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.042100 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerStarted","Data":"cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350"} Jun 03 22:05:04.045443 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.045414 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-859d68b648-9vddz" event={"ID":"6e156e23-af8f-4f91-8582-10f8877b6311","Type":"ContainerStarted","Data":"3436841faad9714ab5d96698909c927e043ae16fddd34fddcaa403368d6b5efa"} Jun 03 22:05:04.686200 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.686169 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:05:04.694405 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.694378 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.697366 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.697340 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 22:05:04.697691 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.697657 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 22:05:04.697691 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.697686 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 22:05:04.697881 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.697729 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 22:05:04.697881 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.697759 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 22:05:04.697881 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.697847 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 22:05:04.698023 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.697894 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 22:05:04.698102 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.698020 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 22:05:04.698102 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.698090 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 22:05:04.698533 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.698312 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 22:05:04.698533 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.698389 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 22:05:04.698533 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.698458 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-11o3loqppb754\"" Jun 03 22:05:04.698766 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.698743 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vn7wg\"" Jun 03 22:05:04.699445 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.699424 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:04.701247 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.700961 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 22:05:04.701970 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.701875 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 22:05:04.705615 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.705592 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 22:05:04.714415 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.714388 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:05:04.720042 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.720011 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" podUID="5c337ed3-85de-4869-9ffe-70aa635649b5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 22:05:04.803557 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.803516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ed30bd5-40f7-4134-9f97-d629fc9ad035-config-out\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.803752 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.803614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.803752 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.803638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.803752 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.803696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.803752 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.803723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.803936 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.803759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.803936 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.803810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.803936 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.803867 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.803936 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.803896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.803936 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.803925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ed30bd5-40f7-4134-9f97-d629fc9ad035-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.804214 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.804014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.804214 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.804095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-web-config\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.804214 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.804122 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b2jv\" (UniqueName: \"kubernetes.io/projected/5ed30bd5-40f7-4134-9f97-d629fc9ad035-kube-api-access-7b2jv\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.804214 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.804168 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-config\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.804399 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.804226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.804399 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.804254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.804399 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.804277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.804399 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.804302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.804399 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.804337 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.804399 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.804361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.905475 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.905615 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905491 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.905615 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.905724 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905688 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.905788 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905733 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.905788 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.905894 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ed30bd5-40f7-4134-9f97-d629fc9ad035-config-out\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.905894 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.905894 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.905894 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.906110 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.906110 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.906110 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.905982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.906110 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.906033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.906110 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.906102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.906357 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.906135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ed30bd5-40f7-4134-9f97-d629fc9ad035-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.906357 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.906166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.906357 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.906207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-web-config\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.906357 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.906232 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b2jv\" (UniqueName: \"kubernetes.io/projected/5ed30bd5-40f7-4134-9f97-d629fc9ad035-kube-api-access-7b2jv\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.906357 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.906287 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-config\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.909471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.907332 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.909471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.907406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.909471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.907728 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.909471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.907788 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.909471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.908189 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.909471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.908997 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.909471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.909034 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.909471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.909200 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.909471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.909289 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.909471 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.909309 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ed30bd5-40f7-4134-9f97-d629fc9ad035-config-out\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.910220 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.909558 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.910220 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.909634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.910220 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.909790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.910772 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.910749 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-web-config\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.910772 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.910771 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.910921 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.910873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ed30bd5-40f7-4134-9f97-d629fc9ad035-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.911898 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.911857 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.912036 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.912016 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-config\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.912246 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.912231 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.917600 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.917577 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b2jv\" (UniqueName: \"kubernetes.io/projected/5ed30bd5-40f7-4134-9f97-d629fc9ad035-kube-api-access-7b2jv\") pod \"prometheus-k8s-0\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:04.973558 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:04.973527 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7954f7bdbb-hrp58" Jun 03 22:05:05.005587 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:05.005553 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:05.053910 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:05.053875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerStarted","Data":"5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da"} Jun 03 22:05:05.055895 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:05.055856 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-859d68b648-9vddz" event={"ID":"6e156e23-af8f-4f91-8582-10f8877b6311","Type":"ContainerStarted","Data":"77f72aa277330874c734ec8cb282fc72c294268557181d807ae31394a4274ae8"} Jun 03 22:05:05.088599 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:05.088486 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.4734579119999998 podStartE2EDuration="6.088462644s" totalImagesPullingTime="3.597294462s" totalInitContainerRuntime="17.71027ms" isStatefulPod=false podCreationTimestamp="2026-06-03 22:04:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:05:05.08751277 +0000 UTC m=+308.562393895" watchObservedRunningTime="2026-06-03 22:05:05.088462644 +0000 UTC m=+308.563343772" Jun 03 22:05:05.110112 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:05.110037 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-859d68b648-9vddz" podStartSLOduration=1.680941034 podStartE2EDuration="3.110018634s" totalImagesPullingTime="1.4290776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:05:05.109463997 +0000 UTC m=+308.584345129" watchObservedRunningTime="2026-06-03 22:05:05.110018634 +0000 UTC m=+308.584899762" Jun 03 22:05:05.119904 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:05.119859 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:05.162099 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:05.162066 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:05:05.166167 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:05:05.166140 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed30bd5_40f7_4134_9f97_d629fc9ad035.slice/crio-d4b06a7a8c679b0e5d37a079c63cfa447385b7c3d798f5a290dd67d7c41b708f WatchSource:0}: Error finding container d4b06a7a8c679b0e5d37a079c63cfa447385b7c3d798f5a290dd67d7c41b708f: Status 404 returned error can't find the container with id d4b06a7a8c679b0e5d37a079c63cfa447385b7c3d798f5a290dd67d7c41b708f Jun 03 22:05:05.187044 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:05.187020 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:06.060970 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:06.060934 2578 generic.go:356] "Generic (PLEG): container finished" podID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerID="b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736" exitCode=0 Jun 03 22:05:06.061370 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:06.061023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerDied","Data":"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736"} Jun 03 22:05:06.061370 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:06.061107 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerStarted","Data":"d4b06a7a8c679b0e5d37a079c63cfa447385b7c3d798f5a290dd67d7c41b708f"} Jun 03 22:05:06.371257 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:06.371164 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:06.437316 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:06.437280 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:08.218117 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:08.218082 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:08.319169 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:08.319124 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:10.079469 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:10.079430 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerStarted","Data":"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db"} Jun 03 22:05:10.079870 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:10.079510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerStarted","Data":"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad"} Jun 03 22:05:12.093061 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:12.093007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerStarted","Data":"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c"} Jun 03 22:05:12.093421 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:12.093137 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerStarted","Data":"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f"} Jun 03 22:05:12.093421 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:12.093182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerStarted","Data":"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227"} Jun 03 22:05:12.093421 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:12.093220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerStarted","Data":"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19"} Jun 03 22:05:12.128243 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:12.128195 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.2265493100000002 podStartE2EDuration="8.128177861s" totalImagesPullingTime="4.88196797s" totalInitContainerRuntime="19.660581ms" isStatefulPod=false podCreationTimestamp="2026-06-03 22:05:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:05:12.126274263 +0000 UTC m=+315.601155392" watchObservedRunningTime="2026-06-03 22:05:12.128177861 +0000 UTC m=+315.603058988" Jun 03 22:05:12.903506 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:12.903472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:12.977002 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:12.976968 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:13.226632 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:13.226589 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:13.288879 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:13.288846 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:14.721275 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:14.721239 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" podUID="5c337ed3-85de-4869-9ffe-70aa635649b5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 22:05:14.721606 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:14.721305 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" Jun 03 22:05:14.721896 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:14.721862 2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"11283925673c261865c07dd8f46771a1b3ad0807fb0b277cb6dcb1eafebfaf1d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 22:05:14.721952 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:14.721935 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" podUID="5c337ed3-85de-4869-9ffe-70aa635649b5" containerName="service-proxy" containerID="cri-o://11283925673c261865c07dd8f46771a1b3ad0807fb0b277cb6dcb1eafebfaf1d" gracePeriod=30 Jun 03 22:05:15.006531 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:15.006446 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:05:15.105943 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:15.105914 2578 generic.go:356] "Generic (PLEG): container finished" podID="5c337ed3-85de-4869-9ffe-70aa635649b5" containerID="11283925673c261865c07dd8f46771a1b3ad0807fb0b277cb6dcb1eafebfaf1d" exitCode=2 Jun 03 22:05:15.106109 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:15.105982 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" event={"ID":"5c337ed3-85de-4869-9ffe-70aa635649b5","Type":"ContainerDied","Data":"11283925673c261865c07dd8f46771a1b3ad0807fb0b277cb6dcb1eafebfaf1d"} Jun 03 22:05:15.106109 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:15.106024 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccd6bdd44-j52l5" event={"ID":"5c337ed3-85de-4869-9ffe-70aa635649b5","Type":"ContainerStarted","Data":"239db94cb0ece8a4d7699256b7b47ef2d161361e83e9576e768bb69ed4ab5dec"} Jun 03 22:05:18.823882 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:18.823836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:18.924583 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:18.924550 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:19.136318 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:19.136233 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:19.237358 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:19.237329 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:23.034941 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:23.034901 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:23.035379 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:23.034967 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:24.858842 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:24.858800 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:25.167338 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:25.167280 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:25.228169 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:25.228141 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:26.050488 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:26.050459 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:26.634022 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:26.633984 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:26.734942 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:26.734894 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:26.792428 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:26.792387 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:33.809479 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:33.809428 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:33.909410 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:33.909373 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:43.040286 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:43.040208 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:43.046148 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:43.046116 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-859d68b648-9vddz" Jun 03 22:05:48.830659 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:48.830617 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:05:48.900741 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:05:48.900710 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:04.263701 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:04.263666 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:04.317962 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:04.317930 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:05.006000 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:05.005968 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:05.025885 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:05.025858 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:05.306725 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:05.306651 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:09.781931 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:09.781897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:06:09.784537 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:09.784507 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc891b78-9de2-441d-9e93-86bcded1ab6e-metrics-certs\") pod \"network-metrics-daemon-4wpm2\" (UID: \"bc891b78-9de2-441d-9e93-86bcded1ab6e\") " pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:06:09.870599 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:09.870565 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z6v52\"" Jun 03 22:06:09.878607 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:09.878579 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wpm2" Jun 03 22:06:10.004254 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:10.004228 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4wpm2"] Jun 03 22:06:10.006547 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:06:10.006519 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc891b78_9de2_441d_9e93_86bcded1ab6e.slice/crio-9df5ecd70429324cbafd011becb13ea32da4eba5830f2ed910653f518588ae99 WatchSource:0}: Error finding container 9df5ecd70429324cbafd011becb13ea32da4eba5830f2ed910653f518588ae99: Status 404 returned error can't find the container with id 9df5ecd70429324cbafd011becb13ea32da4eba5830f2ed910653f518588ae99 Jun 03 22:06:10.309307 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:10.309275 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4wpm2" event={"ID":"bc891b78-9de2-441d-9e93-86bcded1ab6e","Type":"ContainerStarted","Data":"9df5ecd70429324cbafd011becb13ea32da4eba5830f2ed910653f518588ae99"} Jun 03 22:06:11.315664 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:11.315626 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4wpm2" event={"ID":"bc891b78-9de2-441d-9e93-86bcded1ab6e","Type":"ContainerStarted","Data":"945109a073359c01252ffc0040b10a3d6d795953c068780c144d76a84f9e6999"} Jun 03 22:06:11.316038 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:11.315676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4wpm2" event={"ID":"bc891b78-9de2-441d-9e93-86bcded1ab6e","Type":"ContainerStarted","Data":"0bebcd9f1daab4fe26a89310a85b63f4db8eedc9c215ffd0b6ab0fc14353e566"} Jun 03 22:06:11.335933 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:11.335869 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4wpm2" podStartSLOduration=373.496424378 podStartE2EDuration="6m14.335852896s" totalImagesPullingTime="839.428518ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:06:11.333875453 +0000 UTC m=+374.808756582" watchObservedRunningTime="2026-06-03 22:06:11.335852896 +0000 UTC m=+374.810734021" Jun 03 22:06:11.446350 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:11.446301 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:11.535029 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:11.534998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:17.673558 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:17.673520 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:17.812531 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:17.812498 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:18.777913 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:18.777876 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:06:18.778368 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:18.778184 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="alertmanager" containerID="cri-o://cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350" gracePeriod=120 Jun 03 22:06:18.778368 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:18.778221 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="kube-rbac-proxy" containerID="cri-o://62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158" gracePeriod=120 Jun 03 22:06:18.778368 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:18.778238 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="kube-rbac-proxy-web" containerID="cri-o://f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed" gracePeriod=120 Jun 03 22:06:18.778368 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:18.778265 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="prom-label-proxy" containerID="cri-o://5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da" gracePeriod=120 Jun 03 22:06:18.778368 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:18.778301 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="config-reloader" containerID="cri-o://7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f" gracePeriod=120 Jun 03 22:06:18.778634 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:18.778301 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="kube-rbac-proxy-metric" containerID="cri-o://92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a" gracePeriod=120 Jun 03 22:06:19.348937 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:19.348906 2578 generic.go:356] "Generic (PLEG): container finished" podID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerID="5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da" exitCode=0 Jun 03 22:06:19.348937 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:19.348931 2578 generic.go:356] "Generic (PLEG): container finished" podID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerID="62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158" exitCode=0 Jun 03 22:06:19.348937 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:19.348938 2578 generic.go:356] "Generic (PLEG): container finished" podID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerID="7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f" exitCode=0 Jun 03 22:06:19.348937 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:19.348944 2578 generic.go:356] "Generic (PLEG): container finished" podID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerID="cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350" exitCode=0 Jun 03 22:06:19.349236 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:19.348984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerDied","Data":"5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da"} Jun 03 22:06:19.349236 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:19.349065 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerDied","Data":"62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158"} Jun 03 22:06:19.349236 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:19.349094 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerDied","Data":"7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f"} Jun 03 22:06:19.349236 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:19.349119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerDied","Data":"cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350"} Jun 03 22:06:20.033262 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.033237 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:06:20.171942 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.171914 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy-web\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172140 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.171948 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-metrics-client-ca\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172140 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.171978 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-trusted-ca-bundle\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172140 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172008 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsdgl\" (UniqueName: \"kubernetes.io/projected/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-kube-api-access-xsdgl\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172140 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172036 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172140 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172078 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-main-tls\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172140 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172107 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-cluster-tls-config\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172456 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172145 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-config-volume\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172456 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172170 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-tls-assets\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172456 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172215 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-web-config\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172456 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172253 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172456 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172280 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-config-out\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172456 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172305 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-main-db\") pod \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\" (UID: \"a84388a4-3fe5-4243-8c92-f4a2f64ae04e\") " Jun 03 22:06:20.172456 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172397 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:06:20.172783 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172685 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-metrics-client-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.172783 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172706 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:06:20.172783 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.172722 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:06:20.175195 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.175144 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:20.175195 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.175180 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:20.175804 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.175778 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:20.176245 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.176214 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-config-volume" (OuterVolumeSpecName: "config-volume") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:20.176326 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.176260 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-config-out" (OuterVolumeSpecName: "config-out") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:06:20.176544 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.176518 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:20.176676 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.176659 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:06:20.176781 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.176757 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-kube-api-access-xsdgl" (OuterVolumeSpecName: "kube-api-access-xsdgl") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "kube-api-access-xsdgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:06:20.180923 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.180887 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:20.187267 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.187245 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-web-config" (OuterVolumeSpecName: "web-config") pod "a84388a4-3fe5-4243-8c92-f4a2f64ae04e" (UID: "a84388a4-3fe5-4243-8c92-f4a2f64ae04e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:20.273848 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.273812 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-config-out\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.273848 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.273844 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-main-db\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.273848 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.273857 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.274117 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.273866 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.274117 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.273874 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsdgl\" (UniqueName: \"kubernetes.io/projected/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-kube-api-access-xsdgl\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.274117 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.273884 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.274117 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.273893 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-main-tls\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.274117 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.273901 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-cluster-tls-config\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.274117 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.273910 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.274117 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.273918 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-tls-assets\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.274117 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.273925 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-web-config\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.274117 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.273933 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a84388a4-3fe5-4243-8c92-f4a2f64ae04e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:20.355399 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.355358 2578 generic.go:356] "Generic (PLEG): container finished" podID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerID="92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a" exitCode=0 Jun 03 22:06:20.355399 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.355391 2578 generic.go:356] "Generic (PLEG): container finished" podID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerID="f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed" exitCode=0 Jun 03 22:06:20.355649 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.355436 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 22:06:20.355649 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.355445 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerDied","Data":"92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a"} Jun 03 22:06:20.355649 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.355519 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerDied","Data":"f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed"} Jun 03 22:06:20.355649 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.355560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a84388a4-3fe5-4243-8c92-f4a2f64ae04e","Type":"ContainerDied","Data":"89cecf6b4dfba5cce0b440eeeaed967eee771cf0db726de1b073b80cda01a195"} Jun 03 22:06:20.355649 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.355598 2578 scope.go:117] "RemoveContainer" containerID="5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da" Jun 03 22:06:20.364495 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.364475 2578 scope.go:117] "RemoveContainer" containerID="92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a" Jun 03 22:06:20.371463 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.371447 2578 scope.go:117] "RemoveContainer" containerID="62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158" Jun 03 22:06:20.379352 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.379333 2578 scope.go:117] "RemoveContainer" containerID="f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed" Jun 03 22:06:20.379419 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.379330 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:06:20.383634 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.383610 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 22:06:20.387366 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.387350 2578 scope.go:117] "RemoveContainer" containerID="7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f" Jun 03 22:06:20.395989 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.395968 2578 scope.go:117] "RemoveContainer" containerID="cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350" Jun 03 22:06:20.403678 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.403653 2578 scope.go:117] "RemoveContainer" containerID="b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2" Jun 03 22:06:20.411029 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.411013 2578 scope.go:117] "RemoveContainer" containerID="5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da" Jun 03 22:06:20.411348 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:20.411328 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da\": container with ID starting with 5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da not found: ID does not exist" containerID="5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da" Jun 03 22:06:20.411399 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.411357 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da"} err="failed to get container status \"5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da\": rpc error: code = NotFound desc = could not find container \"5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da\": container with ID starting with 5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da not found: ID does not exist" Jun 03 22:06:20.411399 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.411376 2578 scope.go:117] "RemoveContainer" containerID="92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a" Jun 03 22:06:20.411618 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:20.411599 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a\": container with ID starting with 92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a not found: ID does not exist" containerID="92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a" Jun 03 22:06:20.411686 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.411629 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a"} err="failed to get container status \"92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a\": rpc error: code = NotFound desc = could not find container \"92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a\": container with ID starting with 92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a not found: ID does not exist" Jun 03 22:06:20.411686 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.411652 2578 scope.go:117] "RemoveContainer" containerID="62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158" Jun 03 22:06:20.411898 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:20.411881 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158\": container with ID starting with 62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158 not found: ID does not exist" containerID="62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158" Jun 03 22:06:20.411959 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.411906 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158"} err="failed to get container status \"62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158\": rpc error: code = NotFound desc = could not find container \"62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158\": container with ID starting with 62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158 not found: ID does not exist" Jun 03 22:06:20.411959 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.411925 2578 scope.go:117] "RemoveContainer" containerID="f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed" Jun 03 22:06:20.412206 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:20.412190 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed\": container with ID starting with f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed not found: ID does not exist" containerID="f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed" Jun 03 22:06:20.412252 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.412209 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed"} err="failed to get container status \"f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed\": rpc error: code = NotFound desc = could not find container \"f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed\": container with ID starting with f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed not found: ID does not exist" Jun 03 22:06:20.412252 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.412223 2578 scope.go:117] "RemoveContainer" containerID="7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f" Jun 03 22:06:20.412422 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:20.412406 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f\": container with ID starting with 7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f not found: ID does not exist" containerID="7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f" Jun 03 22:06:20.412460 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.412424 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f"} err="failed to get container status \"7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f\": rpc error: code = NotFound desc = could not find container \"7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f\": container with ID starting with 7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f not found: ID does not exist" Jun 03 22:06:20.412460 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.412435 2578 scope.go:117] "RemoveContainer" containerID="cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350" Jun 03 22:06:20.412632 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:20.412616 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350\": container with ID starting with cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350 not found: ID does not exist" containerID="cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350" Jun 03 22:06:20.412693 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.412640 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350"} err="failed to get container status \"cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350\": rpc error: code = NotFound desc = could not find container \"cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350\": container with ID starting with cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350 not found: ID does not exist" Jun 03 22:06:20.412693 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.412663 2578 scope.go:117] "RemoveContainer" containerID="b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2" Jun 03 22:06:20.412904 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:20.412889 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2\": container with ID starting with b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2 not found: ID does not exist" containerID="b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2" Jun 03 22:06:20.412969 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.412908 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2"} err="failed to get container status \"b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2\": rpc error: code = NotFound desc = could not find container \"b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2\": container with ID starting with b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2 not found: ID does not exist" Jun 03 22:06:20.412969 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.412919 2578 scope.go:117] "RemoveContainer" containerID="5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da" Jun 03 22:06:20.413200 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.413171 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da"} err="failed to get container status \"5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da\": rpc error: code = NotFound desc = could not find container \"5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da\": container with ID starting with 5dbae376565b8abde8750c9e9ea903c871e6228b436f127628660ce6cdf8d4da not found: ID does not exist" Jun 03 22:06:20.413255 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.413201 2578 scope.go:117] "RemoveContainer" containerID="92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a" Jun 03 22:06:20.413443 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.413423 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a"} err="failed to get container status \"92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a\": rpc error: code = NotFound desc = could not find container \"92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a\": container with ID starting with 92ae903f93669b6cc9a7f07f80e58be7b6be4f48113fce8f6afa4a9d4155a34a not found: ID does not exist" Jun 03 22:06:20.413443 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.413443 2578 scope.go:117] "RemoveContainer" containerID="62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158" Jun 03 22:06:20.413657 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.413637 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158"} err="failed to get container status \"62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158\": rpc error: code = NotFound desc = could not find container \"62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158\": container with ID starting with 62e14131d88770925970e27a791dfc713c2f03a5a724f3e745449b6f6f741158 not found: ID does not exist" Jun 03 22:06:20.413657 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.413656 2578 scope.go:117] "RemoveContainer" containerID="f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed" Jun 03 22:06:20.413892 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.413874 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed"} err="failed to get container status \"f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed\": rpc error: code = NotFound desc = could not find container \"f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed\": container with ID starting with f2a3392fdbbe1722f211afcd14dea13ae8a35e6e2c8d0c302eda6540171908ed not found: ID does not exist" Jun 03 22:06:20.413955 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.413893 2578 scope.go:117] "RemoveContainer" containerID="7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f" Jun 03 22:06:20.414113 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.414097 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f"} err="failed to get container status \"7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f\": rpc error: code = NotFound desc = could not find container \"7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f\": container with ID starting with 7205e376d961927d0487963187e4e8db117855e6ab286856615de60c2fd4de9f not found: ID does not exist" Jun 03 22:06:20.414167 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.414114 2578 scope.go:117] "RemoveContainer" containerID="cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350" Jun 03 22:06:20.414299 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.414281 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350"} err="failed to get container status \"cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350\": rpc error: code = NotFound desc = could not find container \"cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350\": container with ID starting with cdac811aae0aed0b5b4691409610268f5e41a6132cc8728a6d9239639a7a6350 not found: ID does not exist" Jun 03 22:06:20.414360 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.414300 2578 scope.go:117] "RemoveContainer" containerID="b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2" Jun 03 22:06:20.414496 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.414478 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2"} err="failed to get container status \"b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2\": rpc error: code = NotFound desc = could not find container \"b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2\": container with ID starting with b524acb6964eced13287baf1ed75f42f0700cb5a0f7ab4bcb9f3f6a6e3c810d2 not found: ID does not exist" Jun 03 22:06:20.971946 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:20.971913 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" path="/var/lib/kubelet/pods/a84388a4-3fe5-4243-8c92-f4a2f64ae04e/volumes" Jun 03 22:06:21.518647 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:21.518612 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:21.575631 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:21.575587 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:23.123548 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.123508 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:06:23.124001 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.123805 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="prometheus" containerID="cri-o://c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad" gracePeriod=600 Jun 03 22:06:23.124001 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.123821 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="kube-rbac-proxy" containerID="cri-o://d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f" gracePeriod=600 Jun 03 22:06:23.124001 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.123873 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="thanos-sidecar" containerID="cri-o://4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19" gracePeriod=600 Jun 03 22:06:23.124001 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.123907 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="config-reloader" containerID="cri-o://19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db" gracePeriod=600 Jun 03 22:06:23.124001 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.123876 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c" gracePeriod=600 Jun 03 22:06:23.124264 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.123877 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="kube-rbac-proxy-web" containerID="cri-o://81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227" gracePeriod=600 Jun 03 22:06:23.365392 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.365365 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.368774 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.368744 2578 generic.go:356] "Generic (PLEG): container finished" podID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerID="8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c" exitCode=0 Jun 03 22:06:23.368774 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.368762 2578 generic.go:356] "Generic (PLEG): container finished" podID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerID="d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f" exitCode=0 Jun 03 22:06:23.368774 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.368768 2578 generic.go:356] "Generic (PLEG): container finished" podID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerID="81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227" exitCode=0 Jun 03 22:06:23.368774 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.368774 2578 generic.go:356] "Generic (PLEG): container finished" podID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerID="4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19" exitCode=0 Jun 03 22:06:23.368774 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.368779 2578 generic.go:356] "Generic (PLEG): container finished" podID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerID="19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db" exitCode=0 Jun 03 22:06:23.368999 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.368784 2578 generic.go:356] "Generic (PLEG): container finished" podID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerID="c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad" exitCode=0 Jun 03 22:06:23.368999 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.368818 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.368999 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.368825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerDied","Data":"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c"} Jun 03 22:06:23.368999 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.368905 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerDied","Data":"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f"} Jun 03 22:06:23.368999 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.368949 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerDied","Data":"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227"} Jun 03 22:06:23.368999 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.368969 2578 scope.go:117] "RemoveContainer" containerID="8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c" Jun 03 22:06:23.368999 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.368989 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerDied","Data":"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19"} Jun 03 22:06:23.369245 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.369029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerDied","Data":"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db"} Jun 03 22:06:23.369245 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.369087 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerDied","Data":"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad"} Jun 03 22:06:23.369245 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.369131 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ed30bd5-40f7-4134-9f97-d629fc9ad035","Type":"ContainerDied","Data":"d4b06a7a8c679b0e5d37a079c63cfa447385b7c3d798f5a290dd67d7c41b708f"} Jun 03 22:06:23.376311 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.376294 2578 scope.go:117] "RemoveContainer" containerID="d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f" Jun 03 22:06:23.382778 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.382748 2578 scope.go:117] "RemoveContainer" containerID="81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227" Jun 03 22:06:23.389354 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.389336 2578 scope.go:117] "RemoveContainer" containerID="4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19" Jun 03 22:06:23.396150 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.396128 2578 scope.go:117] "RemoveContainer" containerID="19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db" Jun 03 22:06:23.404652 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.404634 2578 scope.go:117] "RemoveContainer" containerID="c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad" Jun 03 22:06:23.413287 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.413264 2578 scope.go:117] "RemoveContainer" containerID="b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736" Jun 03 22:06:23.420570 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.420551 2578 scope.go:117] "RemoveContainer" containerID="8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c" Jun 03 22:06:23.420877 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:23.420858 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": container with ID starting with 8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c not found: ID does not exist" containerID="8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c" Jun 03 22:06:23.420941 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.420889 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c"} err="failed to get container status \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": rpc error: code = NotFound desc = could not find container \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": container with ID starting with 8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c not found: ID does not exist" Jun 03 22:06:23.420941 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.420917 2578 scope.go:117] "RemoveContainer" containerID="d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f" Jun 03 22:06:23.421247 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:23.421229 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": container with ID starting with d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f not found: ID does not exist" containerID="d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f" Jun 03 22:06:23.421314 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.421251 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f"} err="failed to get container status \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": rpc error: code = NotFound desc = could not find container \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": container with ID starting with d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f not found: ID does not exist" Jun 03 22:06:23.421314 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.421267 2578 scope.go:117] "RemoveContainer" containerID="81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227" Jun 03 22:06:23.421513 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:23.421491 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": container with ID starting with 81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227 not found: ID does not exist" containerID="81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227" Jun 03 22:06:23.421596 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.421522 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227"} err="failed to get container status \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": rpc error: code = NotFound desc = could not find container \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": container with ID starting with 81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227 not found: ID does not exist" Jun 03 22:06:23.421596 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.421542 2578 scope.go:117] "RemoveContainer" containerID="4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19" Jun 03 22:06:23.421824 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:23.421798 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": container with ID starting with 4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19 not found: ID does not exist" containerID="4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19" Jun 03 22:06:23.421876 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.421833 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19"} err="failed to get container status \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": rpc error: code = NotFound desc = could not find container \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": container with ID starting with 4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19 not found: ID does not exist" Jun 03 22:06:23.421876 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.421856 2578 scope.go:117] "RemoveContainer" containerID="19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db" Jun 03 22:06:23.422147 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:23.422121 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": container with ID starting with 19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db not found: ID does not exist" containerID="19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db" Jun 03 22:06:23.422248 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.422152 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db"} err="failed to get container status \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": rpc error: code = NotFound desc = could not find container \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": container with ID starting with 19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db not found: ID does not exist" Jun 03 22:06:23.422248 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.422166 2578 scope.go:117] "RemoveContainer" containerID="c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad" Jun 03 22:06:23.422460 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:23.422436 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": container with ID starting with c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad not found: ID does not exist" containerID="c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad" Jun 03 22:06:23.422501 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.422469 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad"} err="failed to get container status \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": rpc error: code = NotFound desc = could not find container \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": container with ID starting with c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad not found: ID does not exist" Jun 03 22:06:23.422501 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.422491 2578 scope.go:117] "RemoveContainer" containerID="b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736" Jun 03 22:06:23.422778 ip-10-0-138-139 kubenswrapper[2578]: E0603 22:06:23.422754 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": container with ID starting with b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736 not found: ID does not exist" containerID="b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736" Jun 03 22:06:23.422838 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.422786 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736"} err="failed to get container status \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": rpc error: code = NotFound desc = could not find container \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": container with ID starting with b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736 not found: ID does not exist" Jun 03 22:06:23.422838 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.422806 2578 scope.go:117] "RemoveContainer" containerID="8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c" Jun 03 22:06:23.423133 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.423109 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c"} err="failed to get container status \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": rpc error: code = NotFound desc = could not find container \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": container with ID starting with 8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c not found: ID does not exist" Jun 03 22:06:23.423184 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.423135 2578 scope.go:117] "RemoveContainer" containerID="d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f" Jun 03 22:06:23.423363 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.423345 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f"} err="failed to get container status \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": rpc error: code = NotFound desc = could not find container \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": container with ID starting with d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f not found: ID does not exist" Jun 03 22:06:23.423406 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.423365 2578 scope.go:117] "RemoveContainer" containerID="81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227" Jun 03 22:06:23.423624 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.423606 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227"} err="failed to get container status \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": rpc error: code = NotFound desc = could not find container \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": container with ID starting with 81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227 not found: ID does not exist" Jun 03 22:06:23.423683 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.423625 2578 scope.go:117] "RemoveContainer" containerID="4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19" Jun 03 22:06:23.423843 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.423823 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19"} err="failed to get container status \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": rpc error: code = NotFound desc = could not find container \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": container with ID starting with 4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19 not found: ID does not exist" Jun 03 22:06:23.423901 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.423844 2578 scope.go:117] "RemoveContainer" containerID="19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db" Jun 03 22:06:23.424114 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.424091 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db"} err="failed to get container status \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": rpc error: code = NotFound desc = could not find container \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": container with ID starting with 19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db not found: ID does not exist" Jun 03 22:06:23.424178 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.424115 2578 scope.go:117] "RemoveContainer" containerID="c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad" Jun 03 22:06:23.424375 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.424359 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad"} err="failed to get container status \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": rpc error: code = NotFound desc = could not find container \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": container with ID starting with c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad not found: ID does not exist" Jun 03 22:06:23.424423 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.424376 2578 scope.go:117] "RemoveContainer" containerID="b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736" Jun 03 22:06:23.424585 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.424568 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736"} err="failed to get container status \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": rpc error: code = NotFound desc = could not find container \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": container with ID starting with b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736 not found: ID does not exist" Jun 03 22:06:23.424631 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.424585 2578 scope.go:117] "RemoveContainer" containerID="8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c" Jun 03 22:06:23.424778 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.424763 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c"} err="failed to get container status \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": rpc error: code = NotFound desc = could not find container \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": container with ID starting with 8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c not found: ID does not exist" Jun 03 22:06:23.424829 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.424778 2578 scope.go:117] "RemoveContainer" containerID="d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f" Jun 03 22:06:23.425022 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.425005 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f"} err="failed to get container status \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": rpc error: code = NotFound desc = could not find container \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": container with ID starting with d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f not found: ID does not exist" Jun 03 22:06:23.425088 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.425022 2578 scope.go:117] "RemoveContainer" containerID="81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227" Jun 03 22:06:23.425276 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.425257 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227"} err="failed to get container status \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": rpc error: code = NotFound desc = could not find container \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": container with ID starting with 81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227 not found: ID does not exist" Jun 03 22:06:23.425365 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.425277 2578 scope.go:117] "RemoveContainer" containerID="4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19" Jun 03 22:06:23.425518 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.425497 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19"} err="failed to get container status \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": rpc error: code = NotFound desc = could not find container \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": container with ID starting with 4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19 not found: ID does not exist" Jun 03 22:06:23.425518 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.425518 2578 scope.go:117] "RemoveContainer" containerID="19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db" Jun 03 22:06:23.425768 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.425750 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db"} err="failed to get container status \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": rpc error: code = NotFound desc = could not find container \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": container with ID starting with 19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db not found: ID does not exist" Jun 03 22:06:23.425820 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.425769 2578 scope.go:117] "RemoveContainer" containerID="c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad" Jun 03 22:06:23.426022 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.426003 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad"} err="failed to get container status \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": rpc error: code = NotFound desc = could not find container \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": container with ID starting with c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad not found: ID does not exist" Jun 03 22:06:23.426022 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.426021 2578 scope.go:117] "RemoveContainer" containerID="b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736" Jun 03 22:06:23.426265 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.426248 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736"} err="failed to get container status \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": rpc error: code = NotFound desc = could not find container \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": container with ID starting with b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736 not found: ID does not exist" Jun 03 22:06:23.426265 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.426265 2578 scope.go:117] "RemoveContainer" containerID="8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c" Jun 03 22:06:23.426465 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.426450 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c"} err="failed to get container status \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": rpc error: code = NotFound desc = could not find container \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": container with ID starting with 8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c not found: ID does not exist" Jun 03 22:06:23.426509 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.426465 2578 scope.go:117] "RemoveContainer" containerID="d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f" Jun 03 22:06:23.426645 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.426630 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f"} err="failed to get container status \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": rpc error: code = NotFound desc = could not find container \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": container with ID starting with d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f not found: ID does not exist" Jun 03 22:06:23.426684 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.426645 2578 scope.go:117] "RemoveContainer" containerID="81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227" Jun 03 22:06:23.426832 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.426811 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227"} err="failed to get container status \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": rpc error: code = NotFound desc = could not find container \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": container with ID starting with 81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227 not found: ID does not exist" Jun 03 22:06:23.426832 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.426827 2578 scope.go:117] "RemoveContainer" containerID="4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19" Jun 03 22:06:23.427038 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.427015 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19"} err="failed to get container status \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": rpc error: code = NotFound desc = could not find container \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": container with ID starting with 4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19 not found: ID does not exist" Jun 03 22:06:23.427153 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.427038 2578 scope.go:117] "RemoveContainer" containerID="19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db" Jun 03 22:06:23.427295 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.427278 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db"} err="failed to get container status \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": rpc error: code = NotFound desc = could not find container \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": container with ID starting with 19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db not found: ID does not exist" Jun 03 22:06:23.427358 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.427297 2578 scope.go:117] "RemoveContainer" containerID="c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad" Jun 03 22:06:23.427566 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.427534 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad"} err="failed to get container status \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": rpc error: code = NotFound desc = could not find container \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": container with ID starting with c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad not found: ID does not exist" Jun 03 22:06:23.427608 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.427569 2578 scope.go:117] "RemoveContainer" containerID="b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736" Jun 03 22:06:23.427813 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.427796 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736"} err="failed to get container status \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": rpc error: code = NotFound desc = could not find container \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": container with ID starting with b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736 not found: ID does not exist" Jun 03 22:06:23.427887 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.427815 2578 scope.go:117] "RemoveContainer" containerID="8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c" Jun 03 22:06:23.428024 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.428008 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c"} err="failed to get container status \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": rpc error: code = NotFound desc = could not find container \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": container with ID starting with 8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c not found: ID does not exist" Jun 03 22:06:23.428092 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.428024 2578 scope.go:117] "RemoveContainer" containerID="d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f" Jun 03 22:06:23.428308 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.428285 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f"} err="failed to get container status \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": rpc error: code = NotFound desc = could not find container \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": container with ID starting with d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f not found: ID does not exist" Jun 03 22:06:23.428308 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.428307 2578 scope.go:117] "RemoveContainer" containerID="81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227" Jun 03 22:06:23.428563 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.428546 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227"} err="failed to get container status \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": rpc error: code = NotFound desc = could not find container \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": container with ID starting with 81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227 not found: ID does not exist" Jun 03 22:06:23.428635 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.428565 2578 scope.go:117] "RemoveContainer" containerID="4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19" Jun 03 22:06:23.428820 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.428798 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19"} err="failed to get container status \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": rpc error: code = NotFound desc = could not find container \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": container with ID starting with 4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19 not found: ID does not exist" Jun 03 22:06:23.428869 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.428820 2578 scope.go:117] "RemoveContainer" containerID="19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db" Jun 03 22:06:23.429118 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.429098 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db"} err="failed to get container status \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": rpc error: code = NotFound desc = could not find container \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": container with ID starting with 19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db not found: ID does not exist" Jun 03 22:06:23.429202 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.429119 2578 scope.go:117] "RemoveContainer" containerID="c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad" Jun 03 22:06:23.429373 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.429359 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad"} err="failed to get container status \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": rpc error: code = NotFound desc = could not find container \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": container with ID starting with c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad not found: ID does not exist" Jun 03 22:06:23.429428 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.429374 2578 scope.go:117] "RemoveContainer" containerID="b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736" Jun 03 22:06:23.429615 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.429599 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736"} err="failed to get container status \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": rpc error: code = NotFound desc = could not find container \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": container with ID starting with b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736 not found: ID does not exist" Jun 03 22:06:23.429663 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.429615 2578 scope.go:117] "RemoveContainer" containerID="8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c" Jun 03 22:06:23.429873 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.429851 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c"} err="failed to get container status \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": rpc error: code = NotFound desc = could not find container \"8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c\": container with ID starting with 8d23eba5ab83f0f5a0f80e11c7ff9f0cfac5374db015ba4db10c5c087e5f513c not found: ID does not exist" Jun 03 22:06:23.429873 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.429871 2578 scope.go:117] "RemoveContainer" containerID="d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f" Jun 03 22:06:23.430109 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.430092 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f"} err="failed to get container status \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": rpc error: code = NotFound desc = could not find container \"d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f\": container with ID starting with d9ab7b777bbbec9e019d28415fa24f9726361f99448a1d2b59e8a89f4c58ac1f not found: ID does not exist" Jun 03 22:06:23.430169 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.430109 2578 scope.go:117] "RemoveContainer" containerID="81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227" Jun 03 22:06:23.430354 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.430323 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227"} err="failed to get container status \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": rpc error: code = NotFound desc = could not find container \"81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227\": container with ID starting with 81e631e3d328e3b9bbc786105d2e0848a547fd726a714758016fed04284ff227 not found: ID does not exist" Jun 03 22:06:23.430394 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.430357 2578 scope.go:117] "RemoveContainer" containerID="4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19" Jun 03 22:06:23.430609 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.430592 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19"} err="failed to get container status \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": rpc error: code = NotFound desc = could not find container \"4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19\": container with ID starting with 4876003e00ac66c101432dfb55a1da10b5d57e67c60dbeca10d8288e42796c19 not found: ID does not exist" Jun 03 22:06:23.430648 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.430609 2578 scope.go:117] "RemoveContainer" containerID="19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db" Jun 03 22:06:23.430803 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.430788 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db"} err="failed to get container status \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": rpc error: code = NotFound desc = could not find container \"19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db\": container with ID starting with 19f63971221cadb5d2b66cd63657b655dddafa0670bb2ef4633c39be9fb304db not found: ID does not exist" Jun 03 22:06:23.430849 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.430804 2578 scope.go:117] "RemoveContainer" containerID="c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad" Jun 03 22:06:23.430995 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.430976 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad"} err="failed to get container status \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": rpc error: code = NotFound desc = could not find container \"c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad\": container with ID starting with c1b7b7cee6ee10561babed498b239aedbe05b2b83f766d7d82fa036f7b01e2ad not found: ID does not exist" Jun 03 22:06:23.431062 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.430996 2578 scope.go:117] "RemoveContainer" containerID="b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736" Jun 03 22:06:23.431285 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.431266 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736"} err="failed to get container status \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": rpc error: code = NotFound desc = could not find container \"b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736\": container with ID starting with b9fa2b8dce2724ec3c0854ab0deb288bafaea1ae5bbcb1f446cff6a255eb3736 not found: ID does not exist" Jun 03 22:06:23.498337 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.498300 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-kubelet-serving-ca-bundle\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.498503 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.498356 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b2jv\" (UniqueName: \"kubernetes.io/projected/5ed30bd5-40f7-4134-9f97-d629fc9ad035-kube-api-access-7b2jv\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.498503 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.498383 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-web-config\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.498615 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.498543 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-0\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.498615 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.498576 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-db\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.498723 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.498697 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:06:23.498824 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.498805 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-metrics-client-ca\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.498882 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.498849 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-1\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.498936 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.498881 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-thanos-prometheus-http-client-file\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.498936 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.498915 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ed30bd5-40f7-4134-9f97-d629fc9ad035-config-out\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.499033 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.498940 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-2\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.499033 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.498973 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-kube-rbac-proxy\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.499033 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.499017 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-metrics-client-certs\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.499204 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.499121 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.499204 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.499152 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-config\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.499204 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.499175 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-grpc-tls\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.499404 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.499215 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-tls\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.499404 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.499244 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:06:23.499404 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.499255 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.499404 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.499308 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-serving-certs-ca-bundle\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.499404 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.499349 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ed30bd5-40f7-4134-9f97-d629fc9ad035-tls-assets\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.499404 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.499379 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-trusted-ca-bundle\") pod \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\" (UID: \"5ed30bd5-40f7-4134-9f97-d629fc9ad035\") " Jun 03 22:06:23.499763 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.499629 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.499763 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.499647 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-metrics-client-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.500028 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.500006 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:06:23.500110 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.500034 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:06:23.500110 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.500091 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:06:23.500688 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.500423 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:06:23.501278 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.500955 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:06:23.502124 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.501497 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed30bd5-40f7-4134-9f97-d629fc9ad035-kube-api-access-7b2jv" (OuterVolumeSpecName: "kube-api-access-7b2jv") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "kube-api-access-7b2jv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:06:23.502124 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.501679 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:06:23.502124 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.501745 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:23.503484 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.503458 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed30bd5-40f7-4134-9f97-d629fc9ad035-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:06:23.503703 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.503680 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:23.503803 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.503737 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:23.504542 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.504449 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-config" (OuterVolumeSpecName: "config") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:23.504641 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.504562 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:23.504705 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.504664 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed30bd5-40f7-4134-9f97-d629fc9ad035-config-out" (OuterVolumeSpecName: "config-out") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:06:23.505669 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.505566 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:23.505669 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.505643 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:23.505793 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.505760 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:23.512293 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.512271 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-web-config" (OuterVolumeSpecName: "web-config") pod "5ed30bd5-40f7-4134-9f97-d629fc9ad035" (UID: "5ed30bd5-40f7-4134-9f97-d629fc9ad035"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 22:06:23.600980 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.600945 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.600980 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.600975 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.600980 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.600985 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.600995 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ed30bd5-40f7-4134-9f97-d629fc9ad035-tls-assets\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601006 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601014 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b2jv\" (UniqueName: \"kubernetes.io/projected/5ed30bd5-40f7-4134-9f97-d629fc9ad035-kube-api-access-7b2jv\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601046 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-web-config\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601078 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601087 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-db\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601095 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601105 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601114 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ed30bd5-40f7-4134-9f97-d629fc9ad035-config-out\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601122 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ed30bd5-40f7-4134-9f97-d629fc9ad035-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601129 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-kube-rbac-proxy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601138 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-metrics-client-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601149 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601160 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-config\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.601239 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.601168 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ed30bd5-40f7-4134-9f97-d629fc9ad035-secret-grpc-tls\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\"" Jun 03 22:06:23.696025 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.695992 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:06:23.706832 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.706800 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:06:23.751630 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.751600 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:06:23.751918 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.751901 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="config-reloader" Jun 03 22:06:23.752012 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.751920 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="config-reloader" Jun 03 22:06:23.752012 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.751940 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="alertmanager" Jun 03 22:06:23.752012 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.751949 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="alertmanager" Jun 03 22:06:23.752012 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.751960 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="init-config-reloader" Jun 03 22:06:23.752012 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.751968 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="init-config-reloader" Jun 03 22:06:23.752012 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.751983 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="init-config-reloader" Jun 03 22:06:23.752012 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.751991 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="init-config-reloader" Jun 03 22:06:23.752012 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.751999 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="prom-label-proxy" Jun 03 22:06:23.752012 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752007 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="prom-label-proxy" Jun 03 22:06:23.752012 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752017 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="thanos-sidecar" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752024 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="thanos-sidecar" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752041 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="kube-rbac-proxy-thanos" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752070 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="kube-rbac-proxy-thanos" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752084 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="kube-rbac-proxy" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752119 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="kube-rbac-proxy" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752130 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="prometheus" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752138 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="prometheus" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752149 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="kube-rbac-proxy-metric" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752158 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="kube-rbac-proxy-metric" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752167 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="kube-rbac-proxy" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752175 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="kube-rbac-proxy" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752185 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="kube-rbac-proxy-web" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752193 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="kube-rbac-proxy-web" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752201 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="config-reloader" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752209 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="config-reloader" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752218 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="kube-rbac-proxy-web" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752226 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="kube-rbac-proxy-web" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752296 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="prom-label-proxy" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752308 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="kube-rbac-proxy-thanos" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752320 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="kube-rbac-proxy-metric" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752330 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="config-reloader" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752338 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="kube-rbac-proxy" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752347 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="alertmanager" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752356 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a84388a4-3fe5-4243-8c92-f4a2f64ae04e" containerName="kube-rbac-proxy-web" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752364 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="config-reloader" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752371 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="kube-rbac-proxy-web" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752379 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="prometheus" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752385 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="thanos-sidecar" Jun 03 22:06:23.752523 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.752393 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" containerName="kube-rbac-proxy" Jun 03 22:06:23.757772 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.757751 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.765525 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.765501 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 22:06:23.765630 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.765549 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 22:06:23.765630 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.765606 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 22:06:23.765630 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.765556 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 22:06:23.765812 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.765613 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 22:06:23.765812 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.765704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 22:06:23.766205 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.766184 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 22:06:23.766294 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.766175 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 22:06:23.766294 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.766282 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 22:06:23.766402 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.766293 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-11o3loqppb754\"" Jun 03 22:06:23.766499 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.766483 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 22:06:23.766564 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.766485 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 22:06:23.766564 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.766559 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vn7wg\"" Jun 03 22:06:23.766659 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.766593 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 22:06:23.768742 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.768722 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 22:06:23.771084 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.771067 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 22:06:23.783413 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.783385 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:06:23.902710 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.902667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.902882 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.902718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.902882 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.902770 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.902882 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.902800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.902882 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.902824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.902882 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.902849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903130 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.902909 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlrwv\" (UniqueName: \"kubernetes.io/projected/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-kube-api-access-qlrwv\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903130 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.902946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903130 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.902973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903130 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.902994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903130 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.903039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903130 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.903090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903130 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.903108 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-web-config\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903130 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.903125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903391 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.903143 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903391 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.903226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903391 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.903256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-config\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903391 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.903273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903391 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.903295 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:23.903391 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:23.903317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-config-out\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.004544 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.004457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.004544 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.004499 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.004544 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.004523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-web-config\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.004799 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.004647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.004799 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.004693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.004799 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.004732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.004799 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.004760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-config\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.004799 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.004785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005357 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-config-out\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005398 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005445 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005619 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlrwv\" (UniqueName: \"kubernetes.io/projected/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-kube-api-access-qlrwv\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.005822 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.005753 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.006589 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.006302 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.007464 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.007437 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.010151 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.009623 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.010151 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.009625 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.010151 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.009601 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.010151 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.010143 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.010465 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.010155 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-web-config\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.010465 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.010153 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.010465 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.010383 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-config-out\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.010614 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.010581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-config\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.011576 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.010956 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.011576 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.011307 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.011576 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.011536 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.011767 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.011713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.015114 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.011763 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.015114 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.012700 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.015114 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.014090 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.027189 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.027169 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlrwv\" (UniqueName: \"kubernetes.io/projected/54ba88b6-52cf-4268-910e-cc0c1e9c7fcb-kube-api-access-qlrwv\") pod \"prometheus-k8s-0\" (UID: \"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.067029 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.066993 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:24.230847 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.230813 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 22:06:24.234518 ip-10-0-138-139 kubenswrapper[2578]: W0603 22:06:24.234476 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ba88b6_52cf_4268_910e_cc0c1e9c7fcb.slice/crio-63921bcccc78d61111ed68bda2214eea9ea1454acd0f6d034204ce38035ca546 WatchSource:0}: Error finding container 63921bcccc78d61111ed68bda2214eea9ea1454acd0f6d034204ce38035ca546: Status 404 returned error can't find the container with id 63921bcccc78d61111ed68bda2214eea9ea1454acd0f6d034204ce38035ca546 Jun 03 22:06:24.373645 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.373614 2578 generic.go:356] "Generic (PLEG): container finished" podID="54ba88b6-52cf-4268-910e-cc0c1e9c7fcb" containerID="76abbd8251f7a50368669b953545a5b4b0977ccab29845a53c95097a93dd3812" exitCode=0 Jun 03 22:06:24.373834 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.373710 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb","Type":"ContainerDied","Data":"76abbd8251f7a50368669b953545a5b4b0977ccab29845a53c95097a93dd3812"} Jun 03 22:06:24.373834 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.373797 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb","Type":"ContainerStarted","Data":"63921bcccc78d61111ed68bda2214eea9ea1454acd0f6d034204ce38035ca546"} Jun 03 22:06:24.972319 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:24.972286 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ed30bd5-40f7-4134-9f97-d629fc9ad035" path="/var/lib/kubelet/pods/5ed30bd5-40f7-4134-9f97-d629fc9ad035/volumes" Jun 03 22:06:25.382464 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:25.382375 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb","Type":"ContainerStarted","Data":"dfced780a9f765c4edc64e18f356e94db6787ebea47e95851dd9f990048339a6"} Jun 03 22:06:25.382464 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:25.382447 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb","Type":"ContainerStarted","Data":"6686fe4122949bb831cb582f6807381c9df063cba741a8df7312d3214f906f7d"} Jun 03 22:06:25.382848 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:25.382475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb","Type":"ContainerStarted","Data":"f00d7bee60a3aa453e94d77344195cdfe7b68f9059cec7766e89fa0454542013"} Jun 03 22:06:25.382848 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:25.382506 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb","Type":"ContainerStarted","Data":"3fb1d7e349c77f65f10502fc7477bb943c30acea6f3ff591597cb2580b173edd"} Jun 03 22:06:25.382848 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:25.382530 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb","Type":"ContainerStarted","Data":"154b163262a7a0e3d1fc4903538b6e400c704a10dccdc8f55bcc3ef663a3d0ee"} Jun 03 22:06:25.382848 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:25.382563 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"54ba88b6-52cf-4268-910e-cc0c1e9c7fcb","Type":"ContainerStarted","Data":"8928635e8ef529ba868851eec7c1f2014836fcfc17dc39bf418c0b26b14be698"} Jun 03 22:06:25.411727 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:25.411656 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.388214359 podStartE2EDuration="2.411638183s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.423824ms" isStatefulPod=false podCreationTimestamp="2026-06-03 22:06:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:06:25.410247528 +0000 UTC m=+388.885128655" watchObservedRunningTime="2026-06-03 22:06:25.411638183 +0000 UTC m=+388.886519339" Jun 03 22:06:27.452420 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:27.452379 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:27.553179 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:27.553148 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:29.068030 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:29.067983 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:06:37.417651 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:37.417611 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:37.518691 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:37.518654 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:37.581005 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:37.580977 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:38.651434 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:38.651397 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:38.764066 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:38.764018 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:06:38.822517 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:06:38.822477 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:01.007237 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:01.007205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:01.108638 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:01.108603 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:24.067964 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:24.067932 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:07:24.084184 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:24.084159 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:07:24.613165 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:24.613140 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 22:07:32.960603 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:32.960544 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:33.064074 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:33.064023 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:34.468643 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:34.468609 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:34.521563 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:34.521525 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:44.838400 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:44.838363 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:44.892241 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:44.892207 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:45.882573 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:45.882536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:45.984096 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:45.984039 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:46.085162 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:46.085127 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:47.543584 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:47.543544 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:48.818824 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:48.818783 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:48.920761 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:48.920725 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:07:49.020716 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:07:49.020671 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:08:37.853390 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:37.853303 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:08:37.947452 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:37.947417 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" limit=1024 Jun 03 22:08:40.531106 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:40.531080 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-582tg_d4d176ad-9a2b-473b-bd39-3a91857755e1/global-pull-secret-syncer/0.log" Jun 03 22:08:40.687438 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:40.687410 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7qh9f_96dec97d-dd0e-49f2-94ac-4a0b54fd4d28/konnectivity-agent/0.log" Jun 03 22:08:40.789997 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:40.789920 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-139.ec2.internal_55770dce513cfd126cc2cf19f107bfda/haproxy/0.log" Jun 03 22:08:44.988303 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:44.988223 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-859d68b648-9vddz_6e156e23-af8f-4f91-8582-10f8877b6311/metrics-server/0.log" Jun 03 22:08:45.170778 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:45.170747 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bqtmw_3abe68d6-f17f-4e52-9119-8e3509517acf/node-exporter/0.log" Jun 03 22:08:45.205931 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:45.205900 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bqtmw_3abe68d6-f17f-4e52-9119-8e3509517acf/kube-rbac-proxy/0.log" Jun 03 22:08:45.228667 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:45.228640 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bqtmw_3abe68d6-f17f-4e52-9119-8e3509517acf/init-textfile/0.log" Jun 03 22:08:45.446332 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:45.446298 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_54ba88b6-52cf-4268-910e-cc0c1e9c7fcb/prometheus/0.log" Jun 03 22:08:45.479014 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:45.478984 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_54ba88b6-52cf-4268-910e-cc0c1e9c7fcb/config-reloader/0.log" Jun 03 22:08:45.511408 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:45.511381 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_54ba88b6-52cf-4268-910e-cc0c1e9c7fcb/thanos-sidecar/0.log" Jun 03 22:08:45.572776 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:45.572749 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_54ba88b6-52cf-4268-910e-cc0c1e9c7fcb/kube-rbac-proxy-web/0.log" Jun 03 22:08:45.604527 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:45.604504 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_54ba88b6-52cf-4268-910e-cc0c1e9c7fcb/kube-rbac-proxy/0.log" Jun 03 22:08:45.633957 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:45.633934 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_54ba88b6-52cf-4268-910e-cc0c1e9c7fcb/kube-rbac-proxy-thanos/0.log" Jun 03 22:08:45.675759 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:45.675735 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_54ba88b6-52cf-4268-910e-cc0c1e9c7fcb/init-config-reloader/0.log" Jun 03 22:08:47.831840 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:47.831803 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd"] Jun 03 22:08:47.835201 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:47.835176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:47.837637 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:47.837611 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hnj5l\"/\"openshift-service-ca.crt\"" Jun 03 22:08:47.838514 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:47.838499 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hnj5l\"/\"kube-root-ca.crt\"" Jun 03 22:08:47.838622 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:47.838601 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hnj5l\"/\"default-dockercfg-5kf24\"" Jun 03 22:08:47.843178 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:47.843158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd"] Jun 03 22:08:47.949292 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:47.949259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2e7893e-0b25-440b-87e4-338def1b9f55-proc\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:47.949472 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:47.949300 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2e7893e-0b25-440b-87e4-338def1b9f55-sys\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:47.949472 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:47.949332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2e7893e-0b25-440b-87e4-338def1b9f55-lib-modules\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:47.949472 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:47.949360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbjw9\" (UniqueName: \"kubernetes.io/projected/e2e7893e-0b25-440b-87e4-338def1b9f55-kube-api-access-pbjw9\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:47.949472 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:47.949383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2e7893e-0b25-440b-87e4-338def1b9f55-podres\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:48.049973 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.049937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2e7893e-0b25-440b-87e4-338def1b9f55-sys\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:48.049973 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.049976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2e7893e-0b25-440b-87e4-338def1b9f55-lib-modules\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:48.050186 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.049997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbjw9\" (UniqueName: \"kubernetes.io/projected/e2e7893e-0b25-440b-87e4-338def1b9f55-kube-api-access-pbjw9\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:48.050186 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.050018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2e7893e-0b25-440b-87e4-338def1b9f55-podres\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:48.050186 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.050101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2e7893e-0b25-440b-87e4-338def1b9f55-proc\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:48.050186 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.050099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2e7893e-0b25-440b-87e4-338def1b9f55-sys\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:48.050186 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.050146 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2e7893e-0b25-440b-87e4-338def1b9f55-lib-modules\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:48.050186 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.050171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2e7893e-0b25-440b-87e4-338def1b9f55-proc\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:48.050370 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.050196 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2e7893e-0b25-440b-87e4-338def1b9f55-podres\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:48.058681 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.058659 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbjw9\" (UniqueName: \"kubernetes.io/projected/e2e7893e-0b25-440b-87e4-338def1b9f55-kube-api-access-pbjw9\") pod \"perf-node-gather-daemonset-wbjkd\" (UID: \"e2e7893e-0b25-440b-87e4-338def1b9f55\") " pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:48.145854 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.145743 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:48.273229 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.273153 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd"] Jun 03 22:08:48.886044 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.886009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" event={"ID":"e2e7893e-0b25-440b-87e4-338def1b9f55","Type":"ContainerStarted","Data":"8a14077386b6831183af71857c1d3a9ecf21f1c013c292ae1a37b1183634888b"} Jun 03 22:08:48.886459 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.886085 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" event={"ID":"e2e7893e-0b25-440b-87e4-338def1b9f55","Type":"ContainerStarted","Data":"e02b7f1e520a5c8c8ae56cd08f52f70d9e6af80694012b82f68f84e9e6b64173"} Jun 03 22:08:48.886459 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:48.886134 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:49.588587 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:49.588559 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xtjwm_d1d4e60f-af44-4ecd-9436-9cc2cea58767/dns/0.log" Jun 03 22:08:49.616667 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:49.616644 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xtjwm_d1d4e60f-af44-4ecd-9436-9cc2cea58767/kube-rbac-proxy/0.log" Jun 03 22:08:49.749189 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:49.749162 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w2kgw_513cb310-b56c-4ff7-bb64-11b039711b95/dns-node-resolver/0.log" Jun 03 22:08:50.163319 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:50.163288 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7954f7bdbb-hrp58_2a1a20fe-2905-4c96-9319-60159efb2d0e/registry/0.log" Jun 03 22:08:50.240339 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:50.240312 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tvm2z_aee1e2a7-6e76-4a8e-9890-183c5b4be52e/node-ca/0.log" Jun 03 22:08:51.259651 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:51.259619 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xm9zn_9db704ae-7d04-41da-825d-5a8db00b8fb8/serve-healthcheck-canary/0.log" Jun 03 22:08:51.678773 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:51.678749 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cq2fx_107dea25-c6b1-48cd-80bc-5145bcfe80f3/kube-rbac-proxy/0.log" Jun 03 22:08:51.699979 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:51.699956 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cq2fx_107dea25-c6b1-48cd-80bc-5145bcfe80f3/exporter/0.log" Jun 03 22:08:51.720603 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:51.720579 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cq2fx_107dea25-c6b1-48cd-80bc-5145bcfe80f3/extractor/0.log" Jun 03 22:08:54.900520 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:54.900489 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" Jun 03 22:08:54.917084 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:54.917021 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hnj5l/perf-node-gather-daemonset-wbjkd" podStartSLOduration=7.917004305 podStartE2EDuration="7.917004305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:08:48.904776591 +0000 UTC m=+532.379657717" watchObservedRunningTime="2026-06-03 22:08:54.917004305 +0000 UTC m=+538.391885431" Jun 03 22:08:57.118437 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:57.118405 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6qb8_c3e06f1b-89bb-4bfa-8e12-3f252e64f255/kube-multus-additional-cni-plugins/0.log" Jun 03 22:08:57.141897 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:57.141865 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6qb8_c3e06f1b-89bb-4bfa-8e12-3f252e64f255/egress-router-binary-copy/0.log" Jun 03 22:08:57.171113 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:57.171086 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6qb8_c3e06f1b-89bb-4bfa-8e12-3f252e64f255/cni-plugins/0.log" Jun 03 22:08:57.192816 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:57.192791 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6qb8_c3e06f1b-89bb-4bfa-8e12-3f252e64f255/bond-cni-plugin/0.log" Jun 03 22:08:57.217405 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:57.217369 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6qb8_c3e06f1b-89bb-4bfa-8e12-3f252e64f255/routeoverride-cni/0.log" Jun 03 22:08:57.240765 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:57.240741 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6qb8_c3e06f1b-89bb-4bfa-8e12-3f252e64f255/whereabouts-cni-bincopy/0.log" Jun 03 22:08:57.261496 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:57.261424 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6qb8_c3e06f1b-89bb-4bfa-8e12-3f252e64f255/whereabouts-cni/0.log" Jun 03 22:08:57.503831 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:57.503794 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pq28l_138fe142-a354-430d-ba62-07913e04eb71/kube-multus/0.log" Jun 03 22:08:57.557794 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:57.557706 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4wpm2_bc891b78-9de2-441d-9e93-86bcded1ab6e/network-metrics-daemon/0.log" Jun 03 22:08:57.579021 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:57.578988 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4wpm2_bc891b78-9de2-441d-9e93-86bcded1ab6e/kube-rbac-proxy/0.log" Jun 03 22:08:58.420966 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:58.420939 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/ovn-controller/0.log" Jun 03 22:08:58.444422 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:58.444399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/ovn-acl-logging/0.log" Jun 03 22:08:58.444545 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:58.444405 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/ovn-acl-logging/1.log" Jun 03 22:08:58.468013 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:58.467989 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/kube-rbac-proxy-node/0.log" Jun 03 22:08:58.491634 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:58.491610 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 22:08:58.509491 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:58.509465 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/northd/0.log" Jun 03 22:08:58.531438 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:58.531413 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/nbdb/0.log" Jun 03 22:08:58.554667 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:58.554638 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/sbdb/0.log" Jun 03 22:08:58.591114 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:58.591083 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-46r9m_d475ec59-ef91-43eb-a554-dca9dc1e7571/ovnkube-controller/0.log" Jun 03 22:08:59.924835 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:08:59.924799 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-97gxk_027116fa-8b61-40cb-b594-b30abc3ed3d3/network-check-target-container/0.log" Jun 03 22:09:00.901557 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:09:00.901531 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vtnlf_91b3edf3-9583-4b87-886e-64c5cab5b548/iptables-alerter/0.log" Jun 03 22:09:01.594802 ip-10-0-138-139 kubenswrapper[2578]: I0603 22:09:01.594772 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-q7sws_c23c08fc-365a-4285-ba77-582a9f9a1dd9/tuned/0.log"