Jun 08 15:59:47.081141 ip-10-0-138-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 15:59:47.081156 ip-10-0-138-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 15:59:47.081165 ip-10-0-138-187 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 15:59:47.081354 ip-10-0-138-187 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 15:59:57.308593 ip-10-0-138-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 15:59:57.308607 ip-10-0-138-187 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 44e2300a5d734d39bcb53c711feef5f7 -- Jun 08 16:02:38.193611 ip-10-0-138-187 systemd[1]: Starting Kubernetes Kubelet... Jun 08 16:02:38.596444 ip-10-0-138-187 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 16:02:38.596444 ip-10-0-138-187 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 16:02:38.596444 ip-10-0-138-187 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 16:02:38.596444 ip-10-0-138-187 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 16:02:38.596444 ip-10-0-138-187 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 16:02:38.597096 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.596502 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 16:02:38.601562 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601547 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 16:02:38.601562 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601562 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601567 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601570 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601573 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601576 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601578 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601581 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601583 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601586 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601589 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601592 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601594 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601597 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601599 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601602 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601605 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601609 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601611 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601614 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601617 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 16:02:38.601626 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601619 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601622 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601624 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601627 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601629 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601632 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601637 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601641 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601645 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601648 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601651 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601654 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601657 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601660 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601662 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601665 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601667 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601670 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601673 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 16:02:38.602093 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601675 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601678 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601680 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601684 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601686 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601689 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601691 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601694 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601696 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601699 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601701 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601704 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601707 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601710 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601712 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601716 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601720 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601724 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601726 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601729 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 16:02:38.602569 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601732 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601734 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601737 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601739 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601742 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601744 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601748 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601750 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601753 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601755 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601758 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601760 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601763 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601766 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601771 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601774 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601777 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601779 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601782 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601785 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 16:02:38.603056 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601788 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601791 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601793 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601796 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601799 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601801 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601804 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601807 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601810 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601812 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601815 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601817 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601820 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601823 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601825 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601828 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601830 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601833 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.601835 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602564 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 16:02:38.603540 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602570 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602573 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602576 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602579 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602582 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602585 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602588 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602590 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602593 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602596 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602599 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602602 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602605 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602610 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602614 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602617 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602620 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602623 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602627 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 16:02:38.604021 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602631 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602634 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602637 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602640 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602642 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602645 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602648 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602651 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602653 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602656 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602659 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602662 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602664 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602667 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602670 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602672 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602675 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602678 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602681 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602683 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 16:02:38.604508 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602686 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602689 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602691 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602694 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602697 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602700 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602702 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602705 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602708 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602710 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602713 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602716 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602718 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602721 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602724 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602726 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602729 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602731 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602734 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602736 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 16:02:38.604991 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602739 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602741 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602743 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602746 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602748 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602751 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602753 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602756 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602758 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602761 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602764 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602766 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602769 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602771 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602774 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602778 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602782 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602784 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602787 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602789 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 16:02:38.605491 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602792 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602794 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602797 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602799 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602802 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602805 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602807 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602810 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602812 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602814 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602818 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602821 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602824 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602826 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602829 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602831 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602834 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602836 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.602840 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603189 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 16:02:38.605984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603194 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603197 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603200 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603203 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603206 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603208 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603211 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603214 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603217 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603220 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603223 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603226 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603229 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603231 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603234 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603237 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603239 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603242 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603244 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603247 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 16:02:38.606505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603249 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603252 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603255 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603257 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603276 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603279 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603282 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603285 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603287 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603290 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603292 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603295 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603298 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603300 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603303 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603305 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603307 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603310 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603313 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 16:02:38.607012 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603315 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603318 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603321 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603324 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603327 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603329 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603332 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603334 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603341 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603344 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603346 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603349 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603352 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603355 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603358 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603360 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603363 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603365 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603368 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603370 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 16:02:38.607486 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603373 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603376 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603378 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603381 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603383 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603386 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603388 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603391 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603394 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603396 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603399 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603401 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603404 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603406 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603409 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603412 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603415 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603418 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603421 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603425 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 16:02:38.607989 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603429 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603434 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603437 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603440 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603443 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603447 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603450 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603453 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603456 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603459 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603461 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603464 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603467 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603470 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603473 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603476 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603478 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603481 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.603483 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603553 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 16:02:38.608468 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603560 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603567 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603572 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603576 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603579 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603583 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603587 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603590 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603594 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603597 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603601 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603604 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603609 2567 flags.go:64] FLAG: --cgroup-root="" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603612 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603615 2567 flags.go:64] FLAG: --client-ca-file="" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603618 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603621 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603625 2567 flags.go:64] FLAG: --cluster-domain="" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603628 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603631 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603634 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603638 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603641 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 16:02:38.608973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603644 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603647 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603651 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603654 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603659 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603662 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603665 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603667 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603672 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603675 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603678 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603681 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603684 2567 flags.go:64] FLAG: --enable-server="true" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603687 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603692 2567 flags.go:64] FLAG: --event-burst="100" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603695 2567 flags.go:64] FLAG: --event-qps="50" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603698 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603701 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603705 2567 flags.go:64] FLAG: --eviction-hard="" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603709 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603711 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603716 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603719 2567 flags.go:64] FLAG: --eviction-soft="" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603721 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603724 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 16:02:38.609627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603727 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603730 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603733 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603736 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603739 2567 flags.go:64] FLAG: --feature-gates="" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603743 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603746 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603749 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603752 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603755 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603758 2567 flags.go:64] FLAG: --help="false" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603762 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603765 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603768 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603771 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603774 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603778 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603780 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603783 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603786 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603789 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603791 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603795 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603797 2567 flags.go:64] FLAG: --kube-reserved="" Jun 08 16:02:38.610319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603800 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603803 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603806 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603809 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603813 2567 flags.go:64] FLAG: --lock-file="" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603816 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603819 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603822 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603827 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603830 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603833 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603835 2567 flags.go:64] FLAG: --logging-format="text" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603838 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603842 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603845 2567 flags.go:64] FLAG: --manifest-url="" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603847 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603851 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603854 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603858 2567 flags.go:64] FLAG: --max-pods="110" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603862 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603865 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603869 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603872 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603875 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603877 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 16:02:38.611155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603880 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603887 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603890 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603893 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603896 2567 flags.go:64] FLAG: --pod-cidr="" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603899 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603904 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603907 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603910 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603913 2567 flags.go:64] FLAG: --port="10250" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603916 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603919 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06a88bb17fc7d4f2f" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603924 2567 flags.go:64] FLAG: --qos-reserved="" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603927 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603930 2567 flags.go:64] FLAG: --register-node="true" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603933 2567 flags.go:64] FLAG: --register-with-taints="" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603936 2567 flags.go:64] FLAG: --registry-burst="10" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603939 2567 flags.go:64] FLAG: --registry-qps="5" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603942 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603944 2567 flags.go:64] FLAG: --reserved-memory="" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603948 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603951 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603954 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603957 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603960 2567 flags.go:64] FLAG: --runonce="false" Jun 08 16:02:38.611910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603962 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603966 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603969 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603972 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603975 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603978 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603981 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603984 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603986 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603989 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603992 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603995 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.603998 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604001 2567 flags.go:64] FLAG: --system-cgroups="" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604003 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604008 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604011 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604014 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604018 2567 flags.go:64] FLAG: --tls-min-version="" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604022 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604025 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604028 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604031 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604034 2567 flags.go:64] FLAG: --v="2" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604038 2567 flags.go:64] FLAG: --version="false" Jun 08 16:02:38.612547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604042 2567 flags.go:64] FLAG: --vmodule="" Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604046 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.604049 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604166 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604170 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604174 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604179 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604182 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604186 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604190 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604192 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604195 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604198 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604201 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604204 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604206 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604209 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604212 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604215 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 16:02:38.613164 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604217 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604220 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604222 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604225 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604227 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604230 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604232 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604236 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604239 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604242 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604244 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604247 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604250 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604254 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604257 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604272 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604275 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604277 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604280 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 16:02:38.613670 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604283 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604285 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604290 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604292 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604295 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604298 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604300 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604303 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604306 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604308 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604311 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604313 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604316 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604318 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604321 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604323 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604326 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604329 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604331 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604334 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 16:02:38.614131 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604337 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604340 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604343 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604345 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604348 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604351 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604354 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604356 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604359 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604362 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604364 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604367 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604370 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604372 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604376 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604379 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604382 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604384 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604387 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604390 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 16:02:38.614679 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604392 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604395 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604397 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604400 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604403 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604405 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604408 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604410 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604413 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604415 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604418 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604420 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604423 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604425 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604428 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604431 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604433 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604436 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604438 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604441 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 16:02:38.615165 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604443 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604447 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604450 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.604453 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.605067 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.613450 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.613466 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.613487 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.613493 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613552 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613557 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613560 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613564 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613567 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 16:02:38.615702 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613570 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613573 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613576 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613578 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613581 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613584 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613586 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613589 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613592 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613594 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613597 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613601 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613604 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613607 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613610 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613613 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613615 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613618 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613621 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613624 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 08 16:02:38.616045 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613626 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613629 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613632 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613634 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613638 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613641 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613645 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613648 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613652 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613655 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613658 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613661 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613664 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613666 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613669 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613672 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613675 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613678 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613681 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 16:02:38.616548 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613683 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613686 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613689 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613692 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613694 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613697 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613700 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613703 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613705 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613708 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613711 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613713 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613716 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613718 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613721 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613723 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613726 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613729 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613732 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613735 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 16:02:38.617003 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613738 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613741 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613743 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613746 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613749 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613751 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613754 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613756 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613759 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613761 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613764 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613767 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613769 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613772 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613775 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613778 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613780 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613783 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613785 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 16:02:38.617505 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613788 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613791 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613795 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613799 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613802 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613805 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613808 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613810 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613814 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613816 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613819 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613822 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613825 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613828 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613830 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 16:02:38.617961 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613833 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.613838 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613953 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613958 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613961 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613964 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613966 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613969 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613972 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613974 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613977 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613980 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613983 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613986 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 16:02:38.618352 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613989 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613992 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613994 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613997 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.613999 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614002 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614004 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614007 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614009 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614012 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614014 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614017 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614019 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614022 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614025 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614028 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614030 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614033 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614036 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 16:02:38.618694 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614039 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614041 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614044 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614046 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614049 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614052 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614054 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614057 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614059 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614062 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614064 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614067 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614070 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614072 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614080 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614085 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614088 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614091 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614094 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 16:02:38.619157 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614097 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614100 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614103 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614106 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614108 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614111 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614113 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614116 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614119 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614121 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614124 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614126 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614129 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614133 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614137 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614140 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614143 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614146 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614148 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614151 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 16:02:38.619827 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614153 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614156 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614158 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614161 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614164 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614166 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614169 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614171 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614174 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614177 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614179 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614182 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614184 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614187 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614190 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614192 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614195 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614197 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614200 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614202 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 16:02:38.620354 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614205 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614207 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614210 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614212 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614216 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614220 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614223 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614226 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:38.614230 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.614235 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.614359 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.617761 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.619363 2567 server.go:1019] "Starting client certificate rotation" Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.619465 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 16:02:38.620837 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.619493 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 16:02:38.622324 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.622308 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 16:02:38.623596 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.623579 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 16:02:38.635184 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.635166 2567 log.go:25] "Validated CRI v1 runtime API" Jun 08 16:02:38.638391 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.638373 2567 log.go:25] "Validated CRI v1 image API" Jun 08 16:02:38.639190 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.639176 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 16:02:38.641569 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.641550 2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a769e2af-0e60-419b-977d-d29343605a72:/dev/nvme0n1p4 c255bef3-48d8-4de1-a9de-d96e0d543a8a:/dev/nvme0n1p3] Jun 08 16:02:38.641621 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.641569 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 16:02:38.647997 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.647883 2567 manager.go:216] Machine: {Timestamp:2026-06-08 16:02:38.646125691 +0000 UTC m=+0.333771919 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099237 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2445e0ebf7e8c83b4e11f3483268e9 SystemUUID:ec2445e0-ebf7-e8c8-3b4e-11f3483268e9 BootID:44e2300a-5d73-4d39-bcb5-3c711feef5f7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cd:1f:d7:30:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cd:1f:d7:30:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:b6:13:34:ff:b5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 16:02:38.647997 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.647984 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 16:02:38.648115 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.648104 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 16:02:38.650858 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.650842 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 16:02:38.651503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.651470 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 16:02:38.651638 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.651508 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 16:02:38.653039 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.653027 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 16:02:38.653087 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.653042 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 16:02:38.653087 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.653050 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 16:02:38.653904 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.653894 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 16:02:38.655621 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.655612 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 16:02:38.659879 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.659868 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 08 16:02:38.659994 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.659985 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 16:02:38.660024 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.660015 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 08 16:02:38.660058 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.660025 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 16:02:38.660058 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.660038 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 16:02:38.660058 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.660047 2567 kubelet.go:398] "Adding apiserver pod source" Jun 08 16:02:38.660058 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.660056 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 16:02:38.660434 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.660423 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 16:02:38.660469 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.660442 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 16:02:38.662778 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.662764 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 16:02:38.664482 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.664467 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 16:02:38.664537 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.664499 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 16:02:38.665159 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.665148 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 16:02:38.665202 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.665167 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 16:02:38.665202 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.665173 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 16:02:38.665202 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.665178 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 16:02:38.665202 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.665186 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 16:02:38.665202 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.665191 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 16:02:38.665355 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.665206 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 16:02:38.665355 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.665211 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 16:02:38.665355 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.665217 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 16:02:38.665355 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.665223 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 16:02:38.665355 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.665231 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 16:02:38.665355 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.665240 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 16:02:38.666178 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.666168 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 16:02:38.666211 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.666179 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 16:02:38.669661 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.669643 2567 server.go:1268] "Started kubelet" Jun 08 16:02:38.669756 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.669718 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 16:02:38.669756 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.669711 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 16:02:38.669867 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.669775 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 16:02:38.670531 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.670498 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 16:02:38.670696 ip-10-0-138-187 systemd[1]: Started Kubernetes Kubelet. Jun 08 16:02:38.671376 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.671348 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 16:02:38.671376 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.671348 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 16:02:38.672163 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.672146 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 16:02:38.672224 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.672201 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 08 16:02:38.674857 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.674840 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xfsg7" Jun 08 16:02:38.675877 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.674964 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-187.ec2.internal.18b7268b99b8189a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-187.ec2.internal,UID:ip-10-0-138-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-187.ec2.internal,},FirstTimestamp:2026-06-08 16:02:38.669609114 +0000 UTC m=+0.357255386,LastTimestamp:2026-06-08 16:02:38.669609114 +0000 UTC m=+0.357255386,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-187.ec2.internal,}" Jun 08 16:02:38.677369 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.677341 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 16:02:38.680144 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.680126 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 16:02:38.680144 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.680139 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 16:02:38.680303 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.680196 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:38.680846 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.680829 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 16:02:38.680846 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.680832 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 16:02:38.680999 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.680855 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 16:02:38.680999 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.680943 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 08 16:02:38.680999 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.680953 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 08 16:02:38.681133 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.681120 2567 factory.go:153] Registering CRI-O factory Jun 08 16:02:38.681178 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.681138 2567 factory.go:223] Registration of the crio container factory successfully Jun 08 16:02:38.681220 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.681187 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 16:02:38.681220 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.681195 2567 factory.go:55] Registering systemd factory Jun 08 16:02:38.681220 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.681202 2567 factory.go:223] Registration of the systemd container factory successfully Jun 08 16:02:38.681350 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.681222 2567 factory.go:103] Registering Raw factory Jun 08 16:02:38.681350 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.681236 2567 manager.go:1196] Started watching for new ooms in manager Jun 08 16:02:38.681712 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.681699 2567 manager.go:349] Starting recovery of all containers Jun 08 16:02:38.682274 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.682238 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xfsg7" Jun 08 16:02:38.687456 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.687426 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 16:02:38.687577 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.687549 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 16:02:38.692883 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.692863 2567 manager.go:354] Recovery completed Jun 08 16:02:38.693109 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.693073 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 16:02:38.697685 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.697671 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:02:38.699650 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.699635 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:02:38.699716 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.699662 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:02:38.699716 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.699673 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:02:38.700148 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.700132 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 16:02:38.700148 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.700144 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:02:38.700255 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.700146 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 16:02:38.700255 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.700203 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 08 16:02:38.700869 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.700855 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:02:38.700911 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.700881 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:02:38.700911 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.700893 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:02:38.703337 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.703325 2567 policy_none.go:49] "None policy: Start" Jun 08 16:02:38.703375 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.703340 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 16:02:38.703375 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.703350 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 16:02:38.706521 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.706508 2567 policy_none.go:47] "Start" Jun 08 16:02:38.749847 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.749827 2567 manager.go:337] "Starting Device Plugin manager" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.749887 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.749901 2567 server.go:87] "Starting device plugin registration server" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.750178 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.750198 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.750308 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.750382 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.750388 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.750984 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.751028 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.755944 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.755980 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.756000 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.756058 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 16:02:38.767753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.757582 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 16:02:38.851133 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.851046 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:02:38.852081 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.852064 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:02:38.852180 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.852093 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:02:38.852180 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.852109 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:02:38.852180 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.852134 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.856677 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.856650 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-187.ec2.internal"] Jun 08 16:02:38.856765 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.856710 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:02:38.857649 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.857633 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.857715 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.857662 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-187.ec2.internal\": node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:38.859167 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.859151 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:02:38.859251 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.859176 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:02:38.859251 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.859185 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:02:38.860595 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.860583 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:02:38.860721 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.860706 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.860779 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.860743 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:02:38.861308 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.861293 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:02:38.861308 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.861302 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:02:38.861420 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.861321 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:02:38.861420 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.861332 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:02:38.861420 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.861322 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:02:38.861420 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.861398 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:02:38.862675 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.862656 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.862760 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.862683 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 16:02:38.863392 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.863377 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientMemory" Jun 08 16:02:38.863484 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.863401 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 16:02:38.863484 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.863413 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeHasSufficientPID" Jun 08 16:02:38.870092 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.870077 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:38.882238 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.882216 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba07de9be2df1e9dac4223012fc61b35-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal\" (UID: \"ba07de9be2df1e9dac4223012fc61b35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.882321 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.882244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba07de9be2df1e9dac4223012fc61b35-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal\" (UID: \"ba07de9be2df1e9dac4223012fc61b35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.882321 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.882273 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d9a7da251adaa160bd8e8117559b219-config\") pod \"kube-apiserver-proxy-ip-10-0-138-187.ec2.internal\" (UID: \"9d9a7da251adaa160bd8e8117559b219\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.890926 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.890907 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-187.ec2.internal\" not found" node="ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.895275 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.895246 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-187.ec2.internal\" not found" node="ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.971138 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:38.971105 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:38.982415 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.982387 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d9a7da251adaa160bd8e8117559b219-config\") pod \"kube-apiserver-proxy-ip-10-0-138-187.ec2.internal\" (UID: \"9d9a7da251adaa160bd8e8117559b219\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.982532 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.982429 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba07de9be2df1e9dac4223012fc61b35-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal\" (UID: \"ba07de9be2df1e9dac4223012fc61b35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.982532 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.982450 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba07de9be2df1e9dac4223012fc61b35-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal\" (UID: \"ba07de9be2df1e9dac4223012fc61b35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.982532 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.982481 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d9a7da251adaa160bd8e8117559b219-config\") pod \"kube-apiserver-proxy-ip-10-0-138-187.ec2.internal\" (UID: \"9d9a7da251adaa160bd8e8117559b219\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.982532 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.982492 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba07de9be2df1e9dac4223012fc61b35-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal\" (UID: \"ba07de9be2df1e9dac4223012fc61b35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" Jun 08 16:02:38.982532 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:38.982492 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba07de9be2df1e9dac4223012fc61b35-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal\" (UID: \"ba07de9be2df1e9dac4223012fc61b35\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" Jun 08 16:02:39.071604 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:39.071559 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:39.172407 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:39.172381 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:39.196892 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.196865 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" Jun 08 16:02:39.200962 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.200947 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-187.ec2.internal" Jun 08 16:02:39.272999 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:39.272965 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:39.373525 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:39.373487 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:39.474119 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:39.474041 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:39.574556 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:39.574521 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:39.619102 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.619080 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 16:02:39.619685 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.619224 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 16:02:39.675469 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:39.675322 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:39.690316 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.690277 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 15:57:38 +0000 UTC" deadline="2027-12-20 19:52:43.258960467 +0000 UTC" Jun 08 16:02:39.690316 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.690304 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13443h50m3.568659051s" Jun 08 16:02:39.718870 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:39.718836 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9a7da251adaa160bd8e8117559b219.slice/crio-0ceed65909ada20b2bcc103ee53d015b32b074494d09562563e58b23853afe36 WatchSource:0}: Error finding container 0ceed65909ada20b2bcc103ee53d015b32b074494d09562563e58b23853afe36: Status 404 returned error can't find the container with id 0ceed65909ada20b2bcc103ee53d015b32b074494d09562563e58b23853afe36 Jun 08 16:02:39.719542 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:39.719520 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba07de9be2df1e9dac4223012fc61b35.slice/crio-e72baa5b994a8a5032c821ef42009873f17dfe3c518ba4e8ad2842e73f403084 WatchSource:0}: Error finding container e72baa5b994a8a5032c821ef42009873f17dfe3c518ba4e8ad2842e73f403084: Status 404 returned error can't find the container with id e72baa5b994a8a5032c821ef42009873f17dfe3c518ba4e8ad2842e73f403084 Jun 08 16:02:39.724078 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.724064 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 16:02:39.759696 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.759639 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-187.ec2.internal" event={"ID":"9d9a7da251adaa160bd8e8117559b219","Type":"ContainerStarted","Data":"0ceed65909ada20b2bcc103ee53d015b32b074494d09562563e58b23853afe36"} Jun 08 16:02:39.760670 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.760648 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" event={"ID":"ba07de9be2df1e9dac4223012fc61b35","Type":"ContainerStarted","Data":"e72baa5b994a8a5032c821ef42009873f17dfe3c518ba4e8ad2842e73f403084"} Jun 08 16:02:39.775815 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:39.775795 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-187.ec2.internal\" not found" Jun 08 16:02:39.783867 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.783645 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 16:02:39.805478 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.805455 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 16:02:39.880782 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.880758 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" Jun 08 16:02:39.892970 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.892950 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 16:02:39.894107 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.894095 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-187.ec2.internal" Jun 08 16:02:39.902359 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.902343 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 16:02:39.968026 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:39.968000 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 16:02:40.661252 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.661206 2567 apiserver.go:52] "Watching apiserver" Jun 08 16:02:40.669864 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.669836 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 16:02:40.670401 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.670375 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jtdfn","kube-system/kube-apiserver-proxy-ip-10-0-138-187.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7","openshift-cluster-node-tuning-operator/tuned-rq462","openshift-dns/node-resolver-kr566","openshift-multus/multus-additional-cni-plugins-jg2qf","openshift-network-diagnostics/network-check-target-dmr5k","openshift-ovn-kubernetes/ovnkube-node-dqj2d","kube-system/konnectivity-agent-2mmd6","openshift-image-registry/node-ca-qzhm8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal","openshift-multus/multus-jlznc","openshift-multus/network-metrics-daemon-ps27h","openshift-network-operator/iptables-alerter-mwpwg"] Jun 08 16:02:40.672093 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.672066 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mmd6" Jun 08 16:02:40.673507 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.673482 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:40.673674 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:40.673643 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:02:40.675026 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.674509 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 16:02:40.675026 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.674689 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7mvpb\"" Jun 08 16:02:40.675026 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.674726 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.675026 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.674863 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 16:02:40.676290 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.676118 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qzhm8" Jun 08 16:02:40.677124 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.677087 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 16:02:40.677961 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.677320 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 16:02:40.677961 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.677481 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z676b\"" Jun 08 16:02:40.677961 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.677543 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 16:02:40.677961 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.677723 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kr566" Jun 08 16:02:40.677961 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.677736 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 16:02:40.678497 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.678475 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 16:02:40.678497 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.678492 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 16:02:40.678888 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.678727 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 16:02:40.678888 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.678729 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n6mf9\"" Jun 08 16:02:40.678888 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.678852 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.680048 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.680029 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:40.680145 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:40.680097 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:02:40.680221 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.680205 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 16:02:40.680291 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.680257 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hsqsb\"" Jun 08 16:02:40.680352 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.680205 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 16:02:40.680843 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.680825 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 16:02:40.681769 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.681278 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.682228 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.682201 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 16:02:40.682331 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.682293 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-47dh7\"" Jun 08 16:02:40.682486 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.682469 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 16:02:40.682818 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.682801 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.685315 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.683800 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 16:02:40.685315 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.683946 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vmwq6\"" Jun 08 16:02:40.685315 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.684716 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 16:02:40.685315 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.684863 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 16:02:40.685315 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.684967 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 16:02:40.685315 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.685124 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 16:02:40.685712 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.685696 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 16:02:40.686063 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.686047 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 16:02:40.686403 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.686387 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:40.686487 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:40.686467 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:02:40.686545 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.686496 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 16:02:40.686776 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.686755 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j2h95\"" Jun 08 16:02:40.687858 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.687829 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.689351 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.689219 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mwpwg" Jun 08 16:02:40.690929 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.690909 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 16:02:40.691341 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.691116 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 16:02:40.691341 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.691239 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9s5kc\"" Jun 08 16:02:40.691519 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.691485 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 16:02:40.691583 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.691567 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 16:02:40.691828 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.691799 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-run-systemd\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.691922 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.691836 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-run-ovn\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.691922 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.691865 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww6gw\" (UniqueName: \"kubernetes.io/projected/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-kube-api-access-ww6gw\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.691922 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.691890 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-run-ovn-kubernetes\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.691922 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.691913 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-sysctl-conf\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.692128 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.691935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-run-netns\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.692128 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.691957 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-etc-kubernetes\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.692128 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.691980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ef00d38-4d8f-457c-aadd-720dbc72d8c2-agent-certs\") pod \"konnectivity-agent-2mmd6\" (UID: \"5ef00d38-4d8f-457c-aadd-720dbc72d8c2\") " pod="kube-system/konnectivity-agent-2mmd6" Jun 08 16:02:40.692128 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692004 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-sysconfig\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.692128 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692027 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-host\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.692128 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692050 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-var-lib-cni-bin\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.692128 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692075 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-log-socket\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.692128 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692095 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f2qsk\"" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692098 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-cni-bin\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692225 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692230 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dcc3c005-3b85-4892-a0af-bfb57b816951-ovnkube-config\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf2hl\" (UniqueName: \"kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl\") pod \"network-check-target-dmr5k\" (UID: \"3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4\") " pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692293 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-var-lib-openvswitch\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692315 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-cnibin\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692336 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-run-netns\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692358 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692381 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-kubernetes\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692406 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692408 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-var-lib-cni-multus\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692430 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-var-lib-kubelet\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692451 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/97a38f50-42ab-4195-a445-e65e696a54a2-serviceca\") pod \"node-ca-qzhm8\" (UID: \"97a38f50-42ab-4195-a445-e65e696a54a2\") " pod="openshift-image-registry/node-ca-qzhm8" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692472 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnvph\" (UniqueName: \"kubernetes.io/projected/e961beec-d71c-4045-9141-cf0114549316-kube-api-access-qnvph\") pod \"node-resolver-kr566\" (UID: \"e961beec-d71c-4045-9141-cf0114549316\") " pod="openshift-dns/node-resolver-kr566" Jun 08 16:02:40.692524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692494 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-multus-daemon-config\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-run-multus-certs\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692559 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e961beec-d71c-4045-9141-cf0114549316-hosts-file\") pod \"node-resolver-kr566\" (UID: \"e961beec-d71c-4045-9141-cf0114549316\") " pod="openshift-dns/node-resolver-kr566" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-systemd-units\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692647 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-sys\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692764 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-multus-cni-dir\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-hostroot\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-multus-conf-dir\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692849 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-node-log\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-cni-netd\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692902 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dcc3c005-3b85-4892-a0af-bfb57b816951-env-overrides\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.692930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78xwb\" (UniqueName: \"kubernetes.io/projected/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-kube-api-access-78xwb\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693003 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-run-k8s-cni-cncf-io\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xgmc\" (UniqueName: \"kubernetes.io/projected/97a38f50-42ab-4195-a445-e65e696a54a2-kube-api-access-6xgmc\") pod \"node-ca-qzhm8\" (UID: \"97a38f50-42ab-4195-a445-e65e696a54a2\") " pod="openshift-image-registry/node-ca-qzhm8" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693060 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvnsm\" (UniqueName: \"kubernetes.io/projected/dcc3c005-3b85-4892-a0af-bfb57b816951-kube-api-access-gvnsm\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-run\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.693348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693108 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-os-release\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693140 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-cni-binary-copy\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693170 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-kubelet\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693175 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-run-openvswitch\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693238 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-tuned\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-systemd\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-multus-socket-dir-parent\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693391 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97a38f50-42ab-4195-a445-e65e696a54a2-host\") pod \"node-ca-qzhm8\" (UID: \"97a38f50-42ab-4195-a445-e65e696a54a2\") " pod="openshift-image-registry/node-ca-qzhm8" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693447 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dcc3c005-3b85-4892-a0af-bfb57b816951-ovn-node-metrics-cert\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693505 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dcc3c005-3b85-4892-a0af-bfb57b816951-ovnkube-script-lib\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693535 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp7w7\" (UniqueName: \"kubernetes.io/projected/b5e10afe-54a1-42cd-9ad3-bce820a97e56-kube-api-access-wp7w7\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693561 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e961beec-d71c-4045-9141-cf0114549316-tmp-dir\") pod \"node-resolver-kr566\" (UID: \"e961beec-d71c-4045-9141-cf0114549316\") " pod="openshift-dns/node-resolver-kr566" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693584 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-modprobe-d\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693668 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-var-lib-kubelet\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-system-cni-dir\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-slash\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.694136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693745 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-etc-openvswitch\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.694912 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693767 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-sysctl-d\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.694912 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-lib-modules\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.694912 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693810 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ef00d38-4d8f-457c-aadd-720dbc72d8c2-konnectivity-ca\") pod \"konnectivity-agent-2mmd6\" (UID: \"5ef00d38-4d8f-457c-aadd-720dbc72d8c2\") " pod="kube-system/konnectivity-agent-2mmd6" Jun 08 16:02:40.694912 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.693831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5e10afe-54a1-42cd-9ad3-bce820a97e56-tmp\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.711711 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.711689 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2fv74" Jun 08 16:02:40.722460 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.722134 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2fv74" Jun 08 16:02:40.782331 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.782304 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 16:02:40.794099 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794068 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-os-release\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.794099 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-cni-binary-copy\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794125 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-kubelet\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-run-openvswitch\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794173 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-tuned\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794200 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-os-release\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-socket-dir\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794230 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-systemd\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794253 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-run-openvswitch\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794256 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-multus-socket-dir-parent\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794321 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-kubelet\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794339 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97a38f50-42ab-4195-a445-e65e696a54a2-host\") pod \"node-ca-qzhm8\" (UID: \"97a38f50-42ab-4195-a445-e65e696a54a2\") " pod="openshift-image-registry/node-ca-qzhm8" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794325 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-systemd\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794372 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-multus-socket-dir-parent\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.794371 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794376 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dcc3c005-3b85-4892-a0af-bfb57b816951-ovn-node-metrics-cert\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794387 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97a38f50-42ab-4195-a445-e65e696a54a2-host\") pod \"node-ca-qzhm8\" (UID: \"97a38f50-42ab-4195-a445-e65e696a54a2\") " pod="openshift-image-registry/node-ca-qzhm8" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dcc3c005-3b85-4892-a0af-bfb57b816951-ovnkube-script-lib\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794449 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp7w7\" (UniqueName: \"kubernetes.io/projected/b5e10afe-54a1-42cd-9ad3-bce820a97e56-kube-api-access-wp7w7\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794473 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e961beec-d71c-4045-9141-cf0114549316-tmp-dir\") pod \"node-resolver-kr566\" (UID: \"e961beec-d71c-4045-9141-cf0114549316\") " pod="openshift-dns/node-resolver-kr566" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794528 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-modprobe-d\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-var-lib-kubelet\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794538 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794582 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-device-dir\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-system-cni-dir\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794634 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-slash\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-etc-openvswitch\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794735 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794756 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-slash\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794765 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-cni-binary-copy\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794773 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4jwz\" (UniqueName: \"kubernetes.io/projected/7240a0c6-264a-4231-8db1-04f88a751c79-kube-api-access-d4jwz\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.795010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794808 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-sysctl-d\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-lib-modules\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794879 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-var-lib-kubelet\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794882 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ef00d38-4d8f-457c-aadd-720dbc72d8c2-konnectivity-ca\") pod \"konnectivity-agent-2mmd6\" (UID: \"5ef00d38-4d8f-457c-aadd-720dbc72d8c2\") " pod="kube-system/konnectivity-agent-2mmd6" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5e10afe-54a1-42cd-9ad3-bce820a97e56-tmp\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794948 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-cnibin\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.794970 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-etc-selinux\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-sys-fs\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795054 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dcc3c005-3b85-4892-a0af-bfb57b816951-ovnkube-script-lib\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795067 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-modprobe-d\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-run-systemd\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795089 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-run-systemd\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795105 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-run-ovn\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795119 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e961beec-d71c-4045-9141-cf0114549316-tmp-dir\") pod \"node-resolver-kr566\" (UID: \"e961beec-d71c-4045-9141-cf0114549316\") " pod="openshift-dns/node-resolver-kr566" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795166 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-lib-modules\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795170 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795198 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-run-ovn\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.795752 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795227 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-etc-openvswitch\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795282 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-sysctl-d\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795285 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-system-cni-dir\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795298 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww6gw\" (UniqueName: \"kubernetes.io/projected/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-kube-api-access-ww6gw\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795383 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ef00d38-4d8f-457c-aadd-720dbc72d8c2-konnectivity-ca\") pod \"konnectivity-agent-2mmd6\" (UID: \"5ef00d38-4d8f-457c-aadd-720dbc72d8c2\") " pod="kube-system/konnectivity-agent-2mmd6" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795420 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-run-ovn-kubernetes\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795457 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795462 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-run-ovn-kubernetes\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-registration-dir\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795560 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3fc1d906-60d3-4e77-b11d-f353e39348ef-iptables-alerter-script\") pod \"iptables-alerter-mwpwg\" (UID: \"3fc1d906-60d3-4e77-b11d-f353e39348ef\") " pod="openshift-network-operator/iptables-alerter-mwpwg" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795602 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-sysctl-conf\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795653 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-run-netns\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795680 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-etc-kubernetes\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-sysctl-conf\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795690 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-run-netns\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795713 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ef00d38-4d8f-457c-aadd-720dbc72d8c2-agent-certs\") pod \"konnectivity-agent-2mmd6\" (UID: \"5ef00d38-4d8f-457c-aadd-720dbc72d8c2\") " pod="kube-system/konnectivity-agent-2mmd6" Jun 08 16:02:40.796546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795734 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-etc-kubernetes\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795738 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-sysconfig\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-host\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795786 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-var-lib-cni-bin\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-log-socket\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795832 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-sysconfig\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795853 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-host\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-cni-bin\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795882 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-cni-bin\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795892 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-var-lib-cni-bin\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dcc3c005-3b85-4892-a0af-bfb57b816951-ovnkube-config\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795932 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-log-socket\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795939 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2hl\" (UniqueName: \"kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl\") pod \"network-check-target-dmr5k\" (UID: \"3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4\") " pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795968 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-kubelet-config\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.795994 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz7xs\" (UniqueName: \"kubernetes.io/projected/3fc1d906-60d3-4e77-b11d-f353e39348ef-kube-api-access-kz7xs\") pod \"iptables-alerter-mwpwg\" (UID: \"3fc1d906-60d3-4e77-b11d-f353e39348ef\") " pod="openshift-network-operator/iptables-alerter-mwpwg" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796022 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-var-lib-openvswitch\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796046 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.797368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796070 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-dbus\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796093 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-cnibin\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796118 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-run-netns\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796141 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796163 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-kubernetes\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796186 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-system-cni-dir\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796210 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-var-lib-cni-multus\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796233 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-var-lib-kubelet\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796296 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-var-lib-kubelet\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796311 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-cnibin\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796341 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-run-netns\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796349 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/97a38f50-42ab-4195-a445-e65e696a54a2-serviceca\") pod \"node-ca-qzhm8\" (UID: \"97a38f50-42ab-4195-a445-e65e696a54a2\") " pod="openshift-image-registry/node-ca-qzhm8" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796359 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dcc3c005-3b85-4892-a0af-bfb57b816951-ovnkube-config\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnvph\" (UniqueName: \"kubernetes.io/projected/e961beec-d71c-4045-9141-cf0114549316-kube-api-access-qnvph\") pod \"node-resolver-kr566\" (UID: \"e961beec-d71c-4045-9141-cf0114549316\") " pod="openshift-dns/node-resolver-kr566" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796414 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6tgb\" (UniqueName: \"kubernetes.io/projected/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-kube-api-access-r6tgb\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:40.796426 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796441 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-var-lib-openvswitch\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.798100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fc1d906-60d3-4e77-b11d-f353e39348ef-host-slash\") pod \"iptables-alerter-mwpwg\" (UID: \"3fc1d906-60d3-4e77-b11d-f353e39348ef\") " pod="openshift-network-operator/iptables-alerter-mwpwg" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:40.796499 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs podName:b1df1dda-f1d7-4d55-afad-f80e3256cf0f nodeName:}" failed. No retries permitted until 2026-06-08 16:02:41.296478528 +0000 UTC m=+2.984124759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs") pod "network-metrics-daemon-ps27h" (UID: "b1df1dda-f1d7-4d55-afad-f80e3256cf0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796548 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-multus-daemon-config\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796577 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-run-multus-certs\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796602 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e961beec-d71c-4045-9141-cf0114549316-hosts-file\") pod \"node-resolver-kr566\" (UID: \"e961beec-d71c-4045-9141-cf0114549316\") " pod="openshift-dns/node-resolver-kr566" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796624 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-systemd-units\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796621 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-var-lib-cni-multus\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796648 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-sys\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796697 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-run-multus-certs\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796700 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796745 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-kubernetes\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796745 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-systemd-units\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796762 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e961beec-d71c-4045-9141-cf0114549316-hosts-file\") pod \"node-resolver-kr566\" (UID: \"e961beec-d71c-4045-9141-cf0114549316\") " pod="openshift-dns/node-resolver-kr566" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796706 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-multus-cni-dir\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796827 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-hostroot\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796850 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-multus-conf-dir\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.798909 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.796854 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/97a38f50-42ab-4195-a445-e65e696a54a2-serviceca\") pod \"node-ca-qzhm8\" (UID: \"97a38f50-42ab-4195-a445-e65e696a54a2\") " pod="openshift-image-registry/node-ca-qzhm8" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798374 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-node-log\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-cni-netd\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798454 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dcc3c005-3b85-4892-a0af-bfb57b816951-env-overrides\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798493 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78xwb\" (UniqueName: \"kubernetes.io/projected/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-kube-api-access-78xwb\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-run-k8s-cni-cncf-io\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xgmc\" (UniqueName: \"kubernetes.io/projected/97a38f50-42ab-4195-a445-e65e696a54a2-kube-api-access-6xgmc\") pod \"node-ca-qzhm8\" (UID: \"97a38f50-42ab-4195-a445-e65e696a54a2\") " pod="openshift-image-registry/node-ca-qzhm8" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798591 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvnsm\" (UniqueName: \"kubernetes.io/projected/dcc3c005-3b85-4892-a0af-bfb57b816951-kube-api-access-gvnsm\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798618 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-run\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798651 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-os-release\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798725 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-multus-daemon-config\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798785 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-host-cni-netd\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798794 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ef00d38-4d8f-457c-aadd-720dbc72d8c2-agent-certs\") pod \"konnectivity-agent-2mmd6\" (UID: \"5ef00d38-4d8f-457c-aadd-720dbc72d8c2\") " pod="kube-system/konnectivity-agent-2mmd6" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.798992 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5e10afe-54a1-42cd-9ad3-bce820a97e56-tmp\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.799682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.799322 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dcc3c005-3b85-4892-a0af-bfb57b816951-node-log\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.800361 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.799386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-sys\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.800361 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.799494 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-host-run-k8s-cni-cncf-io\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.800577 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.799568 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-hostroot\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.800577 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.799628 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-multus-cni-dir\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.800577 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.799682 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5e10afe-54a1-42cd-9ad3-bce820a97e56-run\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.800577 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.799791 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dcc3c005-3b85-4892-a0af-bfb57b816951-env-overrides\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.800577 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.799860 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-multus-conf-dir\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.800577 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.799997 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5e10afe-54a1-42cd-9ad3-bce820a97e56-etc-tuned\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.800577 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.800186 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dcc3c005-3b85-4892-a0af-bfb57b816951-ovn-node-metrics-cert\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.803139 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:40.803117 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:02:40.803245 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:40.803146 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:02:40.803245 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:40.803159 2567 projected.go:196] Error preparing data for projected volume kube-api-access-bf2hl for pod openshift-network-diagnostics/network-check-target-dmr5k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:02:40.803368 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:40.803285 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl podName:3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4 nodeName:}" failed. No retries permitted until 2026-06-08 16:02:41.303251343 +0000 UTC m=+2.990897580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bf2hl" (UniqueName: "kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl") pod "network-check-target-dmr5k" (UID: "3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:02:40.803513 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.803490 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww6gw\" (UniqueName: \"kubernetes.io/projected/47016bc9-ac6f-4c3e-aae7-4a825aa959f0-kube-api-access-ww6gw\") pod \"multus-jlznc\" (UID: \"47016bc9-ac6f-4c3e-aae7-4a825aa959f0\") " pod="openshift-multus/multus-jlznc" Jun 08 16:02:40.804375 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.804333 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp7w7\" (UniqueName: \"kubernetes.io/projected/b5e10afe-54a1-42cd-9ad3-bce820a97e56-kube-api-access-wp7w7\") pod \"tuned-rq462\" (UID: \"b5e10afe-54a1-42cd-9ad3-bce820a97e56\") " pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:40.808696 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.808673 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xgmc\" (UniqueName: \"kubernetes.io/projected/97a38f50-42ab-4195-a445-e65e696a54a2-kube-api-access-6xgmc\") pod \"node-ca-qzhm8\" (UID: \"97a38f50-42ab-4195-a445-e65e696a54a2\") " pod="openshift-image-registry/node-ca-qzhm8" Jun 08 16:02:40.808936 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.808914 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78xwb\" (UniqueName: \"kubernetes.io/projected/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-kube-api-access-78xwb\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:40.809020 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.808936 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvnsm\" (UniqueName: \"kubernetes.io/projected/dcc3c005-3b85-4892-a0af-bfb57b816951-kube-api-access-gvnsm\") pod \"ovnkube-node-dqj2d\" (UID: \"dcc3c005-3b85-4892-a0af-bfb57b816951\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:40.809338 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.809317 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnvph\" (UniqueName: \"kubernetes.io/projected/e961beec-d71c-4045-9141-cf0114549316-kube-api-access-qnvph\") pod \"node-resolver-kr566\" (UID: \"e961beec-d71c-4045-9141-cf0114549316\") " pod="openshift-dns/node-resolver-kr566" Jun 08 16:02:40.899357 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899325 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-kubelet-config\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:40.899357 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899359 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz7xs\" (UniqueName: \"kubernetes.io/projected/3fc1d906-60d3-4e77-b11d-f353e39348ef-kube-api-access-kz7xs\") pod \"iptables-alerter-mwpwg\" (UID: \"3fc1d906-60d3-4e77-b11d-f353e39348ef\") " pod="openshift-network-operator/iptables-alerter-mwpwg" Jun 08 16:02:40.899588 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899385 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.899588 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-dbus\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:40.899588 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-system-cni-dir\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.899588 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899442 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-kubelet-config\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:40.899588 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899465 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6tgb\" (UniqueName: \"kubernetes.io/projected/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-kube-api-access-r6tgb\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.899588 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fc1d906-60d3-4e77-b11d-f353e39348ef-host-slash\") pod \"iptables-alerter-mwpwg\" (UID: \"3fc1d906-60d3-4e77-b11d-f353e39348ef\") " pod="openshift-network-operator/iptables-alerter-mwpwg" Jun 08 16:02:40.899588 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899519 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-os-release\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.899588 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-socket-dir\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.899588 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899565 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-dbus\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:40.899588 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899574 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899618 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-device-dir\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899649 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899676 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4jwz\" (UniqueName: \"kubernetes.io/projected/7240a0c6-264a-4231-8db1-04f88a751c79-kube-api-access-d4jwz\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899686 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-os-release\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899702 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-cnibin\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899714 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fc1d906-60d3-4e77-b11d-f353e39348ef-host-slash\") pod \"iptables-alerter-mwpwg\" (UID: \"3fc1d906-60d3-4e77-b11d-f353e39348ef\") " pod="openshift-network-operator/iptables-alerter-mwpwg" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899518 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-system-cni-dir\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899737 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-cnibin\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899742 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899744 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-etc-selinux\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-sys-fs\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899794 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-etc-selinux\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899797 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-device-dir\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899817 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899850 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.900054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.900725 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899904 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-registration-dir\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.900725 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.899928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3fc1d906-60d3-4e77-b11d-f353e39348ef-iptables-alerter-script\") pod \"iptables-alerter-mwpwg\" (UID: \"3fc1d906-60d3-4e77-b11d-f353e39348ef\") " pod="openshift-network-operator/iptables-alerter-mwpwg" Jun 08 16:02:40.900725 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:40.899949 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:02:40.900725 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:40.900031 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret podName:5d749a0d-b6b8-429f-a970-e1ea1b8bff6f nodeName:}" failed. No retries permitted until 2026-06-08 16:02:41.400011397 +0000 UTC m=+3.087657627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret") pod "global-pull-secret-syncer-jtdfn" (UID: "5d749a0d-b6b8-429f-a970-e1ea1b8bff6f") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:02:40.900725 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.900037 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-socket-dir\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.900725 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.900052 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-sys-fs\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.900725 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.900085 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.900725 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.900113 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-registration-dir\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.900725 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.900155 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7240a0c6-264a-4231-8db1-04f88a751c79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.900725 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.900252 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.900725 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.900536 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3fc1d906-60d3-4e77-b11d-f353e39348ef-iptables-alerter-script\") pod \"iptables-alerter-mwpwg\" (UID: \"3fc1d906-60d3-4e77-b11d-f353e39348ef\") " pod="openshift-network-operator/iptables-alerter-mwpwg" Jun 08 16:02:40.901114 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.901093 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.908117 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.908091 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6tgb\" (UniqueName: \"kubernetes.io/projected/7bb13c11-b1d3-4936-9ad2-9b594fe91a0b-kube-api-access-r6tgb\") pod \"multus-additional-cni-plugins-jg2qf\" (UID: \"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:40.908277 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.908242 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4jwz\" (UniqueName: \"kubernetes.io/projected/7240a0c6-264a-4231-8db1-04f88a751c79-kube-api-access-d4jwz\") pod \"aws-ebs-csi-driver-node-8zpl7\" (UID: \"7240a0c6-264a-4231-8db1-04f88a751c79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:40.908573 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.908547 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz7xs\" (UniqueName: \"kubernetes.io/projected/3fc1d906-60d3-4e77-b11d-f353e39348ef-kube-api-access-kz7xs\") pod \"iptables-alerter-mwpwg\" (UID: \"3fc1d906-60d3-4e77-b11d-f353e39348ef\") " pod="openshift-network-operator/iptables-alerter-mwpwg" Jun 08 16:02:40.986596 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.986510 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mmd6" Jun 08 16:02:40.996419 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:40.996397 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jlznc" Jun 08 16:02:41.007246 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.007217 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qzhm8" Jun 08 16:02:41.011308 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.011285 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kr566" Jun 08 16:02:41.020068 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.020048 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rq462" Jun 08 16:02:41.027196 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.027166 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:02:41.034950 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.034930 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jg2qf" Jun 08 16:02:41.040787 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.040766 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" Jun 08 16:02:41.046500 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.046481 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mwpwg" Jun 08 16:02:41.171615 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.171587 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 16:02:41.302899 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.302826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:41.303060 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:41.302956 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:02:41.303060 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:41.303008 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs podName:b1df1dda-f1d7-4d55-afad-f80e3256cf0f nodeName:}" failed. No retries permitted until 2026-06-08 16:02:42.30299261 +0000 UTC m=+3.990638832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs") pod "network-metrics-daemon-ps27h" (UID: "b1df1dda-f1d7-4d55-afad-f80e3256cf0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:02:41.403176 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.403142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:41.403440 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.403194 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2hl\" (UniqueName: \"kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl\") pod \"network-check-target-dmr5k\" (UID: \"3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4\") " pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:41.403440 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:41.403257 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:02:41.403440 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:41.403361 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret podName:5d749a0d-b6b8-429f-a970-e1ea1b8bff6f nodeName:}" failed. No retries permitted until 2026-06-08 16:02:42.403341224 +0000 UTC m=+4.090987441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret") pod "global-pull-secret-syncer-jtdfn" (UID: "5d749a0d-b6b8-429f-a970-e1ea1b8bff6f") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:02:41.403440 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:41.403363 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:02:41.403440 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:41.403383 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:02:41.403440 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:41.403394 2567 projected.go:196] Error preparing data for projected volume kube-api-access-bf2hl for pod openshift-network-diagnostics/network-check-target-dmr5k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:02:41.403440 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:41.403430 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl podName:3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4 nodeName:}" failed. No retries permitted until 2026-06-08 16:02:42.403419756 +0000 UTC m=+4.091065970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bf2hl" (UniqueName: "kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl") pod "network-check-target-dmr5k" (UID: "3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:02:41.724916 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.724860 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 15:57:40 +0000 UTC" deadline="2028-01-28 17:24:07.154203728 +0000 UTC" Jun 08 16:02:41.724916 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.724912 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14377h21m25.429294894s" Jun 08 16:02:41.735574 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:41.735542 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7240a0c6_264a_4231_8db1_04f88a751c79.slice/crio-6a299ee1897787c8d2d73554defecaed8a9ee4f33cf17055752acf663804bc36 WatchSource:0}: Error finding container 6a299ee1897787c8d2d73554defecaed8a9ee4f33cf17055752acf663804bc36: Status 404 returned error can't find the container with id 6a299ee1897787c8d2d73554defecaed8a9ee4f33cf17055752acf663804bc36 Jun 08 16:02:41.752984 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:41.752929 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e10afe_54a1_42cd_9ad3_bce820a97e56.slice/crio-7c0ea4a37471bd3865410fd9a250c3e80400c80583f6fcec1d2aac19d391e1ab WatchSource:0}: Error finding container 7c0ea4a37471bd3865410fd9a250c3e80400c80583f6fcec1d2aac19d391e1ab: Status 404 returned error can't find the container with id 7c0ea4a37471bd3865410fd9a250c3e80400c80583f6fcec1d2aac19d391e1ab Jun 08 16:02:41.753781 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:41.753760 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a38f50_42ab_4195_a445_e65e696a54a2.slice/crio-9e880ba1b223d7bc06ea5c7e187fb07664682b2d911791ee206f9caa5360c6f0 WatchSource:0}: Error finding container 9e880ba1b223d7bc06ea5c7e187fb07664682b2d911791ee206f9caa5360c6f0: Status 404 returned error can't find the container with id 9e880ba1b223d7bc06ea5c7e187fb07664682b2d911791ee206f9caa5360c6f0 Jun 08 16:02:41.754936 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:41.754919 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb13c11_b1d3_4936_9ad2_9b594fe91a0b.slice/crio-a05b7de69ebe89dde7f705822b302e98fec86fafd2d588789a99b70fd3c662fd WatchSource:0}: Error finding container a05b7de69ebe89dde7f705822b302e98fec86fafd2d588789a99b70fd3c662fd: Status 404 returned error can't find the container with id a05b7de69ebe89dde7f705822b302e98fec86fafd2d588789a99b70fd3c662fd Jun 08 16:02:41.757326 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:41.757274 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode961beec_d71c_4045_9141_cf0114549316.slice/crio-6072a66aeea6a05d8853ac718f863d4100c93b2a175f305e15f29c69e7ba13fd WatchSource:0}: Error finding container 6072a66aeea6a05d8853ac718f863d4100c93b2a175f305e15f29c69e7ba13fd: Status 404 returned error can't find the container with id 6072a66aeea6a05d8853ac718f863d4100c93b2a175f305e15f29c69e7ba13fd Jun 08 16:02:41.758198 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:41.758174 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef00d38_4d8f_457c_aadd_720dbc72d8c2.slice/crio-dd72315f1143c6896a49e6756e7cdbe495134e71a52b02daf570234bcca04b0f WatchSource:0}: Error finding container dd72315f1143c6896a49e6756e7cdbe495134e71a52b02daf570234bcca04b0f: Status 404 returned error can't find the container with id dd72315f1143c6896a49e6756e7cdbe495134e71a52b02daf570234bcca04b0f Jun 08 16:02:41.759242 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:41.759222 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc1d906_60d3_4e77_b11d_f353e39348ef.slice/crio-627391f9817902a36bafeb90a9c74788055389a9a049db1860ecd4e9ad390efd WatchSource:0}: Error finding container 627391f9817902a36bafeb90a9c74788055389a9a049db1860ecd4e9ad390efd: Status 404 returned error can't find the container with id 627391f9817902a36bafeb90a9c74788055389a9a049db1860ecd4e9ad390efd Jun 08 16:02:41.760219 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:41.760031 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47016bc9_ac6f_4c3e_aae7_4a825aa959f0.slice/crio-71f6d460ea209de0133d3e423f8ce63f3a8bdd308524bb8609649fe823fc88ca WatchSource:0}: Error finding container 71f6d460ea209de0133d3e423f8ce63f3a8bdd308524bb8609649fe823fc88ca: Status 404 returned error can't find the container with id 71f6d460ea209de0133d3e423f8ce63f3a8bdd308524bb8609649fe823fc88ca Jun 08 16:02:41.761937 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:02:41.761732 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc3c005_3b85_4892_a0af_bfb57b816951.slice/crio-e611b579bb577d36f4bd99c34a46240002ce73315e0e12dae0a6bf7f550b7597 WatchSource:0}: Error finding container e611b579bb577d36f4bd99c34a46240002ce73315e0e12dae0a6bf7f550b7597: Status 404 returned error can't find the container with id e611b579bb577d36f4bd99c34a46240002ce73315e0e12dae0a6bf7f550b7597 Jun 08 16:02:41.765065 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.765034 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kr566" event={"ID":"e961beec-d71c-4045-9141-cf0114549316","Type":"ContainerStarted","Data":"6072a66aeea6a05d8853ac718f863d4100c93b2a175f305e15f29c69e7ba13fd"} Jun 08 16:02:41.766365 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.766341 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rq462" event={"ID":"b5e10afe-54a1-42cd-9ad3-bce820a97e56","Type":"ContainerStarted","Data":"7c0ea4a37471bd3865410fd9a250c3e80400c80583f6fcec1d2aac19d391e1ab"} Jun 08 16:02:41.767774 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.767739 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" event={"ID":"7240a0c6-264a-4231-8db1-04f88a751c79","Type":"ContainerStarted","Data":"6a299ee1897787c8d2d73554defecaed8a9ee4f33cf17055752acf663804bc36"} Jun 08 16:02:41.769910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.769887 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qzhm8" event={"ID":"97a38f50-42ab-4195-a445-e65e696a54a2","Type":"ContainerStarted","Data":"9e880ba1b223d7bc06ea5c7e187fb07664682b2d911791ee206f9caa5360c6f0"} Jun 08 16:02:41.773382 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.772136 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mmd6" event={"ID":"5ef00d38-4d8f-457c-aadd-720dbc72d8c2","Type":"ContainerStarted","Data":"dd72315f1143c6896a49e6756e7cdbe495134e71a52b02daf570234bcca04b0f"} Jun 08 16:02:41.774366 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.774340 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jg2qf" event={"ID":"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b","Type":"ContainerStarted","Data":"a05b7de69ebe89dde7f705822b302e98fec86fafd2d588789a99b70fd3c662fd"} Jun 08 16:02:41.775597 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.775572 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" event={"ID":"dcc3c005-3b85-4892-a0af-bfb57b816951","Type":"ContainerStarted","Data":"e611b579bb577d36f4bd99c34a46240002ce73315e0e12dae0a6bf7f550b7597"} Jun 08 16:02:41.779720 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.779691 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mwpwg" event={"ID":"3fc1d906-60d3-4e77-b11d-f353e39348ef","Type":"ContainerStarted","Data":"627391f9817902a36bafeb90a9c74788055389a9a049db1860ecd4e9ad390efd"} Jun 08 16:02:41.780834 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:41.780811 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jlznc" event={"ID":"47016bc9-ac6f-4c3e-aae7-4a825aa959f0","Type":"ContainerStarted","Data":"71f6d460ea209de0133d3e423f8ce63f3a8bdd308524bb8609649fe823fc88ca"} Jun 08 16:02:42.309971 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:42.309883 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:42.310126 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:42.310060 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:02:42.310201 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:42.310129 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs podName:b1df1dda-f1d7-4d55-afad-f80e3256cf0f nodeName:}" failed. No retries permitted until 2026-06-08 16:02:44.310108065 +0000 UTC m=+5.997754301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs") pod "network-metrics-daemon-ps27h" (UID: "b1df1dda-f1d7-4d55-afad-f80e3256cf0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:02:42.410820 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:42.410781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:42.411045 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:42.410848 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2hl\" (UniqueName: \"kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl\") pod \"network-check-target-dmr5k\" (UID: \"3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4\") " pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:42.411045 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:42.411004 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:02:42.411045 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:42.411023 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:02:42.411045 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:42.411035 2567 projected.go:196] Error preparing data for projected volume kube-api-access-bf2hl for pod openshift-network-diagnostics/network-check-target-dmr5k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:02:42.411235 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:42.411095 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl podName:3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4 nodeName:}" failed. No retries permitted until 2026-06-08 16:02:44.411076873 +0000 UTC m=+6.098723101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bf2hl" (UniqueName: "kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl") pod "network-check-target-dmr5k" (UID: "3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:02:42.411505 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:42.411418 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:02:42.411505 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:42.411477 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret podName:5d749a0d-b6b8-429f-a970-e1ea1b8bff6f nodeName:}" failed. No retries permitted until 2026-06-08 16:02:44.411461633 +0000 UTC m=+6.099107860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret") pod "global-pull-secret-syncer-jtdfn" (UID: "5d749a0d-b6b8-429f-a970-e1ea1b8bff6f") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:02:42.726167 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:42.726090 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 15:57:40 +0000 UTC" deadline="2027-11-18 10:23:39.71280878 +0000 UTC" Jun 08 16:02:42.726167 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:42.726163 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12666h20m56.986649841s" Jun 08 16:02:42.758086 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:42.757383 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:42.758086 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:42.757397 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:42.758086 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:42.757509 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:02:42.758086 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:42.757911 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:02:42.758086 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:42.757969 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:42.758086 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:42.758041 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:02:42.792285 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:42.791968 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-187.ec2.internal" event={"ID":"9d9a7da251adaa160bd8e8117559b219","Type":"ContainerStarted","Data":"fb58b2a91e47dbc3c2b97c932808180622b8898a21837a9ecaa74bb164b88ea9"} Jun 08 16:02:42.801172 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:42.800439 2567 generic.go:356] "Generic (PLEG): container finished" podID="ba07de9be2df1e9dac4223012fc61b35" containerID="b4108cae0e682e0b9df699eb2145214e92c00edd2f715b187e9f67c5c01ab60c" exitCode=0 Jun 08 16:02:42.801172 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:42.800482 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" event={"ID":"ba07de9be2df1e9dac4223012fc61b35","Type":"ContainerDied","Data":"b4108cae0e682e0b9df699eb2145214e92c00edd2f715b187e9f67c5c01ab60c"} Jun 08 16:02:42.820314 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:42.820230 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-187.ec2.internal" podStartSLOduration=3.820208285 podStartE2EDuration="3.820208285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:02:42.806553443 +0000 UTC m=+4.494199680" watchObservedRunningTime="2026-06-08 16:02:42.820208285 +0000 UTC m=+4.507854522" Jun 08 16:02:43.814046 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:43.813794 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" event={"ID":"ba07de9be2df1e9dac4223012fc61b35","Type":"ContainerStarted","Data":"327254e856e0cfb99c80f684ad95266b3050b2a5b9de6b8f53876ca35e56122d"} Jun 08 16:02:43.836946 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:43.836464 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-187.ec2.internal" podStartSLOduration=4.83644173 podStartE2EDuration="4.83644173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:02:43.831511 +0000 UTC m=+5.519157238" watchObservedRunningTime="2026-06-08 16:02:43.83644173 +0000 UTC m=+5.524087965" Jun 08 16:02:44.327550 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:44.327503 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:44.327743 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:44.327720 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:02:44.327806 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:44.327788 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs podName:b1df1dda-f1d7-4d55-afad-f80e3256cf0f nodeName:}" failed. No retries permitted until 2026-06-08 16:02:48.32776882 +0000 UTC m=+10.015415037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs") pod "network-metrics-daemon-ps27h" (UID: "b1df1dda-f1d7-4d55-afad-f80e3256cf0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:02:44.428180 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:44.428134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:44.428370 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:44.428200 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2hl\" (UniqueName: \"kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl\") pod \"network-check-target-dmr5k\" (UID: \"3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4\") " pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:44.428464 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:44.428403 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:02:44.428464 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:44.428425 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:02:44.428464 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:44.428439 2567 projected.go:196] Error preparing data for projected volume kube-api-access-bf2hl for pod openshift-network-diagnostics/network-check-target-dmr5k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:02:44.428833 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:44.428534 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl podName:3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4 nodeName:}" failed. No retries permitted until 2026-06-08 16:02:48.428513895 +0000 UTC m=+10.116160109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bf2hl" (UniqueName: "kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl") pod "network-check-target-dmr5k" (UID: "3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:02:44.429012 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:44.428980 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:02:44.429103 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:44.429032 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret podName:5d749a0d-b6b8-429f-a970-e1ea1b8bff6f nodeName:}" failed. No retries permitted until 2026-06-08 16:02:48.429017673 +0000 UTC m=+10.116663892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret") pod "global-pull-secret-syncer-jtdfn" (UID: "5d749a0d-b6b8-429f-a970-e1ea1b8bff6f") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:02:44.756464 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:44.756417 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:44.756658 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:44.756550 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:44.756658 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:44.756567 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:02:44.756658 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:44.756589 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:44.756813 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:44.756702 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:02:44.756813 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:44.756786 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:02:46.757281 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:46.757209 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:46.757785 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:46.757366 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:02:46.757785 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:46.757209 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:46.757785 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:46.757708 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:02:46.757943 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:46.757877 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:46.758034 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:46.757991 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:02:48.360771 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:48.360691 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:48.361231 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:48.360874 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:02:48.361231 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:48.360959 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs podName:b1df1dda-f1d7-4d55-afad-f80e3256cf0f nodeName:}" failed. No retries permitted until 2026-06-08 16:02:56.36093521 +0000 UTC m=+18.048581429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs") pod "network-metrics-daemon-ps27h" (UID: "b1df1dda-f1d7-4d55-afad-f80e3256cf0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:02:48.462094 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:48.462057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:48.462307 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:48.462117 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2hl\" (UniqueName: \"kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl\") pod \"network-check-target-dmr5k\" (UID: \"3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4\") " pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:48.462307 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:48.462222 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:02:48.462307 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:48.462292 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:02:48.462307 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:48.462309 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:02:48.462520 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:48.462323 2567 projected.go:196] Error preparing data for projected volume kube-api-access-bf2hl for pod openshift-network-diagnostics/network-check-target-dmr5k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:02:48.462520 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:48.462350 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret podName:5d749a0d-b6b8-429f-a970-e1ea1b8bff6f nodeName:}" failed. No retries permitted until 2026-06-08 16:02:56.462324999 +0000 UTC m=+18.149971229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret") pod "global-pull-secret-syncer-jtdfn" (UID: "5d749a0d-b6b8-429f-a970-e1ea1b8bff6f") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:02:48.462520 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:48.462377 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl podName:3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4 nodeName:}" failed. No retries permitted until 2026-06-08 16:02:56.462360546 +0000 UTC m=+18.150006821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bf2hl" (UniqueName: "kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl") pod "network-check-target-dmr5k" (UID: "3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:02:48.758591 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:48.758557 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:48.758751 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:48.758692 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:02:48.759105 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:48.759083 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:48.759221 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:48.759195 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:02:48.759339 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:48.759243 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:48.759393 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:48.759372 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:02:50.756830 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:50.756793 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:50.756830 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:50.756826 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:50.757519 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:50.756795 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:50.757519 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:50.756929 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:02:50.757519 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:50.757027 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:02:50.757519 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:50.757102 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:02:52.757072 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:52.757033 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:52.757560 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:52.757169 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:02:52.757560 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:52.757507 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:52.757678 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:52.757621 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:02:52.757678 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:52.757650 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:52.757782 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:52.757703 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:02:54.756907 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:54.756869 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:54.757391 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:54.756869 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:54.757391 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:54.757009 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:02:54.757391 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:54.757020 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:54.757391 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:54.757145 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:02:54.757391 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:54.757247 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:02:56.420712 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:56.420679 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:56.421236 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:56.420860 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:02:56.421236 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:56.420940 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs podName:b1df1dda-f1d7-4d55-afad-f80e3256cf0f nodeName:}" failed. No retries permitted until 2026-06-08 16:03:12.420918015 +0000 UTC m=+34.108564244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs") pod "network-metrics-daemon-ps27h" (UID: "b1df1dda-f1d7-4d55-afad-f80e3256cf0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:02:56.521171 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:56.521137 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:56.521171 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:56.521178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2hl\" (UniqueName: \"kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl\") pod \"network-check-target-dmr5k\" (UID: \"3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4\") " pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:56.521404 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:56.521323 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:02:56.521404 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:56.521336 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:02:56.521404 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:56.521350 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:02:56.521404 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:56.521363 2567 projected.go:196] Error preparing data for projected volume kube-api-access-bf2hl for pod openshift-network-diagnostics/network-check-target-dmr5k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:02:56.521404 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:56.521396 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret podName:5d749a0d-b6b8-429f-a970-e1ea1b8bff6f nodeName:}" failed. No retries permitted until 2026-06-08 16:03:12.52137768 +0000 UTC m=+34.209023904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret") pod "global-pull-secret-syncer-jtdfn" (UID: "5d749a0d-b6b8-429f-a970-e1ea1b8bff6f") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:02:56.521614 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:56.521411 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl podName:3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4 nodeName:}" failed. No retries permitted until 2026-06-08 16:03:12.521404761 +0000 UTC m=+34.209050978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bf2hl" (UniqueName: "kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl") pod "network-check-target-dmr5k" (UID: "3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:02:56.756423 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:56.756340 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:56.756570 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:56.756473 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:02:56.756807 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:56.756786 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:56.756936 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:56.756911 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:02:56.757001 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:56.756953 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:56.757064 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:56.757045 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:02:58.757334 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:58.757305 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:02:58.757334 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:58.757334 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:02:58.757922 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:58.757414 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:02:58.757922 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:02:58.757508 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:02:58.757922 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:58.757495 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:02:58.757922 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:02:58.757592 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:03:00.756663 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:00.756494 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:00.757257 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:00.756493 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:00.757257 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:00.756512 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:00.757257 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:00.756754 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:03:00.757257 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:00.756835 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:03:00.757257 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:00.756888 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:03:00.848463 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:00.848423 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jlznc" event={"ID":"47016bc9-ac6f-4c3e-aae7-4a825aa959f0","Type":"ContainerStarted","Data":"3619f5de798b74f49fbe8f8618af44c8527e64f4a4677244f3353ecba533fc87"} Jun 08 16:03:00.849966 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:00.849935 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rq462" event={"ID":"b5e10afe-54a1-42cd-9ad3-bce820a97e56","Type":"ContainerStarted","Data":"1314c6a98460c8c357baac2c454d9e9dde26aae1a3f5ee2a7274aead3bea5922"} Jun 08 16:03:00.853547 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:00.853501 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mmd6" event={"ID":"5ef00d38-4d8f-457c-aadd-720dbc72d8c2","Type":"ContainerStarted","Data":"06aca9c16ca35a648d03ca8a911e49cd2c52a016a0051d9c2154821e10a7eed2"} Jun 08 16:03:00.859872 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:00.855072 2567 generic.go:356] "Generic (PLEG): container finished" podID="7bb13c11-b1d3-4936-9ad2-9b594fe91a0b" containerID="af9141c99ecd8cab60e017477c00843eb2ec4c7a85e91ebce759d4eef8eac44e" exitCode=0 Jun 08 16:03:00.859872 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:00.855107 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jg2qf" event={"ID":"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b","Type":"ContainerDied","Data":"af9141c99ecd8cab60e017477c00843eb2ec4c7a85e91ebce759d4eef8eac44e"} Jun 08 16:03:00.868627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:00.868573 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jlznc" podStartSLOduration=4.304542797 podStartE2EDuration="22.868559281s" totalImagesPullingTime="18.564016484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:00.867359951 +0000 UTC m=+22.555006188" watchObservedRunningTime="2026-06-08 16:03:00.868559281 +0000 UTC m=+22.556205516" Jun 08 16:03:00.883844 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:00.883691 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rq462" podStartSLOduration=3.320069439 podStartE2EDuration="21.883668621s" totalImagesPullingTime="18.563599182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:00.883526312 +0000 UTC m=+22.571172548" watchObservedRunningTime="2026-06-08 16:03:00.883668621 +0000 UTC m=+22.571314857" Jun 08 16:03:00.923319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:00.923255 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2mmd6" podStartSLOduration=4.365192475 podStartE2EDuration="22.923238619s" totalImagesPullingTime="18.558046144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:00.922729332 +0000 UTC m=+22.610375568" watchObservedRunningTime="2026-06-08 16:03:00.923238619 +0000 UTC m=+22.610884854" Jun 08 16:03:00.992638 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:00.992613 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:01.092362 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.092332 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:01.300069 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.300004 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:01.594520 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.594482 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:01.860678 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.860643 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/ovn-acl-logging/0.log" Jun 08 16:03:01.861165 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.861105 2567 generic.go:356] "Generic (PLEG): container finished" podID="dcc3c005-3b85-4892-a0af-bfb57b816951" containerID="c909f38580508fda6ed889820ad03158b10d23e5d7e8cfabaf0aebbd43e13799" exitCode=1 Jun 08 16:03:01.861240 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.861176 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" event={"ID":"dcc3c005-3b85-4892-a0af-bfb57b816951","Type":"ContainerStarted","Data":"f4e43b097d64666233d39f05184c24f733de0770b8e4e86f184ddb73a48ce384"} Jun 08 16:03:01.861363 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.861338 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" event={"ID":"dcc3c005-3b85-4892-a0af-bfb57b816951","Type":"ContainerStarted","Data":"10a2dce946ffe3e89da90de146adde249823e64765bb8bdfbe31605cf599b079"} Jun 08 16:03:01.861447 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.861398 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" event={"ID":"dcc3c005-3b85-4892-a0af-bfb57b816951","Type":"ContainerStarted","Data":"5564a7df11be061adb3467f527525d5eb8218c794bc9e51ae46f40365fb25e2a"} Jun 08 16:03:01.861506 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.861444 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" event={"ID":"dcc3c005-3b85-4892-a0af-bfb57b816951","Type":"ContainerStarted","Data":"a40bcffd69c90abff5f5f13253298f40d2e7faaf44516b464a090deae006595f"} Jun 08 16:03:01.861506 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.861490 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" event={"ID":"dcc3c005-3b85-4892-a0af-bfb57b816951","Type":"ContainerDied","Data":"c909f38580508fda6ed889820ad03158b10d23e5d7e8cfabaf0aebbd43e13799"} Jun 08 16:03:01.861604 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.861539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" event={"ID":"dcc3c005-3b85-4892-a0af-bfb57b816951","Type":"ContainerStarted","Data":"4988c1b561be87863cde9c34c3dffd5cbe7e2c5ea4d930e3975f3e93a528609b"} Jun 08 16:03:01.862974 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.862948 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mwpwg" event={"ID":"3fc1d906-60d3-4e77-b11d-f353e39348ef","Type":"ContainerStarted","Data":"bb01cbe85eeb1ab4a3f22a413aa10cb8fdf014520f3375f9ad2d79b3e2bc5f55"} Jun 08 16:03:01.864666 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.864601 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kr566" event={"ID":"e961beec-d71c-4045-9141-cf0114549316","Type":"ContainerStarted","Data":"99edce27297cc3174dde6c570c197e3842707ee45de1da3cfdd2abee53a69375"} Jun 08 16:03:01.866438 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.866415 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" event={"ID":"7240a0c6-264a-4231-8db1-04f88a751c79","Type":"ContainerStarted","Data":"cba88d5c84303275f5b6a4c8620ee03a703cc449ff081d7714561dbd17f80625"} Jun 08 16:03:01.868531 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.868504 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qzhm8" event={"ID":"97a38f50-42ab-4195-a445-e65e696a54a2","Type":"ContainerStarted","Data":"192b8460419bdeeec0347475a4130054e359458523c28873b9bfa3cf5df9aa83"} Jun 08 16:03:01.878113 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.878053 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mwpwg" podStartSLOduration=4.321429614 podStartE2EDuration="22.878031658s" totalImagesPullingTime="18.556602044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:01.877541469 +0000 UTC m=+23.565187707" watchObservedRunningTime="2026-06-08 16:03:01.878031658 +0000 UTC m=+23.565677896" Jun 08 16:03:01.892864 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.892806 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qzhm8" podStartSLOduration=5.327850505 podStartE2EDuration="23.892784407s" totalImagesPullingTime="18.564933902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:01.891987382 +0000 UTC m=+23.579633620" watchObservedRunningTime="2026-06-08 16:03:01.892784407 +0000 UTC m=+23.580430649" Jun 08 16:03:01.908160 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:01.908102 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kr566" podStartSLOduration=5.343177058 podStartE2EDuration="23.90808685s" totalImagesPullingTime="18.564909792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:01.907539471 +0000 UTC m=+23.595185708" watchObservedRunningTime="2026-06-08 16:03:01.90808685 +0000 UTC m=+23.595733084" Jun 08 16:03:02.192719 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.192674 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:02.251067 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.251031 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:02.391176 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.391148 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:02.434751 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.434725 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 16:03:02.436734 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.436708 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2mmd6" Jun 08 16:03:02.437257 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.437234 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2mmd6" Jun 08 16:03:02.626609 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.626578 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:02.727104 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.727013 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:02.757229 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.757195 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:02.757390 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.757195 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:02.757390 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:02.757343 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:03:02.757390 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.757367 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:02.757501 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:02.757477 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:03:02.757592 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:02.757571 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:03:02.761277 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.761183 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T16:03:02.434745972Z","UUID":"eac54516-cbcd-448c-83a8-418b4fd63f7f","Handler":null,"Name":"","Endpoint":""} Jun 08 16:03:02.762840 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.762805 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 16:03:02.762949 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.762848 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 16:03:02.827564 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.827534 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:02.872370 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.872335 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" event={"ID":"7240a0c6-264a-4231-8db1-04f88a751c79","Type":"ContainerStarted","Data":"8575f09362251d35e2e159db8d48d103ff540c039cc72447a4662e734f1b1344"} Jun 08 16:03:02.873057 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.872543 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2mmd6" Jun 08 16:03:02.873057 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:02.873030 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2mmd6" Jun 08 16:03:03.018077 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:03.017987 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:03.593168 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:03.593130 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:03.877766 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:03.877725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" event={"ID":"7240a0c6-264a-4231-8db1-04f88a751c79","Type":"ContainerStarted","Data":"60e4461f2695ef72e8409135ed4c735efccc618a9a381f4bbb9a1224d30ba220"} Jun 08 16:03:03.881441 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:03.881421 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/ovn-acl-logging/0.log" Jun 08 16:03:03.881929 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:03.881901 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" event={"ID":"dcc3c005-3b85-4892-a0af-bfb57b816951","Type":"ContainerStarted","Data":"51625c1eb8b12704dfb9ae6d0daeba5a4e9fbd8990f1dd638437abe009a139f4"} Jun 08 16:03:04.201648 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:04.201613 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:04.391985 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:04.391949 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:04.589496 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:04.589408 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:04.719717 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:04.719681 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:04.756436 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:04.756408 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:04.756599 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:04.756408 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:04.756599 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:04.756513 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:03:04.756599 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:04.756408 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:04.756599 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:04.756582 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:03:04.756729 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:04.756648 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:03:04.901501 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:04.901387 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zpl7" podStartSLOduration=4.64979044 podStartE2EDuration="25.901371866s" totalImagesPullingTime="21.251581426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:02:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:04.901257106 +0000 UTC m=+26.588903341" watchObservedRunningTime="2026-06-08 16:03:04.901371866 +0000 UTC m=+26.589018102" Jun 08 16:03:04.993803 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:04.993760 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:05.791703 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:05.791620 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:05.995037 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:05.994999 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:06.396109 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.395924 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:06.594541 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.594517 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:06.757027 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.756996 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:06.757185 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.756997 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:06.757185 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:06.757107 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:03:06.757340 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:06.757198 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:03:06.757340 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.756997 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:06.757420 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:06.757338 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:03:06.891627 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.891546 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/ovn-acl-logging/0.log" Jun 08 16:03:06.891935 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.891904 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" event={"ID":"dcc3c005-3b85-4892-a0af-bfb57b816951","Type":"ContainerStarted","Data":"c20afd5ae1700d8443c7ec009639f82b5453a7c0791176f8824fdd55f38328a1"} Jun 08 16:03:06.892202 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.892176 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:03:06.892335 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.892276 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:03:06.892335 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.892316 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:03:06.892463 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.892314 2567 scope.go:117] "RemoveContainer" containerID="c909f38580508fda6ed889820ad03158b10d23e5d7e8cfabaf0aebbd43e13799" Jun 08 16:03:06.897435 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.897411 2567 generic.go:356] "Generic (PLEG): container finished" podID="7bb13c11-b1d3-4936-9ad2-9b594fe91a0b" containerID="d25575dd3cf5ae7bf81af0c960ad0521e97e31f54324f0facbf919e046dad813" exitCode=0 Jun 08 16:03:06.897556 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.897456 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jg2qf" event={"ID":"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b","Type":"ContainerDied","Data":"d25575dd3cf5ae7bf81af0c960ad0521e97e31f54324f0facbf919e046dad813"} Jun 08 16:03:06.909834 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.909811 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:03:06.909931 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.909914 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:03:06.995049 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:06.995019 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:07.392011 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:07.391836 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:07.799776 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:07.799746 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:07.903221 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:07.903196 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/ovn-acl-logging/0.log" Jun 08 16:03:07.903601 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:07.903574 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" event={"ID":"dcc3c005-3b85-4892-a0af-bfb57b816951","Type":"ContainerStarted","Data":"f5e80b372f96f81f5d77ac4135e91fbb9471bc21d1c883d4d184076c560188c3"} Jun 08 16:03:07.905673 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:07.905651 2567 generic.go:356] "Generic (PLEG): container finished" podID="7bb13c11-b1d3-4936-9ad2-9b594fe91a0b" containerID="bafdef1125dd04db9404c1daf61fdf4550b5bff6b46d4ee9d953cbace70bad69" exitCode=0 Jun 08 16:03:07.905759 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:07.905686 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jg2qf" event={"ID":"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b","Type":"ContainerDied","Data":"bafdef1125dd04db9404c1daf61fdf4550b5bff6b46d4ee9d953cbace70bad69"} Jun 08 16:03:07.936958 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:07.936122 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" podStartSLOduration=10.070588277 podStartE2EDuration="28.936102097s" totalImagesPullingTime="18.86551382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:07.93471506 +0000 UTC m=+29.622361299" watchObservedRunningTime="2026-06-08 16:03:07.936102097 +0000 UTC m=+29.623748335" Jun 08 16:03:07.998854 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:07.998819 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:08.757307 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:08.757188 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:08.757307 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:08.757302 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:08.757532 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:08.757347 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:08.757532 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:08.757345 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:03:08.757532 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:08.757418 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:03:08.757532 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:08.757464 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:03:08.910475 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:08.910437 2567 generic.go:356] "Generic (PLEG): container finished" podID="7bb13c11-b1d3-4936-9ad2-9b594fe91a0b" containerID="40ed7e8606dd7bc6312685c63a85caaff9504ac3043b2c9d80633b63fc5a2de1" exitCode=0 Jun 08 16:03:08.910662 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:08.910525 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jg2qf" event={"ID":"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b","Type":"ContainerDied","Data":"40ed7e8606dd7bc6312685c63a85caaff9504ac3043b2c9d80633b63fc5a2de1"} Jun 08 16:03:10.305726 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:10.305691 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:10.373842 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:10.373807 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:10.756625 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:10.756589 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:10.756816 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:10.756632 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:10.756816 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:10.756588 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:10.756816 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:10.756746 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:03:10.756991 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:10.756821 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:03:10.756991 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:10.756904 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:03:12.119637 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:12.119607 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:12.219630 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:12.219588 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:12.321591 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:12.321554 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:12.436817 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:12.436787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:12.436976 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:12.436930 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:03:12.437026 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:12.437000 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs podName:b1df1dda-f1d7-4d55-afad-f80e3256cf0f nodeName:}" failed. No retries permitted until 2026-06-08 16:03:44.436982583 +0000 UTC m=+66.124628797 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs") pod "network-metrics-daemon-ps27h" (UID: "b1df1dda-f1d7-4d55-afad-f80e3256cf0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 16:03:12.537550 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:12.537513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:12.537724 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:12.537570 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2hl\" (UniqueName: \"kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl\") pod \"network-check-target-dmr5k\" (UID: \"3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4\") " pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:12.537724 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:12.537670 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 16:03:12.537724 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:12.537712 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 16:03:12.537852 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:12.537734 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 16:03:12.537852 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:12.537741 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret podName:5d749a0d-b6b8-429f-a970-e1ea1b8bff6f nodeName:}" failed. No retries permitted until 2026-06-08 16:03:44.537722403 +0000 UTC m=+66.225368637 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret") pod "global-pull-secret-syncer-jtdfn" (UID: "5d749a0d-b6b8-429f-a970-e1ea1b8bff6f") : object "kube-system"/"original-pull-secret" not registered Jun 08 16:03:12.537852 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:12.537745 2567 projected.go:196] Error preparing data for projected volume kube-api-access-bf2hl for pod openshift-network-diagnostics/network-check-target-dmr5k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:03:12.537852 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:12.537786 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl podName:3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4 nodeName:}" failed. No retries permitted until 2026-06-08 16:03:44.537775435 +0000 UTC m=+66.225421649 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bf2hl" (UniqueName: "kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl") pod "network-check-target-dmr5k" (UID: "3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 16:03:12.584920 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:12.584843 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:12.686050 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:12.686017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:12.757194 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:12.757083 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:12.757194 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:12.757093 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:12.757451 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:12.757240 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:03:12.757451 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:12.757329 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:03:12.757451 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:12.757109 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:12.757451 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:12.757415 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:03:13.339480 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:13.339198 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jtdfn"] Jun 08 16:03:13.340350 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:13.339625 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:13.340350 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:13.339731 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:03:13.342291 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:13.342231 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dmr5k"] Jun 08 16:03:13.342462 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:13.342428 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:13.342555 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:13.342532 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:03:13.342919 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:13.342889 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ps27h"] Jun 08 16:03:13.342994 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:13.342975 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:13.343072 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:13.343055 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:03:13.925014 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:13.924984 2567 generic.go:356] "Generic (PLEG): container finished" podID="7bb13c11-b1d3-4936-9ad2-9b594fe91a0b" containerID="7e5f0e086bcce7da977a7afc7f4e5104079a449bd8c624f36af57f43e9fd8a00" exitCode=0 Jun 08 16:03:13.925250 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:13.925023 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jg2qf" event={"ID":"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b","Type":"ContainerDied","Data":"7e5f0e086bcce7da977a7afc7f4e5104079a449bd8c624f36af57f43e9fd8a00"} Jun 08 16:03:14.756580 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:14.756501 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:14.756939 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:14.756513 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:14.756939 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:14.756607 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:03:14.756939 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:14.756515 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:14.756939 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:14.756663 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:03:14.756939 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:14.756759 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:03:14.930648 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:14.930616 2567 generic.go:356] "Generic (PLEG): container finished" podID="7bb13c11-b1d3-4936-9ad2-9b594fe91a0b" containerID="96d133cbcbf177e7080701e563254fc0a9047f614da95c4491ef58aa2aa0cdb2" exitCode=0 Jun 08 16:03:14.930829 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:14.930655 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jg2qf" event={"ID":"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b","Type":"ContainerDied","Data":"96d133cbcbf177e7080701e563254fc0a9047f614da95c4491ef58aa2aa0cdb2"} Jun 08 16:03:15.936707 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:15.936674 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jg2qf" event={"ID":"7bb13c11-b1d3-4936-9ad2-9b594fe91a0b","Type":"ContainerStarted","Data":"eb28a1b54fe0090c2e5724130552c88e8465baed6e9c919b29cdf452313eb11d"} Jun 08 16:03:15.961151 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:15.961103 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jg2qf" podStartSLOduration=7.327774768 podStartE2EDuration="36.961090317s" totalImagesPullingTime="29.633315549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:02:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:15.959848314 +0000 UTC m=+37.647494550" watchObservedRunningTime="2026-06-08 16:03:15.961090317 +0000 UTC m=+37.648736547" Jun 08 16:03:16.083047 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:16.082965 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:16.182834 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:16.182807 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:16.550572 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:16.550543 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:16.606126 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:16.606097 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:16.757279 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:16.757229 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:16.757279 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:16.757252 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:16.757512 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:16.757276 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:16.757512 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:16.757388 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ps27h" podUID="b1df1dda-f1d7-4d55-afad-f80e3256cf0f" Jun 08 16:03:16.757512 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:16.757395 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dmr5k" podUID="3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4" Jun 08 16:03:16.757512 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:16.757495 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jtdfn" podUID="5d749a0d-b6b8-429f-a970-e1ea1b8bff6f" Jun 08 16:03:17.082310 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.082288 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-187.ec2.internal" event="NodeReady" Jun 08 16:03:17.082659 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.082435 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 16:03:17.128622 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.128589 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6tzdp"] Jun 08 16:03:17.133984 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.133963 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t5qtp"] Jun 08 16:03:17.134093 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.134075 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.136936 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.136891 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 16:03:17.137172 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.137160 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7hk6m\"" Jun 08 16:03:17.137252 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.137167 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 16:03:17.140152 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.140134 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t5qtp" Jun 08 16:03:17.142577 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.142556 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fk5p4\"" Jun 08 16:03:17.142672 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.142653 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 16:03:17.142944 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.142930 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 16:03:17.143026 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.142934 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 16:03:17.145603 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.145582 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6tzdp"] Jun 08 16:03:17.158570 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.158551 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2h6k8"] Jun 08 16:03:17.164241 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.164209 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.169284 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.165523 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t5qtp"] Jun 08 16:03:17.169284 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.167482 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bjs67\"" Jun 08 16:03:17.169284 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.167796 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 16:03:17.169284 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.168041 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 16:03:17.169284 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.168255 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 16:03:17.169610 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.169503 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 16:03:17.173534 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.173511 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2h6k8"] Jun 08 16:03:17.274602 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.274572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd4839c2-6dbd-4078-ac0c-5135146c93e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.274602 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.274605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e783704c-5050-482f-b2fe-7757fafdde0f-metrics-tls\") pod \"dns-default-6tzdp\" (UID: \"e783704c-5050-482f-b2fe-7757fafdde0f\") " pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.274790 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.274642 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9m7t\" (UniqueName: \"kubernetes.io/projected/cd4839c2-6dbd-4078-ac0c-5135146c93e9-kube-api-access-t9m7t\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.274790 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.274711 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf2z6\" (UniqueName: \"kubernetes.io/projected/ff74e2ca-4f18-464a-87e0-268afb2a34be-kube-api-access-nf2z6\") pod \"ingress-canary-t5qtp\" (UID: \"ff74e2ca-4f18-464a-87e0-268afb2a34be\") " pod="openshift-ingress-canary/ingress-canary-t5qtp" Jun 08 16:03:17.274790 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.274746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e783704c-5050-482f-b2fe-7757fafdde0f-config-volume\") pod \"dns-default-6tzdp\" (UID: \"e783704c-5050-482f-b2fe-7757fafdde0f\") " pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.274790 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.274765 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff74e2ca-4f18-464a-87e0-268afb2a34be-cert\") pod \"ingress-canary-t5qtp\" (UID: \"ff74e2ca-4f18-464a-87e0-268afb2a34be\") " pod="openshift-ingress-canary/ingress-canary-t5qtp" Jun 08 16:03:17.274990 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.274822 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd4839c2-6dbd-4078-ac0c-5135146c93e9-crio-socket\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.274990 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.274874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hpvf\" (UniqueName: \"kubernetes.io/projected/e783704c-5050-482f-b2fe-7757fafdde0f-kube-api-access-4hpvf\") pod \"dns-default-6tzdp\" (UID: \"e783704c-5050-482f-b2fe-7757fafdde0f\") " pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.274990 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.274905 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd4839c2-6dbd-4078-ac0c-5135146c93e9-data-volume\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.274990 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.274932 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd4839c2-6dbd-4078-ac0c-5135146c93e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.274990 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.274974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e783704c-5050-482f-b2fe-7757fafdde0f-tmp-dir\") pod \"dns-default-6tzdp\" (UID: \"e783704c-5050-482f-b2fe-7757fafdde0f\") " pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.375951 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.375878 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf2z6\" (UniqueName: \"kubernetes.io/projected/ff74e2ca-4f18-464a-87e0-268afb2a34be-kube-api-access-nf2z6\") pod \"ingress-canary-t5qtp\" (UID: \"ff74e2ca-4f18-464a-87e0-268afb2a34be\") " pod="openshift-ingress-canary/ingress-canary-t5qtp" Jun 08 16:03:17.375951 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.375922 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e783704c-5050-482f-b2fe-7757fafdde0f-config-volume\") pod \"dns-default-6tzdp\" (UID: \"e783704c-5050-482f-b2fe-7757fafdde0f\") " pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.375951 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.375941 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff74e2ca-4f18-464a-87e0-268afb2a34be-cert\") pod \"ingress-canary-t5qtp\" (UID: \"ff74e2ca-4f18-464a-87e0-268afb2a34be\") " pod="openshift-ingress-canary/ingress-canary-t5qtp" Jun 08 16:03:17.376227 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.375995 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd4839c2-6dbd-4078-ac0c-5135146c93e9-crio-socket\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.376227 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.376018 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hpvf\" (UniqueName: \"kubernetes.io/projected/e783704c-5050-482f-b2fe-7757fafdde0f-kube-api-access-4hpvf\") pod \"dns-default-6tzdp\" (UID: \"e783704c-5050-482f-b2fe-7757fafdde0f\") " pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.376227 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.376041 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd4839c2-6dbd-4078-ac0c-5135146c93e9-data-volume\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.376227 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.376059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd4839c2-6dbd-4078-ac0c-5135146c93e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.376227 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.376084 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e783704c-5050-482f-b2fe-7757fafdde0f-tmp-dir\") pod \"dns-default-6tzdp\" (UID: \"e783704c-5050-482f-b2fe-7757fafdde0f\") " pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.376227 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.376121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd4839c2-6dbd-4078-ac0c-5135146c93e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.376227 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.376147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e783704c-5050-482f-b2fe-7757fafdde0f-metrics-tls\") pod \"dns-default-6tzdp\" (UID: \"e783704c-5050-482f-b2fe-7757fafdde0f\") " pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.376227 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.376192 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9m7t\" (UniqueName: \"kubernetes.io/projected/cd4839c2-6dbd-4078-ac0c-5135146c93e9-kube-api-access-t9m7t\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.376678 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.376231 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd4839c2-6dbd-4078-ac0c-5135146c93e9-crio-socket\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.376678 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.376554 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e783704c-5050-482f-b2fe-7757fafdde0f-tmp-dir\") pod \"dns-default-6tzdp\" (UID: \"e783704c-5050-482f-b2fe-7757fafdde0f\") " pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.376678 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.376646 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e783704c-5050-482f-b2fe-7757fafdde0f-config-volume\") pod \"dns-default-6tzdp\" (UID: \"e783704c-5050-482f-b2fe-7757fafdde0f\") " pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.376834 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.376813 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd4839c2-6dbd-4078-ac0c-5135146c93e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.376877 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.376850 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd4839c2-6dbd-4078-ac0c-5135146c93e9-data-volume\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.380161 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.380135 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e783704c-5050-482f-b2fe-7757fafdde0f-metrics-tls\") pod \"dns-default-6tzdp\" (UID: \"e783704c-5050-482f-b2fe-7757fafdde0f\") " pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.380161 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.380148 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd4839c2-6dbd-4078-ac0c-5135146c93e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.380387 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.380370 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff74e2ca-4f18-464a-87e0-268afb2a34be-cert\") pod \"ingress-canary-t5qtp\" (UID: \"ff74e2ca-4f18-464a-87e0-268afb2a34be\") " pod="openshift-ingress-canary/ingress-canary-t5qtp" Jun 08 16:03:17.383931 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.383899 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9m7t\" (UniqueName: \"kubernetes.io/projected/cd4839c2-6dbd-4078-ac0c-5135146c93e9-kube-api-access-t9m7t\") pod \"insights-runtime-extractor-2h6k8\" (UID: \"cd4839c2-6dbd-4078-ac0c-5135146c93e9\") " pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.383931 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.383925 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hpvf\" (UniqueName: \"kubernetes.io/projected/e783704c-5050-482f-b2fe-7757fafdde0f-kube-api-access-4hpvf\") pod \"dns-default-6tzdp\" (UID: \"e783704c-5050-482f-b2fe-7757fafdde0f\") " pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.384235 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.384216 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf2z6\" (UniqueName: \"kubernetes.io/projected/ff74e2ca-4f18-464a-87e0-268afb2a34be-kube-api-access-nf2z6\") pod \"ingress-canary-t5qtp\" (UID: \"ff74e2ca-4f18-464a-87e0-268afb2a34be\") " pod="openshift-ingress-canary/ingress-canary-t5qtp" Jun 08 16:03:17.444323 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.444288 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:17.450354 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.450336 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t5qtp" Jun 08 16:03:17.475743 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.475718 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2h6k8" Jun 08 16:03:17.659973 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.659946 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6tzdp"] Jun 08 16:03:17.662651 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.662626 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t5qtp"] Jun 08 16:03:17.664252 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:17.664224 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode783704c_5050_482f_b2fe_7757fafdde0f.slice/crio-582fe92d95d0f0e6b727e2ac5a5f0debda269a7657bafac1a55c1989c8010dd2 WatchSource:0}: Error finding container 582fe92d95d0f0e6b727e2ac5a5f0debda269a7657bafac1a55c1989c8010dd2: Status 404 returned error can't find the container with id 582fe92d95d0f0e6b727e2ac5a5f0debda269a7657bafac1a55c1989c8010dd2 Jun 08 16:03:17.665926 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:17.665903 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff74e2ca_4f18_464a_87e0_268afb2a34be.slice/crio-30b810929510fcdbc1e9138a182dda8d59713bb432e35f02c70fac604d6a752a WatchSource:0}: Error finding container 30b810929510fcdbc1e9138a182dda8d59713bb432e35f02c70fac604d6a752a: Status 404 returned error can't find the container with id 30b810929510fcdbc1e9138a182dda8d59713bb432e35f02c70fac604d6a752a Jun 08 16:03:17.676159 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.676137 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2h6k8"] Jun 08 16:03:17.679446 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:17.679422 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4839c2_6dbd_4078_ac0c_5135146c93e9.slice/crio-2edaa21f0dd282c11e46b3aab10a1de6b2c341b0eb3313a3b0ebcd14186e60c3 WatchSource:0}: Error finding container 2edaa21f0dd282c11e46b3aab10a1de6b2c341b0eb3313a3b0ebcd14186e60c3: Status 404 returned error can't find the container with id 2edaa21f0dd282c11e46b3aab10a1de6b2c341b0eb3313a3b0ebcd14186e60c3 Jun 08 16:03:17.943002 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.942902 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t5qtp" event={"ID":"ff74e2ca-4f18-464a-87e0-268afb2a34be","Type":"ContainerStarted","Data":"30b810929510fcdbc1e9138a182dda8d59713bb432e35f02c70fac604d6a752a"} Jun 08 16:03:17.944339 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.944313 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2h6k8" event={"ID":"cd4839c2-6dbd-4078-ac0c-5135146c93e9","Type":"ContainerStarted","Data":"8d44f3728c4e68bf317036edf76cff6d2577824b7f3304c5a63026d0d9c121d9"} Jun 08 16:03:17.944481 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.944368 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2h6k8" event={"ID":"cd4839c2-6dbd-4078-ac0c-5135146c93e9","Type":"ContainerStarted","Data":"2edaa21f0dd282c11e46b3aab10a1de6b2c341b0eb3313a3b0ebcd14186e60c3"} Jun 08 16:03:17.945300 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:17.945279 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6tzdp" event={"ID":"e783704c-5050-482f-b2fe-7757fafdde0f","Type":"ContainerStarted","Data":"582fe92d95d0f0e6b727e2ac5a5f0debda269a7657bafac1a55c1989c8010dd2"} Jun 08 16:03:18.510757 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.510710 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:18.614271 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.614217 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:18.678595 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.678545 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d"] Jun 08 16:03:18.681931 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.681901 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:18.689577 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.689551 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d" Jun 08 16:03:18.689791 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.689768 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d"] Jun 08 16:03:18.692346 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.692320 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 16:03:18.692449 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.692413 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gvnvf\"" Jun 08 16:03:18.759142 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.758913 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:18.759370 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.758968 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:18.759601 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.759020 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:18.761897 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.761845 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 16:03:18.761897 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.761887 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w9dzb\"" Jun 08 16:03:18.762235 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.762216 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 16:03:18.762896 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.762876 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 16:03:18.762986 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.762936 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 16:03:18.763050 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.762879 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kcgw4\"" Jun 08 16:03:18.788893 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.788862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c328b617-d701-4358-b7dd-e3b9dd10461f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-8k25d\" (UID: \"c328b617-d701-4358-b7dd-e3b9dd10461f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d" Jun 08 16:03:18.889927 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.889897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c328b617-d701-4358-b7dd-e3b9dd10461f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-8k25d\" (UID: \"c328b617-d701-4358-b7dd-e3b9dd10461f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d" Jun 08 16:03:18.890046 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:18.890026 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 08 16:03:18.890125 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:18.890098 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c328b617-d701-4358-b7dd-e3b9dd10461f-tls-certificates podName:c328b617-d701-4358-b7dd-e3b9dd10461f nodeName:}" failed. No retries permitted until 2026-06-08 16:03:19.390078177 +0000 UTC m=+41.077724393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c328b617-d701-4358-b7dd-e3b9dd10461f-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-8k25d" (UID: "c328b617-d701-4358-b7dd-e3b9dd10461f") : secret "prometheus-operator-admission-webhook-tls" not found Jun 08 16:03:18.934485 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.934454 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:18.949742 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:18.949712 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2h6k8" event={"ID":"cd4839c2-6dbd-4078-ac0c-5135146c93e9","Type":"ContainerStarted","Data":"61796b6ff0ab8907fe3d2a761af29938a7d523897927098a9d107ad8410ebbb7"} Jun 08 16:03:19.043364 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:19.043284 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:19.161729 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:19.161695 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:19.262342 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:19.262305 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:19.362053 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:19.361969 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:19.393835 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:19.393799 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c328b617-d701-4358-b7dd-e3b9dd10461f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-8k25d\" (UID: \"c328b617-d701-4358-b7dd-e3b9dd10461f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d" Jun 08 16:03:19.397045 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:19.396993 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c328b617-d701-4358-b7dd-e3b9dd10461f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-8k25d\" (UID: \"c328b617-d701-4358-b7dd-e3b9dd10461f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d" Jun 08 16:03:19.602240 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:19.602206 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d" Jun 08 16:03:21.133579 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:21.133484 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d"] Jun 08 16:03:21.962038 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:21.961997 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6tzdp" event={"ID":"e783704c-5050-482f-b2fe-7757fafdde0f","Type":"ContainerStarted","Data":"d7176a1541c744910637eb141e5562ea446bb036bfe00aa625ac1fccc9d53af2"} Jun 08 16:03:21.962243 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:21.962062 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6tzdp" event={"ID":"e783704c-5050-482f-b2fe-7757fafdde0f","Type":"ContainerStarted","Data":"7cef4b82f230758a4325e066eeab53ec69dcf8cc6bd4956aa3f88edcde644bf0"} Jun 08 16:03:21.962243 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:21.962120 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:21.963097 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:21.963073 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d" event={"ID":"c328b617-d701-4358-b7dd-e3b9dd10461f","Type":"ContainerStarted","Data":"531aaf8bd650b55541d46c7d9f1d51e0615977219603195fc270ff9e41e3df75"} Jun 08 16:03:21.964359 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:21.964335 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t5qtp" event={"ID":"ff74e2ca-4f18-464a-87e0-268afb2a34be","Type":"ContainerStarted","Data":"2c234935a065dacc5d22c09adabda8753f41f4120727cfa4cb96b340189a35a8"} Jun 08 16:03:21.966249 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:21.966227 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2h6k8" event={"ID":"cd4839c2-6dbd-4078-ac0c-5135146c93e9","Type":"ContainerStarted","Data":"72232f77fcdde84fcdd839972e5bb3bbec264615aadf9c10248eb3cbb2d34ed4"} Jun 08 16:03:21.980100 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:21.980058 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6tzdp" podStartSLOduration=1.647972816 podStartE2EDuration="4.980045938s" totalImagesPullingTime="3.332073122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:21.978499891 +0000 UTC m=+43.666146127" watchObservedRunningTime="2026-06-08 16:03:21.980045938 +0000 UTC m=+43.667692152" Jun 08 16:03:21.994349 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:21.994303 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t5qtp" podStartSLOduration=1.663711672 podStartE2EDuration="4.994285782s" totalImagesPullingTime="3.33057411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:21.993900511 +0000 UTC m=+43.681546748" watchObservedRunningTime="2026-06-08 16:03:21.994285782 +0000 UTC m=+43.681932019" Jun 08 16:03:22.031081 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:22.031030 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2h6k8" podStartSLOduration=1.910384079 podStartE2EDuration="5.031011413s" totalImagesPullingTime="3.120627334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:03:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:22.029924458 +0000 UTC m=+43.717570694" watchObservedRunningTime="2026-06-08 16:03:22.031011413 +0000 UTC m=+43.718657649" Jun 08 16:03:22.971305 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:22.971251 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d" event={"ID":"c328b617-d701-4358-b7dd-e3b9dd10461f","Type":"ContainerStarted","Data":"b5a82fc7d45c5030c0332e830d67695e97522b8e224fb7397888895140dee7db"} Jun 08 16:03:22.971839 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:22.971819 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d" Jun 08 16:03:22.976337 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:22.976317 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d" Jun 08 16:03:22.987493 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:22.987454 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-8k25d" podStartSLOduration=3.513036159 podStartE2EDuration="4.987441982s" totalImagesPullingTime="1.474405823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:22.986548562 +0000 UTC m=+44.674194800" watchObservedRunningTime="2026-06-08 16:03:22.987441982 +0000 UTC m=+44.675088218" Jun 08 16:03:23.710294 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.710229 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:23.748057 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.748022 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-q88xh"] Jun 08 16:03:23.750120 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.750103 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:23.752612 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.752587 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 16:03:23.753835 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.753817 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 16:03:23.753835 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.753832 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 16:03:23.754009 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.753833 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 16:03:23.754009 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.753878 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-65vvx\"" Jun 08 16:03:23.754171 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.754156 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 16:03:23.759654 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.759631 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-q88xh"] Jun 08 16:03:23.783446 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.783419 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:23.830818 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.830785 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4283851c-10eb-4881-8e55-ad00d79c0e3d-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-q88xh\" (UID: \"4283851c-10eb-4881-8e55-ad00d79c0e3d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:23.830937 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.830844 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4283851c-10eb-4881-8e55-ad00d79c0e3d-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-q88xh\" (UID: \"4283851c-10eb-4881-8e55-ad00d79c0e3d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:23.830937 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.830923 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrst\" (UniqueName: \"kubernetes.io/projected/4283851c-10eb-4881-8e55-ad00d79c0e3d-kube-api-access-8zrst\") pod \"prometheus-operator-7f7d445d84-q88xh\" (UID: \"4283851c-10eb-4881-8e55-ad00d79c0e3d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:23.831022 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.830967 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4283851c-10eb-4881-8e55-ad00d79c0e3d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-q88xh\" (UID: \"4283851c-10eb-4881-8e55-ad00d79c0e3d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:23.866895 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.866867 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:23.931491 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.931455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4283851c-10eb-4881-8e55-ad00d79c0e3d-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-q88xh\" (UID: \"4283851c-10eb-4881-8e55-ad00d79c0e3d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:23.931632 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.931517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4283851c-10eb-4881-8e55-ad00d79c0e3d-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-q88xh\" (UID: \"4283851c-10eb-4881-8e55-ad00d79c0e3d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:23.931632 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.931547 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrst\" (UniqueName: \"kubernetes.io/projected/4283851c-10eb-4881-8e55-ad00d79c0e3d-kube-api-access-8zrst\") pod \"prometheus-operator-7f7d445d84-q88xh\" (UID: \"4283851c-10eb-4881-8e55-ad00d79c0e3d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:23.931632 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.931568 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4283851c-10eb-4881-8e55-ad00d79c0e3d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-q88xh\" (UID: \"4283851c-10eb-4881-8e55-ad00d79c0e3d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:23.932214 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.932188 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4283851c-10eb-4881-8e55-ad00d79c0e3d-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-q88xh\" (UID: \"4283851c-10eb-4881-8e55-ad00d79c0e3d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:23.933910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.933881 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4283851c-10eb-4881-8e55-ad00d79c0e3d-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-q88xh\" (UID: \"4283851c-10eb-4881-8e55-ad00d79c0e3d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:23.934083 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.934065 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4283851c-10eb-4881-8e55-ad00d79c0e3d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-q88xh\" (UID: \"4283851c-10eb-4881-8e55-ad00d79c0e3d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:23.940118 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:23.940095 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrst\" (UniqueName: \"kubernetes.io/projected/4283851c-10eb-4881-8e55-ad00d79c0e3d-kube-api-access-8zrst\") pod \"prometheus-operator-7f7d445d84-q88xh\" (UID: \"4283851c-10eb-4881-8e55-ad00d79c0e3d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:24.059224 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:24.059133 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" Jun 08 16:03:24.180478 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:24.180444 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-q88xh"] Jun 08 16:03:24.183299 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:24.183272 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4283851c_10eb_4881_8e55_ad00d79c0e3d.slice/crio-08513a70ba46a7feca360213c674106e21f4d9e5fd5f1a9905279ce8985bdae8 WatchSource:0}: Error finding container 08513a70ba46a7feca360213c674106e21f4d9e5fd5f1a9905279ce8985bdae8: Status 404 returned error can't find the container with id 08513a70ba46a7feca360213c674106e21f4d9e5fd5f1a9905279ce8985bdae8 Jun 08 16:03:24.692080 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:24.692047 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:24.744932 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:24.744896 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:24.979010 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:24.978914 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" event={"ID":"4283851c-10eb-4881-8e55-ad00d79c0e3d","Type":"ContainerStarted","Data":"08513a70ba46a7feca360213c674106e21f4d9e5fd5f1a9905279ce8985bdae8"} Jun 08 16:03:25.305782 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:25.305751 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:25.399577 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:25.399552 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:25.555026 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:25.554948 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:25.983944 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:25.983913 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" event={"ID":"4283851c-10eb-4881-8e55-ad00d79c0e3d","Type":"ContainerStarted","Data":"de56736d90be7db39d55f46bbf85a640de6d99374857ac380b035c2008cff75a"} Jun 08 16:03:25.984086 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:25.983963 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" event={"ID":"4283851c-10eb-4881-8e55-ad00d79c0e3d","Type":"ContainerStarted","Data":"2d7a0af5a05fe61c25d94f0c72827e4afe27980d19883236b9543b2b8d89b4a9"} Jun 08 16:03:26.001487 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:26.001431 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-q88xh" podStartSLOduration=1.893225522 podStartE2EDuration="3.001417121s" totalImagesPullingTime="1.108191599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:26.001133498 +0000 UTC m=+47.688779736" watchObservedRunningTime="2026-06-08 16:03:26.001417121 +0000 UTC m=+47.689063357" Jun 08 16:03:27.876841 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:27.876806 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:28.086508 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.086470 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:28.109724 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.109698 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk"] Jun 08 16:03:28.145993 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.145916 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk"] Jun 08 16:03:28.145993 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.145969 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz"] Jun 08 16:03:28.146202 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.146047 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.148667 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.148647 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 16:03:28.148804 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.148701 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4wztp\"" Jun 08 16:03:28.148902 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.148882 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 16:03:28.159645 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.159626 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p79cr"] Jun 08 16:03:28.159749 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.159732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.162176 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.162156 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 08 16:03:28.162313 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.162280 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 08 16:03:28.162313 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.162304 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 08 16:03:28.162435 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.162318 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nvnkr\"" Jun 08 16:03:28.170993 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.170972 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:28.173697 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.173680 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz"] Jun 08 16:03:28.173802 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.173790 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.176199 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.176186 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 16:03:28.176309 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.176189 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 16:03:28.176476 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.176451 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 16:03:28.176522 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.176463 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rqhxn\"" Jun 08 16:03:28.261891 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.261864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46abebef-8e71-4f0b-a6dd-689ad0177dec-root\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.262050 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.261897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbf50c4c-9086-495a-bf4d-da284db46409-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.262050 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.261919 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46abebef-8e71-4f0b-a6dd-689ad0177dec-metrics-client-ca\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.262050 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.261944 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-wtmp\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.262050 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbf50c4c-9086-495a-bf4d-da284db46409-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.262050 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262037 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7121dcf0-771f-42fe-9fc7-5b6d0265581d-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.262207 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262078 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-tls\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.262207 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262097 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.262207 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.262207 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262145 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjnc9\" (UniqueName: \"kubernetes.io/projected/46abebef-8e71-4f0b-a6dd-689ad0177dec-kube-api-access-gjnc9\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.262207 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262164 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf50c4c-9086-495a-bf4d-da284db46409-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.262207 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262181 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7jmv\" (UniqueName: \"kubernetes.io/projected/bbf50c4c-9086-495a-bf4d-da284db46409-kube-api-access-z7jmv\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.262207 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262203 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46abebef-8e71-4f0b-a6dd-689ad0177dec-sys\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.262472 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.262472 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262299 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7121dcf0-771f-42fe-9fc7-5b6d0265581d-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.262472 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.262472 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-accelerators-collector-config\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.262472 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-textfile\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.262472 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.262419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb4zr\" (UniqueName: \"kubernetes.io/projected/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-api-access-rb4zr\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.295755 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.295722 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:28.363396 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbf50c4c-9086-495a-bf4d-da284db46409-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.363396 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363402 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7121dcf0-771f-42fe-9fc7-5b6d0265581d-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.363620 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-tls\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.363620 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363442 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.363620 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363470 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.363620 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjnc9\" (UniqueName: \"kubernetes.io/projected/46abebef-8e71-4f0b-a6dd-689ad0177dec-kube-api-access-gjnc9\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.363620 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363524 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf50c4c-9086-495a-bf4d-da284db46409-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.363620 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363550 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7jmv\" (UniqueName: \"kubernetes.io/projected/bbf50c4c-9086-495a-bf4d-da284db46409-kube-api-access-z7jmv\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.363898 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:28.363690 2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 08 16:03:28.363898 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46abebef-8e71-4f0b-a6dd-689ad0177dec-sys\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.363898 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:28.363776 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbf50c4c-9086-495a-bf4d-da284db46409-openshift-state-metrics-tls podName:bbf50c4c-9086-495a-bf4d-da284db46409 nodeName:}" failed. No retries permitted until 2026-06-08 16:03:28.863755554 +0000 UTC m=+50.551401782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bbf50c4c-9086-495a-bf4d-da284db46409-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-vkmtk" (UID: "bbf50c4c-9086-495a-bf4d-da284db46409") : secret "openshift-state-metrics-tls" not found Jun 08 16:03:28.363898 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363814 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.363898 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363853 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7121dcf0-771f-42fe-9fc7-5b6d0265581d-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.363898 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7121dcf0-771f-42fe-9fc7-5b6d0265581d-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.364211 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363918 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.364211 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363952 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-accelerators-collector-config\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.364211 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.363984 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-textfile\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.364211 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4zr\" (UniqueName: \"kubernetes.io/projected/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-api-access-rb4zr\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.364211 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364078 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46abebef-8e71-4f0b-a6dd-689ad0177dec-root\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.364211 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:28.364103 2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 08 16:03:28.364211 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364106 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbf50c4c-9086-495a-bf4d-da284db46409-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.364211 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364136 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46abebef-8e71-4f0b-a6dd-689ad0177dec-metrics-client-ca\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.364211 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:28.364163 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-state-metrics-tls podName:7121dcf0-771f-42fe-9fc7-5b6d0265581d nodeName:}" failed. No retries permitted until 2026-06-08 16:03:28.864132821 +0000 UTC m=+50.551779039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-9wgrz" (UID: "7121dcf0-771f-42fe-9fc7-5b6d0265581d") : secret "kube-state-metrics-tls" not found Jun 08 16:03:28.364211 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364193 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-wtmp\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.364211 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364197 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbf50c4c-9086-495a-bf4d-da284db46409-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.364794 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364241 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.364794 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46abebef-8e71-4f0b-a6dd-689ad0177dec-root\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.364794 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364568 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7121dcf0-771f-42fe-9fc7-5b6d0265581d-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.364794 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364633 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46abebef-8e71-4f0b-a6dd-689ad0177dec-sys\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.364794 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364667 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-textfile\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.364794 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364708 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46abebef-8e71-4f0b-a6dd-689ad0177dec-metrics-client-ca\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.364794 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364733 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-accelerators-collector-config\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.365133 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.364805 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-wtmp\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.366164 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.366134 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-tls\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.366323 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.366242 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46abebef-8e71-4f0b-a6dd-689ad0177dec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.366563 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.366542 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbf50c4c-9086-495a-bf4d-da284db46409-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.366808 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.366789 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.372348 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.372327 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjnc9\" (UniqueName: \"kubernetes.io/projected/46abebef-8e71-4f0b-a6dd-689ad0177dec-kube-api-access-gjnc9\") pod \"node-exporter-p79cr\" (UID: \"46abebef-8e71-4f0b-a6dd-689ad0177dec\") " pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.372498 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.372414 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7jmv\" (UniqueName: \"kubernetes.io/projected/bbf50c4c-9086-495a-bf4d-da284db46409-kube-api-access-z7jmv\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.372618 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.372479 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb4zr\" (UniqueName: \"kubernetes.io/projected/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-api-access-rb4zr\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.396550 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.396462 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:28.481376 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.481341 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p79cr" Jun 08 16:03:28.497336 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.497306 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:28.517190 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:28.517164 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46abebef_8e71_4f0b_a6dd_689ad0177dec.slice/crio-671be14df9454c268e6be9873bb381367c9be247fce478c5f066f412321d0c42 WatchSource:0}: Error finding container 671be14df9454c268e6be9873bb381367c9be247fce478c5f066f412321d0c42: Status 404 returned error can't find the container with id 671be14df9454c268e6be9873bb381367c9be247fce478c5f066f412321d0c42 Jun 08 16:03:28.596524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.596486 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:28.696983 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.696956 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:28.802276 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.802227 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:28.868595 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.868553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf50c4c-9086-495a-bf4d-da284db46409-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.868595 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.868601 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.870995 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.870959 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf50c4c-9086-495a-bf4d-da284db46409-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-vkmtk\" (UID: \"bbf50c4c-9086-495a-bf4d-da284db46409\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:28.871107 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.870989 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7121dcf0-771f-42fe-9fc7-5b6d0265581d-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-9wgrz\" (UID: \"7121dcf0-771f-42fe-9fc7-5b6d0265581d\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:28.995797 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:28.995707 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p79cr" event={"ID":"46abebef-8e71-4f0b-a6dd-689ad0177dec","Type":"ContainerStarted","Data":"671be14df9454c268e6be9873bb381367c9be247fce478c5f066f412321d0c42"} Jun 08 16:03:29.055562 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.055528 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" Jun 08 16:03:29.067646 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.067607 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" Jun 08 16:03:29.091845 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.091817 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:29.178556 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.178528 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:29.184927 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.184615 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:03:29.209928 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.209900 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:03:29.210079 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.209975 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.212750 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.212727 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 16:03:29.212939 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.212925 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 16:03:29.213076 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.213063 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 16:03:29.213386 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.213364 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 16:03:29.213386 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.213376 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 16:03:29.213658 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.213376 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 16:03:29.213726 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.213705 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 16:03:29.213862 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.213751 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dds8k\"" Jun 08 16:03:29.213862 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.213768 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 16:03:29.213862 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.213758 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 16:03:29.256194 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.256126 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk"] Jun 08 16:03:29.259183 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:29.259154 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf50c4c_9086_495a_bf4d_da284db46409.slice/crio-b0d9025ca7d0003572aab0b751bbf94e6ee766eba57765cee8f0ad7443d65dda WatchSource:0}: Error finding container b0d9025ca7d0003572aab0b751bbf94e6ee766eba57765cee8f0ad7443d65dda: Status 404 returned error can't find the container with id b0d9025ca7d0003572aab0b751bbf94e6ee766eba57765cee8f0ad7443d65dda Jun 08 16:03:29.275606 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.275584 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz"] Jun 08 16:03:29.373278 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.373221 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-config-volume\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.373278 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.373300 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1473897b-2a5c-4014-8a97-2c1d4eb27909-config-out\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.373278 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.373357 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1473897b-2a5c-4014-8a97-2c1d4eb27909-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.373278 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.373385 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.373278 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.373443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-web-config\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.373850 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.373553 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1473897b-2a5c-4014-8a97-2c1d4eb27909-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.373850 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.373641 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1473897b-2a5c-4014-8a97-2c1d4eb27909-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.373850 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.373674 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcf5f\" (UniqueName: \"kubernetes.io/projected/1473897b-2a5c-4014-8a97-2c1d4eb27909-kube-api-access-jcf5f\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.373850 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.373713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.373850 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.373815 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.374085 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.373878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.374085 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.373959 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.374085 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.374005 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1473897b-2a5c-4014-8a97-2c1d4eb27909-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.399928 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.399895 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:29.474586 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.474546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.474586 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.474585 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1473897b-2a5c-4014-8a97-2c1d4eb27909-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.474872 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.474608 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-config-volume\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.474872 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.474635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1473897b-2a5c-4014-8a97-2c1d4eb27909-config-out\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.474872 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.474655 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1473897b-2a5c-4014-8a97-2c1d4eb27909-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.474872 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.474676 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.474872 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.474703 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-web-config\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.474872 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.474730 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1473897b-2a5c-4014-8a97-2c1d4eb27909-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.474872 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.474864 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1473897b-2a5c-4014-8a97-2c1d4eb27909-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.475147 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.474905 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcf5f\" (UniqueName: \"kubernetes.io/projected/1473897b-2a5c-4014-8a97-2c1d4eb27909-kube-api-access-jcf5f\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.475147 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.474949 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.475147 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.474992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.475147 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.475017 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.485331 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.485037 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1473897b-2a5c-4014-8a97-2c1d4eb27909-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.486257 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.485536 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1473897b-2a5c-4014-8a97-2c1d4eb27909-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.486257 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.486061 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1473897b-2a5c-4014-8a97-2c1d4eb27909-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.487912 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.487813 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1473897b-2a5c-4014-8a97-2c1d4eb27909-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.487912 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.487842 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.488332 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.488255 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.488332 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.488319 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcf5f\" (UniqueName: \"kubernetes.io/projected/1473897b-2a5c-4014-8a97-2c1d4eb27909-kube-api-access-jcf5f\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.488494 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.488395 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-config-volume\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.488494 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.488446 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.488769 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.488748 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1473897b-2a5c-4014-8a97-2c1d4eb27909-config-out\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.489062 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.489039 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.489294 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.489253 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-web-config\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.489350 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.489331 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.522365 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.522304 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:03:29.564205 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:29.564169 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7121dcf0_771f_42fe_9fc7_5b6d0265581d.slice/crio-3f3a33a0201dd5bfbeef37b5d03449f6371bbd6f333ff41d7a03a34a516ae222 WatchSource:0}: Error finding container 3f3a33a0201dd5bfbeef37b5d03449f6371bbd6f333ff41d7a03a34a516ae222: Status 404 returned error can't find the container with id 3f3a33a0201dd5bfbeef37b5d03449f6371bbd6f333ff41d7a03a34a516ae222 Jun 08 16:03:29.702508 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:29.702472 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:03:29.784241 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:29.784204 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1473897b_2a5c_4014_8a97_2c1d4eb27909.slice/crio-524019846d9cbbb422e18c0a7f85fd635c7fd15026472f175f00859bd35f45d5 WatchSource:0}: Error finding container 524019846d9cbbb422e18c0a7f85fd635c7fd15026472f175f00859bd35f45d5: Status 404 returned error can't find the container with id 524019846d9cbbb422e18c0a7f85fd635c7fd15026472f175f00859bd35f45d5 Jun 08 16:03:30.000053 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.000016 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerStarted","Data":"524019846d9cbbb422e18c0a7f85fd635c7fd15026472f175f00859bd35f45d5"} Jun 08 16:03:30.001197 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.001175 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" event={"ID":"7121dcf0-771f-42fe-9fc7-5b6d0265581d","Type":"ContainerStarted","Data":"3f3a33a0201dd5bfbeef37b5d03449f6371bbd6f333ff41d7a03a34a516ae222"} Jun 08 16:03:30.002654 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.002631 2567 generic.go:356] "Generic (PLEG): container finished" podID="46abebef-8e71-4f0b-a6dd-689ad0177dec" containerID="ddc92944eea0196761a811a298f0ee820ceb487ac3d2b2cc5ce1d01c6385b399" exitCode=0 Jun 08 16:03:30.002760 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.002709 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p79cr" event={"ID":"46abebef-8e71-4f0b-a6dd-689ad0177dec","Type":"ContainerDied","Data":"ddc92944eea0196761a811a298f0ee820ceb487ac3d2b2cc5ce1d01c6385b399"} Jun 08 16:03:30.004520 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.004499 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" event={"ID":"bbf50c4c-9086-495a-bf4d-da284db46409","Type":"ContainerStarted","Data":"3258b0df96e486da849269dd47470067c4e4ac3d773844969c1892797994cf62"} Jun 08 16:03:30.004611 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.004539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" event={"ID":"bbf50c4c-9086-495a-bf4d-da284db46409","Type":"ContainerStarted","Data":"06e9f83f39f151d03ecbba736008bc2508dded504025a79dca56735e2328dfdd"} Jun 08 16:03:30.004611 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.004558 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" event={"ID":"bbf50c4c-9086-495a-bf4d-da284db46409","Type":"ContainerStarted","Data":"b0d9025ca7d0003572aab0b751bbf94e6ee766eba57765cee8f0ad7443d65dda"} Jun 08 16:03:30.197126 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.196728 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-757f97d5cd-xnq44"] Jun 08 16:03:30.207938 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.207913 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.211134 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.210913 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 16:03:30.211641 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.211399 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 16:03:30.211641 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.211461 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2a6h0jc8hpqg4\"" Jun 08 16:03:30.211641 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.211467 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2cs98\"" Jun 08 16:03:30.211641 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.211635 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 16:03:30.211943 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.211721 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 16:03:30.211943 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.211733 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 16:03:30.212624 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.212548 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-757f97d5cd-xnq44"] Jun 08 16:03:30.384041 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.383933 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-metrics-client-ca\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.384256 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.384036 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.384256 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.384079 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.384256 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.384114 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdllc\" (UniqueName: \"kubernetes.io/projected/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-kube-api-access-wdllc\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.384256 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.384176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.384256 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.384223 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.384256 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.384257 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-grpc-tls\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.384608 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.384305 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-tls\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.485166 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.485124 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.485363 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.485176 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-grpc-tls\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.485363 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.485228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-tls\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.485363 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.485291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-metrics-client-ca\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.485705 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.485675 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.485775 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.485746 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.485838 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.485788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdllc\" (UniqueName: \"kubernetes.io/projected/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-kube-api-access-wdllc\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.485895 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.485855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.486155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.486126 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-metrics-client-ca\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.488489 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.488435 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.488715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.488686 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.489040 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.489017 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.489124 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.489099 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.489449 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.489411 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-thanos-querier-tls\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.489702 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.489686 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-secret-grpc-tls\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.497129 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.497100 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdllc\" (UniqueName: \"kubernetes.io/projected/44d2006a-2d2a-43c1-8ddc-2a7ad441accf-kube-api-access-wdllc\") pod \"thanos-querier-757f97d5cd-xnq44\" (UID: \"44d2006a-2d2a-43c1-8ddc-2a7ad441accf\") " pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:30.520926 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:30.520892 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:31.011917 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:31.011880 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p79cr" event={"ID":"46abebef-8e71-4f0b-a6dd-689ad0177dec","Type":"ContainerStarted","Data":"e63f3d007df5614e42fcacc1eeedb0349fcd9077d8cb613d221407f1aa5362b9"} Jun 08 16:03:31.012449 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:31.011950 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p79cr" event={"ID":"46abebef-8e71-4f0b-a6dd-689ad0177dec","Type":"ContainerStarted","Data":"419bcdc5b71d78fb559e7ae5bf55943f64a8e55f926cda59fb0edfffc8ae219f"} Jun 08 16:03:31.033680 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:31.033637 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p79cr" podStartSLOduration=1.6574260729999999 podStartE2EDuration="3.03362139s" totalImagesPullingTime="1.278236255s" totalInitContainerRuntime="97.959062ms" isStatefulPod=true podCreationTimestamp="2026-06-08 16:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:31.031997467 +0000 UTC m=+52.719643703" watchObservedRunningTime="2026-06-08 16:03:31.03362139 +0000 UTC m=+52.721267654" Jun 08 16:03:31.050153 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:31.050121 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:31.110729 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:31.110662 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:31.590858 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:31.590792 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:31.651748 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:31.651713 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:31.974111 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:31.974085 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6tzdp" Jun 08 16:03:32.187723 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.187697 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-757f97d5cd-xnq44"] Jun 08 16:03:32.421346 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.421317 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7cfffff594-x98sv"] Jun 08 16:03:32.456458 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.456429 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cfffff594-x98sv"] Jun 08 16:03:32.456588 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.456566 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.459610 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.459585 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 08 16:03:32.460011 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.459822 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 16:03:32.460011 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.459868 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 08 16:03:32.460322 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.460229 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ni63v9v8c97r\"" Jun 08 16:03:32.460322 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.460295 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qjdsh\"" Jun 08 16:03:32.461237 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.461217 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 08 16:03:32.607471 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.607432 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1a5f7eb9-87d2-4650-a922-66f5bae46a59-metrics-server-audit-profiles\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.607678 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.607479 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1a5f7eb9-87d2-4650-a922-66f5bae46a59-secret-metrics-server-tls\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.607678 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.607502 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1a5f7eb9-87d2-4650-a922-66f5bae46a59-audit-log\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.607678 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.607585 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1a5f7eb9-87d2-4650-a922-66f5bae46a59-secret-metrics-server-client-certs\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.607678 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.607642 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a5f7eb9-87d2-4650-a922-66f5bae46a59-client-ca-bundle\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.607860 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.607746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8kbw\" (UniqueName: \"kubernetes.io/projected/1a5f7eb9-87d2-4650-a922-66f5bae46a59-kube-api-access-n8kbw\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.607860 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.607795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a5f7eb9-87d2-4650-a922-66f5bae46a59-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.708571 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.708534 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8kbw\" (UniqueName: \"kubernetes.io/projected/1a5f7eb9-87d2-4650-a922-66f5bae46a59-kube-api-access-n8kbw\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.708764 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.708581 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a5f7eb9-87d2-4650-a922-66f5bae46a59-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.708764 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.708752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1a5f7eb9-87d2-4650-a922-66f5bae46a59-metrics-server-audit-profiles\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.708874 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.708794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1a5f7eb9-87d2-4650-a922-66f5bae46a59-secret-metrics-server-tls\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.708874 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.708812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1a5f7eb9-87d2-4650-a922-66f5bae46a59-audit-log\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.708874 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.708839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1a5f7eb9-87d2-4650-a922-66f5bae46a59-secret-metrics-server-client-certs\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.709026 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.708881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a5f7eb9-87d2-4650-a922-66f5bae46a59-client-ca-bundle\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.709221 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.709191 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1a5f7eb9-87d2-4650-a922-66f5bae46a59-audit-log\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.709221 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.709216 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a5f7eb9-87d2-4650-a922-66f5bae46a59-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.709817 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.709796 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1a5f7eb9-87d2-4650-a922-66f5bae46a59-metrics-server-audit-profiles\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.711416 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.711395 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a5f7eb9-87d2-4650-a922-66f5bae46a59-client-ca-bundle\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.711502 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.711393 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1a5f7eb9-87d2-4650-a922-66f5bae46a59-secret-metrics-server-tls\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.711502 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.711440 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1a5f7eb9-87d2-4650-a922-66f5bae46a59-secret-metrics-server-client-certs\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.716548 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.716531 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8kbw\" (UniqueName: \"kubernetes.io/projected/1a5f7eb9-87d2-4650-a922-66f5bae46a59-kube-api-access-n8kbw\") pod \"metrics-server-7cfffff594-x98sv\" (UID: \"1a5f7eb9-87d2-4650-a922-66f5bae46a59\") " pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.768998 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.768927 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:32.880972 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.880933 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-wwg45"] Jun 08 16:03:32.892135 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.891707 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:32.901728 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.901694 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-wwg45"] Jun 08 16:03:32.901904 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.901808 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" Jun 08 16:03:32.904544 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.904520 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 16:03:32.904861 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.904848 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jcz67\"" Jun 08 16:03:32.910548 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.910517 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wwg45\" (UID: \"90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" Jun 08 16:03:32.910698 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.910657 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gtxb\" (UniqueName: \"kubernetes.io/projected/90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08-kube-api-access-7gtxb\") pod \"monitoring-plugin-76b68cc874-wwg45\" (UID: \"90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" Jun 08 16:03:32.947284 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:32.947228 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cfffff594-x98sv"] Jun 08 16:03:32.950978 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:32.950949 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a5f7eb9_87d2_4650_a922_66f5bae46a59.slice/crio-edeb2d89a3f1f0f67afa14ce59dae2c32b6ddd705e50607e58615c7db6edd412 WatchSource:0}: Error finding container edeb2d89a3f1f0f67afa14ce59dae2c32b6ddd705e50607e58615c7db6edd412: Status 404 returned error can't find the container with id edeb2d89a3f1f0f67afa14ce59dae2c32b6ddd705e50607e58615c7db6edd412 Jun 08 16:03:33.011562 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.011529 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gtxb\" (UniqueName: \"kubernetes.io/projected/90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08-kube-api-access-7gtxb\") pod \"monitoring-plugin-76b68cc874-wwg45\" (UID: \"90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" Jun 08 16:03:33.011728 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.011631 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wwg45\" (UID: \"90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" Jun 08 16:03:33.011838 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:33.011817 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 08 16:03:33.011912 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:03:33.011900 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08-monitoring-plugin-cert podName:90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08 nodeName:}" failed. No retries permitted until 2026-06-08 16:03:33.511881059 +0000 UTC m=+55.199527278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-wwg45" (UID: "90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08") : secret "monitoring-plugin-cert" not found Jun 08 16:03:33.020842 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.020759 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gtxb\" (UniqueName: \"kubernetes.io/projected/90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08-kube-api-access-7gtxb\") pod \"monitoring-plugin-76b68cc874-wwg45\" (UID: \"90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" Jun 08 16:03:33.021735 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.021706 2567 generic.go:356] "Generic (PLEG): container finished" podID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerID="bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7" exitCode=0 Jun 08 16:03:33.021871 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.021816 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerDied","Data":"bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7"} Jun 08 16:03:33.024856 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.024827 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" event={"ID":"7121dcf0-771f-42fe-9fc7-5b6d0265581d","Type":"ContainerStarted","Data":"5d9168073af98a443b122debd555beb7c1197f02838dc0e59b3dfaf0d8276f83"} Jun 08 16:03:33.024957 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.024892 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" event={"ID":"7121dcf0-771f-42fe-9fc7-5b6d0265581d","Type":"ContainerStarted","Data":"f7d06855162bdd5ff7a9fa625ac3560c21bea39eecea134e3c75163ae1c39ff8"} Jun 08 16:03:33.024957 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.024919 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" event={"ID":"7121dcf0-771f-42fe-9fc7-5b6d0265581d","Type":"ContainerStarted","Data":"851264b0ace3addfad6f4eacb2342529e0f106d01ae640c917f2fdd8e3e3ea7a"} Jun 08 16:03:33.032150 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.032119 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" event={"ID":"1a5f7eb9-87d2-4650-a922-66f5bae46a59","Type":"ContainerStarted","Data":"edeb2d89a3f1f0f67afa14ce59dae2c32b6ddd705e50607e58615c7db6edd412"} Jun 08 16:03:33.033455 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.033430 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" event={"ID":"44d2006a-2d2a-43c1-8ddc-2a7ad441accf","Type":"ContainerStarted","Data":"767802fcb6ea423dc6420a5dfd98d939aaf1de18e90b3ce7b53cb77ba2912bc7"} Jun 08 16:03:33.035786 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.035763 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" event={"ID":"bbf50c4c-9086-495a-bf4d-da284db46409","Type":"ContainerStarted","Data":"6e3db7f8064b92d555947922c354eca005f5fcb26b9cce7223536567585f8465"} Jun 08 16:03:33.067762 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.067699 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-vkmtk" podStartSLOduration=2.883618544 podStartE2EDuration="5.067677594s" totalImagesPullingTime="2.18405905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:33.066163724 +0000 UTC m=+54.753809961" watchObservedRunningTime="2026-06-08 16:03:33.067677594 +0000 UTC m=+54.755323834" Jun 08 16:03:33.083892 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.083838 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9wgrz" podStartSLOduration=2.594156115 podStartE2EDuration="5.083821234s" totalImagesPullingTime="2.489665119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:33.082950847 +0000 UTC m=+54.770597110" watchObservedRunningTime="2026-06-08 16:03:33.083821234 +0000 UTC m=+54.771467471" Jun 08 16:03:33.394911 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.394821 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:33.519523 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.519483 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wwg45\" (UID: \"90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" Jun 08 16:03:33.522603 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.522580 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-wwg45\" (UID: \"90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" Jun 08 16:03:33.815455 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:33.815418 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" Jun 08 16:03:34.354229 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.354189 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:34.360399 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.360365 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 16:03:34.385824 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.385786 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.392049 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.391959 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 16:03:34.397293 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.395122 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 16:03:34.397293 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.395385 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 16:03:34.397293 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.395584 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 16:03:34.397293 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.395909 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-46r08d9mfl8ti\"" Jun 08 16:03:34.397293 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.396091 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 16:03:34.397293 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.396595 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 16:03:34.397293 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.396987 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 16:03:34.397293 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.397239 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 16:03:34.398157 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.397542 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 16:03:34.398157 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.397936 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 16:03:34.407114 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.406927 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 16:03:34.407304 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.407276 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 16:03:34.408295 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.407647 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 16:03:34.408295 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.407915 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4dnbz\"" Jun 08 16:03:34.408295 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.408112 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 16:03:34.409716 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.409694 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 16:03:34.428482 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428447 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428628 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428488 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428628 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428517 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d136d0b-55e8-453d-9636-5d00f664df9b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428628 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428540 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428628 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428582 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428628 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428614 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428797 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428637 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8vgr\" (UniqueName: \"kubernetes.io/projected/8d136d0b-55e8-453d-9636-5d00f664df9b-kube-api-access-p8vgr\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428797 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428750 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428864 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428794 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428864 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428824 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428925 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428866 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428925 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428894 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428986 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428923 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.428986 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.429057 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.428987 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.429057 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.429011 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.429135 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.429065 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d136d0b-55e8-453d-9636-5d00f664df9b-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.429135 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.429088 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.429135 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.429122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-config\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.429283 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.429158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530200 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530400 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530242 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530400 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530295 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530400 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530332 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d136d0b-55e8-453d-9636-5d00f664df9b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530400 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530400 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530400 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530665 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530432 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530665 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8vgr\" (UniqueName: \"kubernetes.io/projected/8d136d0b-55e8-453d-9636-5d00f664df9b-kube-api-access-p8vgr\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530665 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530665 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530665 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530567 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530665 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530665 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530642 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.530987 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.530954 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.531110 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.531089 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.531552 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.531216 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.531552 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.531349 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.531552 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.531385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.531552 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.531405 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.531552 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.531434 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.531552 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.531457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.531552 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.531496 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d136d0b-55e8-453d-9636-5d00f664df9b-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.531552 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.531520 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.531552 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.531559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-config\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.532368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.532064 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.533193 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.532842 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.533342 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.533299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.533950 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.533685 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d136d0b-55e8-453d-9636-5d00f664df9b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.533950 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.533896 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.534784 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.534120 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.535729 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.535683 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.536299 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.536271 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.537230 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.537186 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d136d0b-55e8-453d-9636-5d00f664df9b-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.537584 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.537385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-config\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.537707 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.537676 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.537814 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.537787 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.538701 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.538677 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.538885 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.538847 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.539381 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.539359 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.548495 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.548476 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8vgr\" (UniqueName: \"kubernetes.io/projected/8d136d0b-55e8-453d-9636-5d00f664df9b-kube-api-access-p8vgr\") pod \"prometheus-k8s-0\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.701190 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.701156 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:34.756606 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.756546 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:34.827938 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:34.827901 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:35.148096 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:35.148014 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:35.208317 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:35.208281 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:35.270459 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:35.270424 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:35.417881 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:35.417848 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:35.601248 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:35.601214 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:36.208224 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:36.208191 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:36.225807 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:36.225779 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 16:03:36.227502 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:36.227462 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d136d0b_55e8_453d_9636_5d00f664df9b.slice/crio-3982d9f8482b62d3b7cfa074e759aa00c5eb7fb5b480d377a57a5ede0667666a WatchSource:0}: Error finding container 3982d9f8482b62d3b7cfa074e759aa00c5eb7fb5b480d377a57a5ede0667666a: Status 404 returned error can't find the container with id 3982d9f8482b62d3b7cfa074e759aa00c5eb7fb5b480d377a57a5ede0667666a Jun 08 16:03:36.237029 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:36.236977 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-wwg45"] Jun 08 16:03:36.240087 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:36.240036 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90cc21de_7d86_4cdc_8de4_3dcdbdfd7e08.slice/crio-c66a3805d6686acaad76307716a93f693b4f401e44981f2f76921ead56e0d7c2 WatchSource:0}: Error finding container c66a3805d6686acaad76307716a93f693b4f401e44981f2f76921ead56e0d7c2: Status 404 returned error can't find the container with id c66a3805d6686acaad76307716a93f693b4f401e44981f2f76921ead56e0d7c2 Jun 08 16:03:36.430408 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:36.430382 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:36.534341 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:36.534316 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:36.635569 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:36.635541 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:36.732771 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:36.732747 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:37.019757 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.019729 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:37.054847 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.054706 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" event={"ID":"1a5f7eb9-87d2-4650-a922-66f5bae46a59","Type":"ContainerStarted","Data":"43e6ee290f71a483bd8ca0d0739a3d65482e330aef6f618ba18ef1e7516a884e"} Jun 08 16:03:37.057325 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.057295 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" event={"ID":"44d2006a-2d2a-43c1-8ddc-2a7ad441accf","Type":"ContainerStarted","Data":"999743ecb7553d30679f648f8d82bea221d7ef66e7cbc5cbcabdd4508b186c07"} Jun 08 16:03:37.057480 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.057369 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" event={"ID":"44d2006a-2d2a-43c1-8ddc-2a7ad441accf","Type":"ContainerStarted","Data":"aef9df8a39b64ce09d52e57c23ea523675d3798f6139c8e062b47f3c9c9217a1"} Jun 08 16:03:37.057480 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.057412 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" event={"ID":"44d2006a-2d2a-43c1-8ddc-2a7ad441accf","Type":"ContainerStarted","Data":"43ada23d53f0f4b071d54530b37511fa836fb7c8a8fe4b10b3e3de36d79961fa"} Jun 08 16:03:37.059113 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.059084 2567 generic.go:356] "Generic (PLEG): container finished" podID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerID="79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae" exitCode=0 Jun 08 16:03:37.059233 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.059166 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerDied","Data":"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae"} Jun 08 16:03:37.059233 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.059219 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerStarted","Data":"3982d9f8482b62d3b7cfa074e759aa00c5eb7fb5b480d377a57a5ede0667666a"} Jun 08 16:03:37.060747 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.060719 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" event={"ID":"90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08","Type":"ContainerStarted","Data":"c66a3805d6686acaad76307716a93f693b4f401e44981f2f76921ead56e0d7c2"} Jun 08 16:03:37.064437 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.064403 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerStarted","Data":"a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53"} Jun 08 16:03:37.064530 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.064503 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerStarted","Data":"5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4"} Jun 08 16:03:37.064574 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.064547 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerStarted","Data":"78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d"} Jun 08 16:03:37.064615 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.064587 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerStarted","Data":"97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6"} Jun 08 16:03:37.064653 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.064624 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerStarted","Data":"e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23"} Jun 08 16:03:37.074869 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.074817 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" podStartSLOduration=1.9835129999999999 podStartE2EDuration="5.074798647s" totalImagesPullingTime="3.091285647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:37.073810006 +0000 UTC m=+58.761456239" watchObservedRunningTime="2026-06-08 16:03:37.074798647 +0000 UTC m=+58.762444899" Jun 08 16:03:37.372882 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.372791 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:37.880888 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.880836 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:37.946751 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:37.946730 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:38.075203 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:38.075179 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" event={"ID":"44d2006a-2d2a-43c1-8ddc-2a7ad441accf","Type":"ContainerStarted","Data":"5d9e26452485f9f091a270c7e682964eb92f3bf40dcd4e8bfcea38f2dbd36b75"} Jun 08 16:03:38.076738 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:38.076716 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" event={"ID":"90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08","Type":"ContainerStarted","Data":"d46b74cce68eefd73a78b09c9c2fc97cadbc076dea751d4449c1b259d37cedaf"} Jun 08 16:03:38.077021 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:38.076975 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" Jun 08 16:03:38.081151 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:38.081129 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerStarted","Data":"aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21"} Jun 08 16:03:38.082385 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:38.082357 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" Jun 08 16:03:38.122844 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:38.122799 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-wwg45" podStartSLOduration=4.42780839 podStartE2EDuration="6.122782044s" totalImagesPullingTime="1.694973654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:38.095351108 +0000 UTC m=+59.782997345" watchObservedRunningTime="2026-06-08 16:03:38.122782044 +0000 UTC m=+59.810428258" Jun 08 16:03:38.123422 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:38.123388 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6525383700000003 podStartE2EDuration="9.12337819s" totalImagesPullingTime="6.452582186s" totalInitContainerRuntime="18.257634ms" isStatefulPod=false podCreationTimestamp="2026-06-08 16:03:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:38.120599038 +0000 UTC m=+59.808245275" watchObservedRunningTime="2026-06-08 16:03:38.12337819 +0000 UTC m=+59.811024427" Jun 08 16:03:38.632827 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:38.632790 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:38.691160 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:38.691122 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:38.923360 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:38.923327 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqj2d" Jun 08 16:03:39.049880 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:39.049844 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:39.090574 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:39.090534 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" event={"ID":"44d2006a-2d2a-43c1-8ddc-2a7ad441accf","Type":"ContainerStarted","Data":"068b5f2ab873113287a41c768cc96224f6d7a2be08912f3c0460504032e8e116"} Jun 08 16:03:39.090769 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:39.090621 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" event={"ID":"44d2006a-2d2a-43c1-8ddc-2a7ad441accf","Type":"ContainerStarted","Data":"4022cb087242ad4240e79e5d97f40cace8040811a81f4587a23bb9b7446952b5"} Jun 08 16:03:39.119355 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:39.119291 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" podStartSLOduration=3.784733043 podStartE2EDuration="9.119250101s" totalImagesPullingTime="5.334517058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:03:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:39.118306691 +0000 UTC m=+60.805952928" watchObservedRunningTime="2026-06-08 16:03:39.119250101 +0000 UTC m=+60.806896338" Jun 08 16:03:39.127554 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:39.127517 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:39.190788 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:39.190706 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:40.095737 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:40.095704 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:41.101987 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:41.101956 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerStarted","Data":"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb"} Jun 08 16:03:41.108476 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:41.108455 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-757f97d5cd-xnq44" Jun 08 16:03:41.613023 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:41.612930 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:41.671708 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:41.671654 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:42.109816 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:42.109781 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerStarted","Data":"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea"} Jun 08 16:03:42.110210 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:42.109847 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerStarted","Data":"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983"} Jun 08 16:03:42.110210 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:42.109874 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerStarted","Data":"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538"} Jun 08 16:03:42.110210 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:42.109898 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerStarted","Data":"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb"} Jun 08 16:03:42.110210 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:42.109921 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerStarted","Data":"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2"} Jun 08 16:03:42.177057 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:42.177000 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.195669776 podStartE2EDuration="8.176983056s" totalImagesPullingTime="3.952416027s" totalInitContainerRuntime="28.897253ms" isStatefulPod=false podCreationTimestamp="2026-06-08 16:03:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:42.174143951 +0000 UTC m=+63.861790220" watchObservedRunningTime="2026-06-08 16:03:42.176983056 +0000 UTC m=+63.864629291" Jun 08 16:03:43.116757 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:43.116686 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:43.177379 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:43.177346 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:44.528421 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.528384 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:44.531426 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.531409 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 16:03:44.540757 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.540734 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1df1dda-f1d7-4d55-afad-f80e3256cf0f-metrics-certs\") pod \"network-metrics-daemon-ps27h\" (UID: \"b1df1dda-f1d7-4d55-afad-f80e3256cf0f\") " pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:44.589285 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.589239 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w9dzb\"" Jun 08 16:03:44.597402 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.597378 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ps27h" Jun 08 16:03:44.629230 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.629193 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:44.629382 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.629237 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2hl\" (UniqueName: \"kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl\") pod \"network-check-target-dmr5k\" (UID: \"3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4\") " pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:44.631827 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.631806 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 16:03:44.631827 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.631816 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 16:03:44.642026 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.642001 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d749a0d-b6b8-429f-a970-e1ea1b8bff6f-original-pull-secret\") pod \"global-pull-secret-syncer-jtdfn\" (UID: \"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f\") " pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:44.642306 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.642288 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 16:03:44.653450 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.653428 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf2hl\" (UniqueName: \"kubernetes.io/projected/3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4-kube-api-access-bf2hl\") pod \"network-check-target-dmr5k\" (UID: \"3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4\") " pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:44.702245 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.702213 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:03:44.763784 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.763755 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ps27h"] Jun 08 16:03:44.766650 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:44.766623 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1df1dda_f1d7_4d55_afad_f80e3256cf0f.slice/crio-914edea4290f511ad6593871ee97e49b6e2c90e03c3e4567ec5920fc3c4bebe7 WatchSource:0}: Error finding container 914edea4290f511ad6593871ee97e49b6e2c90e03c3e4567ec5920fc3c4bebe7: Status 404 returned error can't find the container with id 914edea4290f511ad6593871ee97e49b6e2c90e03c3e4567ec5920fc3c4bebe7 Jun 08 16:03:44.878724 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.878641 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jtdfn" Jun 08 16:03:44.894632 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.894603 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kcgw4\"" Jun 08 16:03:44.902773 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:44.902743 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:45.018878 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:45.018842 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jtdfn"] Jun 08 16:03:45.022062 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:45.022037 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d749a0d_b6b8_429f_a970_e1ea1b8bff6f.slice/crio-78b748af5c5f2bfc698d371abe2d945ea4f72644486d935468136fb9f6a4e4ff WatchSource:0}: Error finding container 78b748af5c5f2bfc698d371abe2d945ea4f72644486d935468136fb9f6a4e4ff: Status 404 returned error can't find the container with id 78b748af5c5f2bfc698d371abe2d945ea4f72644486d935468136fb9f6a4e4ff Jun 08 16:03:45.049551 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:45.049520 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dmr5k"] Jun 08 16:03:45.052187 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:03:45.052159 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c774e0b_5f8d_48a1_9d0e_2f7671a7c3e4.slice/crio-d81d6a12a518e2ac840f0bfdc0c3b2b4b9dfa0920c06d25e5b83686e9da29369 WatchSource:0}: Error finding container d81d6a12a518e2ac840f0bfdc0c3b2b4b9dfa0920c06d25e5b83686e9da29369: Status 404 returned error can't find the container with id d81d6a12a518e2ac840f0bfdc0c3b2b4b9dfa0920c06d25e5b83686e9da29369 Jun 08 16:03:45.123559 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:45.123524 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jtdfn" event={"ID":"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f","Type":"ContainerStarted","Data":"78b748af5c5f2bfc698d371abe2d945ea4f72644486d935468136fb9f6a4e4ff"} Jun 08 16:03:45.124968 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:45.124934 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ps27h" event={"ID":"b1df1dda-f1d7-4d55-afad-f80e3256cf0f","Type":"ContainerStarted","Data":"914edea4290f511ad6593871ee97e49b6e2c90e03c3e4567ec5920fc3c4bebe7"} Jun 08 16:03:45.126210 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:45.126182 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dmr5k" event={"ID":"3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4","Type":"ContainerStarted","Data":"d81d6a12a518e2ac840f0bfdc0c3b2b4b9dfa0920c06d25e5b83686e9da29369"} Jun 08 16:03:46.134198 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:46.133631 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ps27h" event={"ID":"b1df1dda-f1d7-4d55-afad-f80e3256cf0f","Type":"ContainerStarted","Data":"e0c2063b8c705d5967b2f5938dc07940cc2cccdd7050511b1904178cfd5ddce5"} Jun 08 16:03:46.134198 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:46.133754 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ps27h" event={"ID":"b1df1dda-f1d7-4d55-afad-f80e3256cf0f","Type":"ContainerStarted","Data":"b1ec7b235c7064451d0564a08626a79adafa564f6ecd8ea5e820baa2be8e3d86"} Jun 08 16:03:46.155154 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:46.155099 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ps27h" podStartSLOduration=67.304401865 podStartE2EDuration="1m8.155079314s" totalImagesPullingTime="850.677449ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:46.154337659 +0000 UTC m=+67.841983896" watchObservedRunningTime="2026-06-08 16:03:46.155079314 +0000 UTC m=+67.842725551" Jun 08 16:03:46.249534 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:46.249499 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:46.350220 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:46.350178 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:46.893931 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:46.893846 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:46.989092 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:46.988989 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:50.154830 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:50.154736 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jtdfn" event={"ID":"5d749a0d-b6b8-429f-a970-e1ea1b8bff6f","Type":"ContainerStarted","Data":"477c9193a2785e8a6d738e1325317a082c29b2b06c25f6bd46d8f128622cfa0e"} Jun 08 16:03:50.156360 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:50.156325 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dmr5k" event={"ID":"3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4","Type":"ContainerStarted","Data":"994dbc5f6817db4224aa93c4fa5160a5bc273b5e4b25fd2bd156084d1336bd21"} Jun 08 16:03:50.156470 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:50.156455 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:03:50.170608 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:50.170556 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jtdfn" podStartSLOduration=66.3496977 podStartE2EDuration="1m11.170538242s" totalImagesPullingTime="4.820840542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:50.169689959 +0000 UTC m=+71.857336197" watchObservedRunningTime="2026-06-08 16:03:50.170538242 +0000 UTC m=+71.858184481" Jun 08 16:03:50.185546 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:50.185504 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dmr5k" podStartSLOduration=66.398200948 podStartE2EDuration="1m11.185492464s" totalImagesPullingTime="4.787291516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:03:50.184616216 +0000 UTC m=+71.872262455" watchObservedRunningTime="2026-06-08 16:03:50.185492464 +0000 UTC m=+71.873138699" Jun 08 16:03:50.235276 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:50.235225 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:50.327919 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:50.327884 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:50.687377 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:50.687347 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:50.787408 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:50.787375 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:52.770026 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:52.769987 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:52.770421 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:52.770047 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:03:53.448784 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:53.448751 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:53.547304 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:53.547250 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:55.241631 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:55.241590 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:55.342508 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:55.342466 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:03:55.409996 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:03:55.409957 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:02.099543 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:02.099436 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:02.178037 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:02.178001 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:02.234456 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:02.234426 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:03.122145 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:03.122110 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:03.222622 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:03.222593 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:03.279461 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:03.279433 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:10.301828 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:10.301795 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:10.363278 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:10.363228 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:12.774589 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:12.774560 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:04:12.778392 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:12.778368 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7cfffff594-x98sv" Jun 08 16:04:21.163389 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:21.163355 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dmr5k" Jun 08 16:04:25.300968 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:25.300935 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:25.358423 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:25.358389 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:32.466333 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:32.466294 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:32.485817 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:32.485794 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:33.346393 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:33.346367 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:37.329976 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:37.329931 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:37.531429 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:37.531384 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:38.395678 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:38.395646 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:04:38.396209 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:38.395920 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="alertmanager" containerID="cri-o://e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23" gracePeriod=120 Jun 08 16:04:38.396209 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:38.395969 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="prom-label-proxy" containerID="cri-o://aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21" gracePeriod=120 Jun 08 16:04:38.396209 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:38.395985 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="kube-rbac-proxy-metric" containerID="cri-o://a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53" gracePeriod=120 Jun 08 16:04:38.396209 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:38.396015 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="kube-rbac-proxy-web" containerID="cri-o://78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d" gracePeriod=120 Jun 08 16:04:38.396209 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:38.395969 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="kube-rbac-proxy" containerID="cri-o://5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4" gracePeriod=120 Jun 08 16:04:38.396209 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:38.396006 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="config-reloader" containerID="cri-o://97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6" gracePeriod=120 Jun 08 16:04:39.358630 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.358593 2567 generic.go:356] "Generic (PLEG): container finished" podID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerID="aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21" exitCode=0 Jun 08 16:04:39.358630 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.358620 2567 generic.go:356] "Generic (PLEG): container finished" podID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerID="5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4" exitCode=0 Jun 08 16:04:39.358630 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.358628 2567 generic.go:356] "Generic (PLEG): container finished" podID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerID="97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6" exitCode=0 Jun 08 16:04:39.358630 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.358636 2567 generic.go:356] "Generic (PLEG): container finished" podID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerID="e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23" exitCode=0 Jun 08 16:04:39.358896 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.358670 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerDied","Data":"aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21"} Jun 08 16:04:39.358896 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.358743 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerDied","Data":"5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4"} Jun 08 16:04:39.358896 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.358773 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerDied","Data":"97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6"} Jun 08 16:04:39.358896 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.358806 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerDied","Data":"e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23"} Jun 08 16:04:39.642804 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.642780 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:39.725503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.725473 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1473897b-2a5c-4014-8a97-2c1d4eb27909-tls-assets\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.725684 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.725513 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-main-tls\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.725684 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.725536 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-cluster-tls-config\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.725684 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.725556 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.725849 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.725702 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-config-volume\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.725849 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.725776 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-web-config\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.725849 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.725806 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.726002 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.725847 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1473897b-2a5c-4014-8a97-2c1d4eb27909-alertmanager-main-db\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.726002 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.725895 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy-web\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.726002 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.725932 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1473897b-2a5c-4014-8a97-2c1d4eb27909-metrics-client-ca\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.726154 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.726008 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1473897b-2a5c-4014-8a97-2c1d4eb27909-alertmanager-trusted-ca-bundle\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.726154 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.726043 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1473897b-2a5c-4014-8a97-2c1d4eb27909-config-out\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.726154 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.726092 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcf5f\" (UniqueName: \"kubernetes.io/projected/1473897b-2a5c-4014-8a97-2c1d4eb27909-kube-api-access-jcf5f\") pod \"1473897b-2a5c-4014-8a97-2c1d4eb27909\" (UID: \"1473897b-2a5c-4014-8a97-2c1d4eb27909\") " Jun 08 16:04:39.726542 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.726509 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1473897b-2a5c-4014-8a97-2c1d4eb27909-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:04:39.726989 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.726962 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1473897b-2a5c-4014-8a97-2c1d4eb27909-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:04:39.727610 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.727577 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1473897b-2a5c-4014-8a97-2c1d4eb27909-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 16:04:39.728894 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.728843 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-config-volume" (OuterVolumeSpecName: "config-volume") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:39.729222 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.729175 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:39.729338 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.729256 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:39.729659 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.729629 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1473897b-2a5c-4014-8a97-2c1d4eb27909-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:04:39.730121 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.730091 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1473897b-2a5c-4014-8a97-2c1d4eb27909-kube-api-access-jcf5f" (OuterVolumeSpecName: "kube-api-access-jcf5f") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "kube-api-access-jcf5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:04:39.730474 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.730436 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1473897b-2a5c-4014-8a97-2c1d4eb27909-config-out" (OuterVolumeSpecName: "config-out") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 16:04:39.730640 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.730599 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:39.730782 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.730745 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:39.734228 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.734205 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:39.740426 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.740403 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-web-config" (OuterVolumeSpecName: "web-config") pod "1473897b-2a5c-4014-8a97-2c1d4eb27909" (UID: "1473897b-2a5c-4014-8a97-2c1d4eb27909"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:39.827719 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827681 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-cluster-tls-config\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:39.827719 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827706 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:39.827719 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827715 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-config-volume\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:39.827719 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827724 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-web-config\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:39.827997 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827732 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:39.827997 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827740 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1473897b-2a5c-4014-8a97-2c1d4eb27909-alertmanager-main-db\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:39.827997 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827749 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:39.827997 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827758 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1473897b-2a5c-4014-8a97-2c1d4eb27909-metrics-client-ca\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:39.827997 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827766 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1473897b-2a5c-4014-8a97-2c1d4eb27909-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:39.827997 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827775 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1473897b-2a5c-4014-8a97-2c1d4eb27909-config-out\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:39.827997 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827782 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcf5f\" (UniqueName: \"kubernetes.io/projected/1473897b-2a5c-4014-8a97-2c1d4eb27909-kube-api-access-jcf5f\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:39.827997 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827790 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1473897b-2a5c-4014-8a97-2c1d4eb27909-tls-assets\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:39.827997 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:39.827799 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1473897b-2a5c-4014-8a97-2c1d4eb27909-secret-alertmanager-main-tls\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:40.366214 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.366181 2567 generic.go:356] "Generic (PLEG): container finished" podID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerID="a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53" exitCode=0 Jun 08 16:04:40.366214 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.366206 2567 generic.go:356] "Generic (PLEG): container finished" podID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerID="78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d" exitCode=0 Jun 08 16:04:40.366444 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.366228 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerDied","Data":"a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53"} Jun 08 16:04:40.366444 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.366254 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.366444 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.366309 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerDied","Data":"78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d"} Jun 08 16:04:40.366444 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.366336 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1473897b-2a5c-4014-8a97-2c1d4eb27909","Type":"ContainerDied","Data":"524019846d9cbbb422e18c0a7f85fd635c7fd15026472f175f00859bd35f45d5"} Jun 08 16:04:40.366444 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.366367 2567 scope.go:117] "RemoveContainer" containerID="aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21" Jun 08 16:04:40.375164 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.375147 2567 scope.go:117] "RemoveContainer" containerID="a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53" Jun 08 16:04:40.382623 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.382608 2567 scope.go:117] "RemoveContainer" containerID="5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4" Jun 08 16:04:40.390089 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.390061 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:04:40.390412 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.390314 2567 scope.go:117] "RemoveContainer" containerID="78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d" Jun 08 16:04:40.394426 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.394405 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:04:40.397571 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.397543 2567 scope.go:117] "RemoveContainer" containerID="97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6" Jun 08 16:04:40.404460 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.404445 2567 scope.go:117] "RemoveContainer" containerID="e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23" Jun 08 16:04:40.411878 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.411861 2567 scope.go:117] "RemoveContainer" containerID="bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7" Jun 08 16:04:40.419115 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419088 2567 scope.go:117] "RemoveContainer" containerID="aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21" Jun 08 16:04:40.419409 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:40.419388 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21\": container with ID starting with aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21 not found: ID does not exist" containerID="aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21" Jun 08 16:04:40.419472 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419417 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:04:40.419472 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419417 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21"} err="failed to get container status \"aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21\": rpc error: code = NotFound desc = could not find container \"aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21\": container with ID starting with aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21 not found: ID does not exist" Jun 08 16:04:40.419472 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419451 2567 scope.go:117] "RemoveContainer" containerID="a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53" Jun 08 16:04:40.419740 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:40.419719 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53\": container with ID starting with a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53 not found: ID does not exist" containerID="a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53" Jun 08 16:04:40.419810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419757 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="prom-label-proxy" Jun 08 16:04:40.419810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419751 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53"} err="failed to get container status \"a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53\": rpc error: code = NotFound desc = could not find container \"a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53\": container with ID starting with a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53 not found: ID does not exist" Jun 08 16:04:40.419810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419771 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="prom-label-proxy" Jun 08 16:04:40.419810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419778 2567 scope.go:117] "RemoveContainer" containerID="5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4" Jun 08 16:04:40.419810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419785 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="config-reloader" Jun 08 16:04:40.419810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419791 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="config-reloader" Jun 08 16:04:40.419810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419798 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="kube-rbac-proxy" Jun 08 16:04:40.419810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419804 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="kube-rbac-proxy" Jun 08 16:04:40.419810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419814 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="alertmanager" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419819 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="alertmanager" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419831 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="kube-rbac-proxy-web" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419837 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="kube-rbac-proxy-web" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419845 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="init-config-reloader" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419850 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="init-config-reloader" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419858 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="kube-rbac-proxy-metric" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419864 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="kube-rbac-proxy-metric" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419910 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="kube-rbac-proxy-web" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419921 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="config-reloader" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419930 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="alertmanager" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419936 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="prom-label-proxy" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419946 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="kube-rbac-proxy" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.419954 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" containerName="kube-rbac-proxy-metric" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:40.420021 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4\": container with ID starting with 5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4 not found: ID does not exist" containerID="5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.420043 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4"} err="failed to get container status \"5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4\": rpc error: code = NotFound desc = could not find container \"5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4\": container with ID starting with 5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4 not found: ID does not exist" Jun 08 16:04:40.420116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.420058 2567 scope.go:117] "RemoveContainer" containerID="78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d" Jun 08 16:04:40.420762 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:40.420283 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d\": container with ID starting with 78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d not found: ID does not exist" containerID="78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d" Jun 08 16:04:40.420762 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.420303 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d"} err="failed to get container status \"78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d\": rpc error: code = NotFound desc = could not find container \"78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d\": container with ID starting with 78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d not found: ID does not exist" Jun 08 16:04:40.420762 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.420317 2567 scope.go:117] "RemoveContainer" containerID="97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6" Jun 08 16:04:40.420762 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:40.420550 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6\": container with ID starting with 97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6 not found: ID does not exist" containerID="97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6" Jun 08 16:04:40.420762 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.420578 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6"} err="failed to get container status \"97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6\": rpc error: code = NotFound desc = could not find container \"97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6\": container with ID starting with 97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6 not found: ID does not exist" Jun 08 16:04:40.420762 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.420631 2567 scope.go:117] "RemoveContainer" containerID="e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23" Jun 08 16:04:40.421033 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:40.420981 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23\": container with ID starting with e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23 not found: ID does not exist" containerID="e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23" Jun 08 16:04:40.421033 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.421011 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23"} err="failed to get container status \"e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23\": rpc error: code = NotFound desc = could not find container \"e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23\": container with ID starting with e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23 not found: ID does not exist" Jun 08 16:04:40.421033 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.421031 2567 scope.go:117] "RemoveContainer" containerID="bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7" Jun 08 16:04:40.421335 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:40.421310 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7\": container with ID starting with bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7 not found: ID does not exist" containerID="bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7" Jun 08 16:04:40.421383 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.421340 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7"} err="failed to get container status \"bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7\": rpc error: code = NotFound desc = could not find container \"bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7\": container with ID starting with bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7 not found: ID does not exist" Jun 08 16:04:40.421383 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.421358 2567 scope.go:117] "RemoveContainer" containerID="aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21" Jun 08 16:04:40.421580 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.421561 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21"} err="failed to get container status \"aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21\": rpc error: code = NotFound desc = could not find container \"aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21\": container with ID starting with aa13f979bbfff5c2ec6af08fba3f734d0e7e3a6f5095b3923fa48609c87e2c21 not found: ID does not exist" Jun 08 16:04:40.421646 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.421582 2567 scope.go:117] "RemoveContainer" containerID="a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53" Jun 08 16:04:40.421792 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.421775 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53"} err="failed to get container status \"a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53\": rpc error: code = NotFound desc = could not find container \"a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53\": container with ID starting with a6a1787f6f2a00e37093e5cd1838a43066a78a5e55054823440efddb23993d53 not found: ID does not exist" Jun 08 16:04:40.421853 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.421793 2567 scope.go:117] "RemoveContainer" containerID="5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4" Jun 08 16:04:40.421999 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.421981 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4"} err="failed to get container status \"5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4\": rpc error: code = NotFound desc = could not find container \"5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4\": container with ID starting with 5e81fc091920d5b715039b63c2bcef4a11c8db2af7da6e2f10f27cc13f3d6ad4 not found: ID does not exist" Jun 08 16:04:40.422053 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.422000 2567 scope.go:117] "RemoveContainer" containerID="78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d" Jun 08 16:04:40.422229 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.422211 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d"} err="failed to get container status \"78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d\": rpc error: code = NotFound desc = could not find container \"78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d\": container with ID starting with 78bc20c42a98ae035def864c0994ed30db950802974a15fd60995b9ccf08644d not found: ID does not exist" Jun 08 16:04:40.422325 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.422231 2567 scope.go:117] "RemoveContainer" containerID="97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6" Jun 08 16:04:40.422539 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.422516 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6"} err="failed to get container status \"97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6\": rpc error: code = NotFound desc = could not find container \"97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6\": container with ID starting with 97533d4fa32db5d6d3035128b10bdbb8514de27a4fc9f530bfb52bed0c7534b6 not found: ID does not exist" Jun 08 16:04:40.422604 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.422541 2567 scope.go:117] "RemoveContainer" containerID="e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23" Jun 08 16:04:40.422854 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.422823 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23"} err="failed to get container status \"e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23\": rpc error: code = NotFound desc = could not find container \"e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23\": container with ID starting with e7c62eadb12370b55a4a9ac1f08f37751bab9f577678f404f6b1b78440017d23 not found: ID does not exist" Jun 08 16:04:40.422974 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.422862 2567 scope.go:117] "RemoveContainer" containerID="bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7" Jun 08 16:04:40.423184 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.423162 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7"} err="failed to get container status \"bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7\": rpc error: code = NotFound desc = could not find container \"bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7\": container with ID starting with bac4e07191eff40ad5793109dde36e2c0b1ea39c490556d59d1fb64d431bbfc7 not found: ID does not exist" Jun 08 16:04:40.424221 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.424203 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.426915 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.426896 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dds8k\"" Jun 08 16:04:40.426989 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.426896 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 16:04:40.427054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.427033 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 16:04:40.427286 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.427250 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 16:04:40.427394 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.427297 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 16:04:40.427394 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.427355 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 16:04:40.427558 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.427541 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 16:04:40.427634 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.427616 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 16:04:40.427693 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.427635 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 16:04:40.432957 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.432939 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 16:04:40.436313 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.436292 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:04:40.534515 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534477 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.534715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534522 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-web-config\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.534715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534560 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xzzc\" (UniqueName: \"kubernetes.io/projected/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-kube-api-access-8xzzc\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.534715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.534715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534618 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.534715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534644 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.534715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534671 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.534715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534697 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.535032 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534745 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.535032 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534778 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-config-volume\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.535032 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534822 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.535032 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534849 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.535032 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.534888 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-config-out\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636303 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636190 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636303 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636303 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636280 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-config-out\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636549 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636305 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636549 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636343 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-web-config\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636549 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xzzc\" (UniqueName: \"kubernetes.io/projected/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-kube-api-access-8xzzc\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636549 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636549 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636542 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636776 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636568 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636776 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636594 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636776 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636624 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636776 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636669 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.636776 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.636702 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-config-volume\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.639286 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.638619 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.639286 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.638903 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.639286 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.638935 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.639286 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.639225 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-config-out\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.639576 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.639384 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.639576 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.639508 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-web-config\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.639905 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.639880 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-config-volume\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.640016 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.639891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.640324 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.640299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.640412 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.640321 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.640670 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.640650 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.641495 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.641474 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.645910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.645884 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xzzc\" (UniqueName: \"kubernetes.io/projected/2df5e6b3-dd90-4b22-9741-0f9d70329ac8-kube-api-access-8xzzc\") pod \"alertmanager-main-0\" (UID: \"2df5e6b3-dd90-4b22-9741-0f9d70329ac8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.734996 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.734957 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 16:04:40.767898 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.767863 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1473897b-2a5c-4014-8a97-2c1d4eb27909" path="/var/lib/kubelet/pods/1473897b-2a5c-4014-8a97-2c1d4eb27909/volumes" Jun 08 16:04:40.869311 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:40.869163 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 16:04:40.871634 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:04:40.871610 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df5e6b3_dd90_4b22_9741_0f9d70329ac8.slice/crio-3050b8653a080aed8b7fded71cc6802819adb148f4caf5bd47ef94e3c47faaf5 WatchSource:0}: Error finding container 3050b8653a080aed8b7fded71cc6802819adb148f4caf5bd47ef94e3c47faaf5: Status 404 returned error can't find the container with id 3050b8653a080aed8b7fded71cc6802819adb148f4caf5bd47ef94e3c47faaf5 Jun 08 16:04:41.372767 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:41.372737 2567 generic.go:356] "Generic (PLEG): container finished" podID="2df5e6b3-dd90-4b22-9741-0f9d70329ac8" containerID="226315119fa47c923076130fd7f95e90f6fe9f4bc9f29a1c2117f38b7601464a" exitCode=0 Jun 08 16:04:41.372929 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:41.372799 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df5e6b3-dd90-4b22-9741-0f9d70329ac8","Type":"ContainerDied","Data":"226315119fa47c923076130fd7f95e90f6fe9f4bc9f29a1c2117f38b7601464a"} Jun 08 16:04:41.372929 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:41.372848 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df5e6b3-dd90-4b22-9741-0f9d70329ac8","Type":"ContainerStarted","Data":"3050b8653a080aed8b7fded71cc6802819adb148f4caf5bd47ef94e3c47faaf5"} Jun 08 16:04:42.381368 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.381311 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df5e6b3-dd90-4b22-9741-0f9d70329ac8","Type":"ContainerStarted","Data":"ae66a700468c7f8e5f673813bce27824bf1307343347736416267244f6c461c4"} Jun 08 16:04:42.381859 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.381415 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df5e6b3-dd90-4b22-9741-0f9d70329ac8","Type":"ContainerStarted","Data":"3f6a7df2238cf6cf8eaeed317c45a81eec50739351216316d1023be344907dbd"} Jun 08 16:04:42.381859 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.381455 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df5e6b3-dd90-4b22-9741-0f9d70329ac8","Type":"ContainerStarted","Data":"8214de929499ea54d586b7b9b4ecb0e3dc671bf472efa9fc1c1accca786e0a49"} Jun 08 16:04:42.381859 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.381499 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df5e6b3-dd90-4b22-9741-0f9d70329ac8","Type":"ContainerStarted","Data":"88aa0ad62b254614b202241aab7cb62922b21e504a0c672f313a628f7067821c"} Jun 08 16:04:42.381859 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.381539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df5e6b3-dd90-4b22-9741-0f9d70329ac8","Type":"ContainerStarted","Data":"5c7db17fa6e729bcc374618ebcecc3e8a8d74e544380e7817d3db1a329dacd67"} Jun 08 16:04:42.381859 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.381576 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2df5e6b3-dd90-4b22-9741-0f9d70329ac8","Type":"ContainerStarted","Data":"e21e125f0d0966ac710b27e686a6d4320561dff12406de318ee4bcdf5aa27123"} Jun 08 16:04:42.410370 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.410307 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.3936492879999998 podStartE2EDuration="2.410287002s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.637714ms" isStatefulPod=false podCreationTimestamp="2026-06-08 16:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:04:42.408542745 +0000 UTC m=+124.096188982" watchObservedRunningTime="2026-06-08 16:04:42.410287002 +0000 UTC m=+124.097933236" Jun 08 16:04:42.423053 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.423012 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-bdc4579dd-h8dh8"] Jun 08 16:04:42.426428 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.426406 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.430715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.429061 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 16:04:42.430715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.429586 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dhhs8\"" Jun 08 16:04:42.430715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.429781 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 16:04:42.430715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.429990 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 16:04:42.430715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.430223 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 16:04:42.430715 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.430472 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 16:04:42.436447 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.436031 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 16:04:42.440556 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.440530 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bdc4579dd-h8dh8"] Jun 08 16:04:42.556626 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.556588 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/59ab6ff4-228c-4d73-8642-597655f3ca2a-telemeter-client-tls\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.556626 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.556629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59ab6ff4-228c-4d73-8642-597655f3ca2a-metrics-client-ca\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.556844 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.556657 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59ab6ff4-228c-4d73-8642-597655f3ca2a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.556844 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.556738 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/59ab6ff4-228c-4d73-8642-597655f3ca2a-secret-telemeter-client\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.556844 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.556787 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ab6ff4-228c-4d73-8642-597655f3ca2a-serving-certs-ca-bundle\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.556844 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.556811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/59ab6ff4-228c-4d73-8642-597655f3ca2a-federate-client-tls\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.557036 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.556885 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmcjb\" (UniqueName: \"kubernetes.io/projected/59ab6ff4-228c-4d73-8642-597655f3ca2a-kube-api-access-cmcjb\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.557036 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.556977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ab6ff4-228c-4d73-8642-597655f3ca2a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.657537 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.657498 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59ab6ff4-228c-4d73-8642-597655f3ca2a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.657781 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.657762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/59ab6ff4-228c-4d73-8642-597655f3ca2a-secret-telemeter-client\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.657898 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.657885 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ab6ff4-228c-4d73-8642-597655f3ca2a-serving-certs-ca-bundle\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.657986 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.657973 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/59ab6ff4-228c-4d73-8642-597655f3ca2a-federate-client-tls\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.658097 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.658084 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmcjb\" (UniqueName: \"kubernetes.io/projected/59ab6ff4-228c-4d73-8642-597655f3ca2a-kube-api-access-cmcjb\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.658225 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.658212 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ab6ff4-228c-4d73-8642-597655f3ca2a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.658402 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.658386 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/59ab6ff4-228c-4d73-8642-597655f3ca2a-telemeter-client-tls\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.658502 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.658490 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59ab6ff4-228c-4d73-8642-597655f3ca2a-metrics-client-ca\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.659381 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.659357 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59ab6ff4-228c-4d73-8642-597655f3ca2a-metrics-client-ca\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.660022 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.659988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ab6ff4-228c-4d73-8642-597655f3ca2a-serving-certs-ca-bundle\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.660275 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.660229 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59ab6ff4-228c-4d73-8642-597655f3ca2a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.661825 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.661798 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/59ab6ff4-228c-4d73-8642-597655f3ca2a-federate-client-tls\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.662345 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.662323 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59ab6ff4-228c-4d73-8642-597655f3ca2a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.662511 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.662487 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/59ab6ff4-228c-4d73-8642-597655f3ca2a-secret-telemeter-client\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.662685 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.662667 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/59ab6ff4-228c-4d73-8642-597655f3ca2a-telemeter-client-tls\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.667997 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.667973 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmcjb\" (UniqueName: \"kubernetes.io/projected/59ab6ff4-228c-4d73-8642-597655f3ca2a-kube-api-access-cmcjb\") pod \"telemeter-client-bdc4579dd-h8dh8\" (UID: \"59ab6ff4-228c-4d73-8642-597655f3ca2a\") " pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.742024 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.741986 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" Jun 08 16:04:42.769460 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.769428 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 16:04:42.770056 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.769752 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="prometheus" containerID="cri-o://2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb" gracePeriod=600 Jun 08 16:04:42.770056 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.769795 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea" gracePeriod=600 Jun 08 16:04:42.770056 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.769919 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="kube-rbac-proxy" containerID="cri-o://494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983" gracePeriod=600 Jun 08 16:04:42.770056 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.769954 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="kube-rbac-proxy-web" containerID="cri-o://f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538" gracePeriod=600 Jun 08 16:04:42.770056 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.769975 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="config-reloader" containerID="cri-o://a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2" gracePeriod=600 Jun 08 16:04:42.770411 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.770078 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="thanos-sidecar" containerID="cri-o://89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb" gracePeriod=600 Jun 08 16:04:42.927612 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:42.927515 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bdc4579dd-h8dh8"] Jun 08 16:04:42.932671 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:04:42.932643 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ab6ff4_228c_4d73_8642_597655f3ca2a.slice/crio-ecb7d68fc3e2a05dda03019b907c20b525e8805f82ca0fd790838eb3b7d487ac WatchSource:0}: Error finding container ecb7d68fc3e2a05dda03019b907c20b525e8805f82ca0fd790838eb3b7d487ac: Status 404 returned error can't find the container with id ecb7d68fc3e2a05dda03019b907c20b525e8805f82ca0fd790838eb3b7d487ac Jun 08 16:04:43.026773 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.026748 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.162768 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.162736 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8vgr\" (UniqueName: \"kubernetes.io/projected/8d136d0b-55e8-453d-9636-5d00f664df9b-kube-api-access-p8vgr\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.162938 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.162776 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d136d0b-55e8-453d-9636-5d00f664df9b-tls-assets\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.162938 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.162810 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-kube-rbac-proxy\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.162938 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.162838 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-1\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.162938 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.162874 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-metrics-client-ca\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.162938 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.162906 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-web-config\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163204 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163037 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-db\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163204 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163079 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d136d0b-55e8-453d-9636-5d00f664df9b-config-out\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163204 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163112 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-metrics-client-certs\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163204 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163142 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-config\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163204 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163180 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163489 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163217 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-serving-certs-ca-bundle\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163489 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163209 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:04:43.163489 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163240 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:04:43.163489 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163256 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-kubelet-serving-ca-bundle\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163489 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163357 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-trusted-ca-bundle\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163489 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163387 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-grpc-tls\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163489 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163413 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163489 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163466 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-0\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163878 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163495 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-thanos-prometheus-http-client-file\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163878 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163528 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-tls\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163878 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163568 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-2\") pod \"8d136d0b-55e8-453d-9636-5d00f664df9b\" (UID: \"8d136d0b-55e8-453d-9636-5d00f664df9b\") " Jun 08 16:04:43.163878 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163659 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:04:43.164101 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163889 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.164101 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163910 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-metrics-client-ca\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.164101 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163925 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.164101 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.163890 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:04:43.164395 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.164143 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:04:43.164395 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.164184 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:04:43.165494 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.165380 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 16:04:43.165923 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.165525 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d136d0b-55e8-453d-9636-5d00f664df9b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:04:43.166252 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.166192 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:43.166654 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.166601 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 16:04:43.167541 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.167457 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:43.167541 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.167477 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d136d0b-55e8-453d-9636-5d00f664df9b-kube-api-access-p8vgr" (OuterVolumeSpecName: "kube-api-access-p8vgr") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "kube-api-access-p8vgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:04:43.167703 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.167606 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:43.167855 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.167823 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d136d0b-55e8-453d-9636-5d00f664df9b-config-out" (OuterVolumeSpecName: "config-out") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 16:04:43.168216 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.168189 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:43.168331 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.168310 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:43.168526 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.168501 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:43.168619 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.168568 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-config" (OuterVolumeSpecName: "config") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:43.168751 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.168728 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:43.176337 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.176318 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-web-config" (OuterVolumeSpecName: "web-config") pod "8d136d0b-55e8-453d-9636-5d00f664df9b" (UID: "8d136d0b-55e8-453d-9636-5d00f664df9b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 16:04:43.264893 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264822 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.264893 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264849 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.264893 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264859 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-grpc-tls\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.264893 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264868 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.264893 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264877 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.264893 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264887 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.264893 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264895 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.265200 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264905 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.265200 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264914 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8vgr\" (UniqueName: \"kubernetes.io/projected/8d136d0b-55e8-453d-9636-5d00f664df9b-kube-api-access-p8vgr\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.265200 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264923 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d136d0b-55e8-453d-9636-5d00f664df9b-tls-assets\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.265200 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264931 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-kube-rbac-proxy\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.265200 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264940 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-web-config\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.265200 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264948 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d136d0b-55e8-453d-9636-5d00f664df9b-prometheus-k8s-db\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.265200 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264956 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d136d0b-55e8-453d-9636-5d00f664df9b-config-out\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.265200 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264964 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-metrics-client-certs\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.265200 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264973 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-config\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.265200 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.264981 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d136d0b-55e8-453d-9636-5d00f664df9b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:04:43.389794 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.389760 2567 generic.go:356] "Generic (PLEG): container finished" podID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerID="db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea" exitCode=0 Jun 08 16:04:43.389794 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.389792 2567 generic.go:356] "Generic (PLEG): container finished" podID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerID="494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983" exitCode=0 Jun 08 16:04:43.389794 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.389801 2567 generic.go:356] "Generic (PLEG): container finished" podID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerID="f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538" exitCode=0 Jun 08 16:04:43.390344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.389809 2567 generic.go:356] "Generic (PLEG): container finished" podID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerID="89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb" exitCode=0 Jun 08 16:04:43.390344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.389817 2567 generic.go:356] "Generic (PLEG): container finished" podID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerID="a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2" exitCode=0 Jun 08 16:04:43.390344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.389825 2567 generic.go:356] "Generic (PLEG): container finished" podID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerID="2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb" exitCode=0 Jun 08 16:04:43.390344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.389827 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerDied","Data":"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea"} Jun 08 16:04:43.390344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.389857 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.390344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.389899 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerDied","Data":"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983"} Jun 08 16:04:43.390344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.389944 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerDied","Data":"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538"} Jun 08 16:04:43.390344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.389978 2567 scope.go:117] "RemoveContainer" containerID="db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea" Jun 08 16:04:43.390344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.389989 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerDied","Data":"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb"} Jun 08 16:04:43.390344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.390132 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerDied","Data":"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2"} Jun 08 16:04:43.390344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.390179 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerDied","Data":"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb"} Jun 08 16:04:43.390344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.390219 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d136d0b-55e8-453d-9636-5d00f664df9b","Type":"ContainerDied","Data":"3982d9f8482b62d3b7cfa074e759aa00c5eb7fb5b480d377a57a5ede0667666a"} Jun 08 16:04:43.391686 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.391661 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" event={"ID":"59ab6ff4-228c-4d73-8642-597655f3ca2a","Type":"ContainerStarted","Data":"ecb7d68fc3e2a05dda03019b907c20b525e8805f82ca0fd790838eb3b7d487ac"} Jun 08 16:04:43.398534 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.398515 2567 scope.go:117] "RemoveContainer" containerID="494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983" Jun 08 16:04:43.405865 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.405849 2567 scope.go:117] "RemoveContainer" containerID="f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538" Jun 08 16:04:43.412328 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.412306 2567 scope.go:117] "RemoveContainer" containerID="89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb" Jun 08 16:04:43.416946 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.416922 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 16:04:43.421792 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.421769 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 16:04:43.424123 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.424104 2567 scope.go:117] "RemoveContainer" containerID="a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2" Jun 08 16:04:43.430833 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.430815 2567 scope.go:117] "RemoveContainer" containerID="2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb" Jun 08 16:04:43.437873 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.437846 2567 scope.go:117] "RemoveContainer" containerID="79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae" Jun 08 16:04:43.446700 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.446681 2567 scope.go:117] "RemoveContainer" containerID="db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea" Jun 08 16:04:43.446993 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:43.446972 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": container with ID starting with db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea not found: ID does not exist" containerID="db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea" Jun 08 16:04:43.447061 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.447000 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea"} err="failed to get container status \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": rpc error: code = NotFound desc = could not find container \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": container with ID starting with db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea not found: ID does not exist" Jun 08 16:04:43.447061 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.447019 2567 scope.go:117] "RemoveContainer" containerID="494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983" Jun 08 16:04:43.447339 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:43.447319 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": container with ID starting with 494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983 not found: ID does not exist" containerID="494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983" Jun 08 16:04:43.447442 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.447344 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983"} err="failed to get container status \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": rpc error: code = NotFound desc = could not find container \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": container with ID starting with 494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983 not found: ID does not exist" Jun 08 16:04:43.447442 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.447362 2567 scope.go:117] "RemoveContainer" containerID="f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538" Jun 08 16:04:43.447597 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:43.447578 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": container with ID starting with f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538 not found: ID does not exist" containerID="f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538" Jun 08 16:04:43.447651 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.447602 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538"} err="failed to get container status \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": rpc error: code = NotFound desc = could not find container \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": container with ID starting with f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538 not found: ID does not exist" Jun 08 16:04:43.447651 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.447618 2567 scope.go:117] "RemoveContainer" containerID="89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb" Jun 08 16:04:43.447784 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.447760 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 16:04:43.447878 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:43.447821 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": container with ID starting with 89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb not found: ID does not exist" containerID="89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb" Jun 08 16:04:43.447878 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.447837 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb"} err="failed to get container status \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": rpc error: code = NotFound desc = could not find container \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": container with ID starting with 89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb not found: ID does not exist" Jun 08 16:04:43.447878 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.447856 2567 scope.go:117] "RemoveContainer" containerID="a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2" Jun 08 16:04:43.448092 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448079 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="thanos-sidecar" Jun 08 16:04:43.448142 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448098 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="thanos-sidecar" Jun 08 16:04:43.448142 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448108 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="kube-rbac-proxy-web" Jun 08 16:04:43.448142 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448114 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="kube-rbac-proxy-web" Jun 08 16:04:43.448142 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448128 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="kube-rbac-proxy" Jun 08 16:04:43.448142 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448133 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="kube-rbac-proxy" Jun 08 16:04:43.448142 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448140 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="kube-rbac-proxy-thanos" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448145 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="kube-rbac-proxy-thanos" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448154 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="config-reloader" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448159 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="config-reloader" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448166 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="init-config-reloader" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448171 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="init-config-reloader" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448180 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="prometheus" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448186 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="prometheus" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:43.448079 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": container with ID starting with a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2 not found: ID does not exist" containerID="a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448238 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="kube-rbac-proxy-web" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448241 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2"} err="failed to get container status \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": rpc error: code = NotFound desc = could not find container \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": container with ID starting with a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2 not found: ID does not exist" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448250 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="thanos-sidecar" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448282 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="config-reloader" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448289 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="kube-rbac-proxy-thanos" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448294 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="kube-rbac-proxy" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448300 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" containerName="prometheus" Jun 08 16:04:43.448503 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448252 2567 scope.go:117] "RemoveContainer" containerID="2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb" Jun 08 16:04:43.449117 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:43.448562 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": container with ID starting with 2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb not found: ID does not exist" containerID="2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb" Jun 08 16:04:43.449117 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448579 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb"} err="failed to get container status \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": rpc error: code = NotFound desc = could not find container \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": container with ID starting with 2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb not found: ID does not exist" Jun 08 16:04:43.449117 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448596 2567 scope.go:117] "RemoveContainer" containerID="79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae" Jun 08 16:04:43.449117 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:04:43.448789 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": container with ID starting with 79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae not found: ID does not exist" containerID="79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae" Jun 08 16:04:43.449117 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448804 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae"} err="failed to get container status \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": rpc error: code = NotFound desc = could not find container \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": container with ID starting with 79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae not found: ID does not exist" Jun 08 16:04:43.449117 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448817 2567 scope.go:117] "RemoveContainer" containerID="db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea" Jun 08 16:04:43.449117 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448985 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea"} err="failed to get container status \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": rpc error: code = NotFound desc = could not find container \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": container with ID starting with db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea not found: ID does not exist" Jun 08 16:04:43.449117 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.448998 2567 scope.go:117] "RemoveContainer" containerID="494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983" Jun 08 16:04:43.449521 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.449191 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983"} err="failed to get container status \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": rpc error: code = NotFound desc = could not find container \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": container with ID starting with 494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983 not found: ID does not exist" Jun 08 16:04:43.449521 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.449204 2567 scope.go:117] "RemoveContainer" containerID="f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538" Jun 08 16:04:43.449521 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.449421 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538"} err="failed to get container status \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": rpc error: code = NotFound desc = could not find container \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": container with ID starting with f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538 not found: ID does not exist" Jun 08 16:04:43.449521 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.449437 2567 scope.go:117] "RemoveContainer" containerID="89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb" Jun 08 16:04:43.449812 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.449792 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb"} err="failed to get container status \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": rpc error: code = NotFound desc = could not find container \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": container with ID starting with 89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb not found: ID does not exist" Jun 08 16:04:43.449859 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.449813 2567 scope.go:117] "RemoveContainer" containerID="a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2" Jun 08 16:04:43.450041 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.450022 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2"} err="failed to get container status \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": rpc error: code = NotFound desc = could not find container \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": container with ID starting with a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2 not found: ID does not exist" Jun 08 16:04:43.450099 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.450041 2567 scope.go:117] "RemoveContainer" containerID="2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb" Jun 08 16:04:43.450288 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.450249 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb"} err="failed to get container status \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": rpc error: code = NotFound desc = could not find container \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": container with ID starting with 2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb not found: ID does not exist" Jun 08 16:04:43.450288 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.450288 2567 scope.go:117] "RemoveContainer" containerID="79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae" Jun 08 16:04:43.450524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.450506 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae"} err="failed to get container status \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": rpc error: code = NotFound desc = could not find container \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": container with ID starting with 79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae not found: ID does not exist" Jun 08 16:04:43.450524 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.450524 2567 scope.go:117] "RemoveContainer" containerID="db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea" Jun 08 16:04:43.451001 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.450986 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea"} err="failed to get container status \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": rpc error: code = NotFound desc = could not find container \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": container with ID starting with db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea not found: ID does not exist" Jun 08 16:04:43.451043 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.451002 2567 scope.go:117] "RemoveContainer" containerID="494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983" Jun 08 16:04:43.451230 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.451208 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983"} err="failed to get container status \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": rpc error: code = NotFound desc = could not find container \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": container with ID starting with 494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983 not found: ID does not exist" Jun 08 16:04:43.451350 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.451231 2567 scope.go:117] "RemoveContainer" containerID="f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538" Jun 08 16:04:43.451451 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.451435 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.451508 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.451488 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538"} err="failed to get container status \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": rpc error: code = NotFound desc = could not find container \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": container with ID starting with f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538 not found: ID does not exist" Jun 08 16:04:43.451508 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.451504 2567 scope.go:117] "RemoveContainer" containerID="89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb" Jun 08 16:04:43.451753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.451724 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb"} err="failed to get container status \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": rpc error: code = NotFound desc = could not find container \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": container with ID starting with 89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb not found: ID does not exist" Jun 08 16:04:43.451753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.451754 2567 scope.go:117] "RemoveContainer" containerID="a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2" Jun 08 16:04:43.452155 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.452117 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2"} err="failed to get container status \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": rpc error: code = NotFound desc = could not find container \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": container with ID starting with a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2 not found: ID does not exist" Jun 08 16:04:43.452296 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.452156 2567 scope.go:117] "RemoveContainer" containerID="2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb" Jun 08 16:04:43.452515 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.452487 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb"} err="failed to get container status \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": rpc error: code = NotFound desc = could not find container \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": container with ID starting with 2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb not found: ID does not exist" Jun 08 16:04:43.452596 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.452516 2567 scope.go:117] "RemoveContainer" containerID="79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae" Jun 08 16:04:43.452893 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.452862 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae"} err="failed to get container status \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": rpc error: code = NotFound desc = could not find container \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": container with ID starting with 79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae not found: ID does not exist" Jun 08 16:04:43.452982 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.452894 2567 scope.go:117] "RemoveContainer" containerID="db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea" Jun 08 16:04:43.453210 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.453185 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea"} err="failed to get container status \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": rpc error: code = NotFound desc = could not find container \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": container with ID starting with db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea not found: ID does not exist" Jun 08 16:04:43.453329 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.453211 2567 scope.go:117] "RemoveContainer" containerID="494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983" Jun 08 16:04:43.453502 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.453478 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983"} err="failed to get container status \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": rpc error: code = NotFound desc = could not find container \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": container with ID starting with 494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983 not found: ID does not exist" Jun 08 16:04:43.453502 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.453501 2567 scope.go:117] "RemoveContainer" containerID="f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538" Jun 08 16:04:43.453732 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.453719 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538"} err="failed to get container status \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": rpc error: code = NotFound desc = could not find container \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": container with ID starting with f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538 not found: ID does not exist" Jun 08 16:04:43.453773 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.453734 2567 scope.go:117] "RemoveContainer" containerID="89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb" Jun 08 16:04:43.453943 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.453923 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb"} err="failed to get container status \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": rpc error: code = NotFound desc = could not find container \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": container with ID starting with 89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb not found: ID does not exist" Jun 08 16:04:43.454011 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.453944 2567 scope.go:117] "RemoveContainer" containerID="a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2" Jun 08 16:04:43.454058 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.454041 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 16:04:43.454313 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.454233 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2"} err="failed to get container status \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": rpc error: code = NotFound desc = could not find container \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": container with ID starting with a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2 not found: ID does not exist" Jun 08 16:04:43.454313 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.454273 2567 scope.go:117] "RemoveContainer" containerID="2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb" Jun 08 16:04:43.454595 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.454574 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 16:04:43.454595 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.454575 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb"} err="failed to get container status \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": rpc error: code = NotFound desc = could not find container \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": container with ID starting with 2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb not found: ID does not exist" Jun 08 16:04:43.454595 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.454603 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 16:04:43.454843 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.454685 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 16:04:43.454843 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.454604 2567 scope.go:117] "RemoveContainer" containerID="79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae" Jun 08 16:04:43.454843 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.454603 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 16:04:43.454981 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.454851 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 16:04:43.455149 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.455129 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae"} err="failed to get container status \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": rpc error: code = NotFound desc = could not find container \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": container with ID starting with 79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae not found: ID does not exist" Jun 08 16:04:43.455247 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.455151 2567 scope.go:117] "RemoveContainer" containerID="db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea" Jun 08 16:04:43.455810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.455397 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea"} err="failed to get container status \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": rpc error: code = NotFound desc = could not find container \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": container with ID starting with db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea not found: ID does not exist" Jun 08 16:04:43.455810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.455423 2567 scope.go:117] "RemoveContainer" containerID="494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983" Jun 08 16:04:43.455810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.455503 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 16:04:43.455810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.455546 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 16:04:43.455810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.455567 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-46r08d9mfl8ti\"" Jun 08 16:04:43.455810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.455631 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 16:04:43.456214 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.456042 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983"} err="failed to get container status \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": rpc error: code = NotFound desc = could not find container \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": container with ID starting with 494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983 not found: ID does not exist" Jun 08 16:04:43.456214 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.456067 2567 scope.go:117] "RemoveContainer" containerID="f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538" Jun 08 16:04:43.456376 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.456248 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 16:04:43.456477 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.456403 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 16:04:43.456705 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.456536 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4dnbz\"" Jun 08 16:04:43.456705 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.456667 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538"} err="failed to get container status \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": rpc error: code = NotFound desc = could not find container \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": container with ID starting with f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538 not found: ID does not exist" Jun 08 16:04:43.456879 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.456708 2567 scope.go:117] "RemoveContainer" containerID="89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb" Jun 08 16:04:43.456968 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.456950 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 16:04:43.457538 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.457435 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb"} err="failed to get container status \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": rpc error: code = NotFound desc = could not find container \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": container with ID starting with 89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb not found: ID does not exist" Jun 08 16:04:43.457538 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.457462 2567 scope.go:117] "RemoveContainer" containerID="a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2" Jun 08 16:04:43.458344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.457798 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2"} err="failed to get container status \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": rpc error: code = NotFound desc = could not find container \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": container with ID starting with a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2 not found: ID does not exist" Jun 08 16:04:43.458344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.457823 2567 scope.go:117] "RemoveContainer" containerID="2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb" Jun 08 16:04:43.458344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.458095 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb"} err="failed to get container status \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": rpc error: code = NotFound desc = could not find container \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": container with ID starting with 2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb not found: ID does not exist" Jun 08 16:04:43.458344 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.458113 2567 scope.go:117] "RemoveContainer" containerID="79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae" Jun 08 16:04:43.458623 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.458594 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae"} err="failed to get container status \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": rpc error: code = NotFound desc = could not find container \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": container with ID starting with 79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae not found: ID does not exist" Jun 08 16:04:43.458746 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.458627 2567 scope.go:117] "RemoveContainer" containerID="db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea" Jun 08 16:04:43.459044 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.459020 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea"} err="failed to get container status \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": rpc error: code = NotFound desc = could not find container \"db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea\": container with ID starting with db44968697c0e95d8d364bfb8ad030b67741e285d03843f67e79ab2e994bcdea not found: ID does not exist" Jun 08 16:04:43.459179 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.459047 2567 scope.go:117] "RemoveContainer" containerID="494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983" Jun 08 16:04:43.459179 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.459096 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 16:04:43.459535 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.459319 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983"} err="failed to get container status \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": rpc error: code = NotFound desc = could not find container \"494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983\": container with ID starting with 494b2600e411effa830a2d10252dc9e0755526022bb8192f4629db6935b47983 not found: ID does not exist" Jun 08 16:04:43.459535 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.459343 2567 scope.go:117] "RemoveContainer" containerID="f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538" Jun 08 16:04:43.459904 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.459620 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538"} err="failed to get container status \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": rpc error: code = NotFound desc = could not find container \"f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538\": container with ID starting with f5d6a22c299e1a1aa12234eb2bbf91f73693eddc83215593c477f4001ebe7538 not found: ID does not exist" Jun 08 16:04:43.459904 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.459642 2567 scope.go:117] "RemoveContainer" containerID="89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb" Jun 08 16:04:43.460015 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.459960 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb"} err="failed to get container status \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": rpc error: code = NotFound desc = could not find container \"89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb\": container with ID starting with 89d20df7aeef3c8b505b1e6361f5f006e210b328f884ee42da0e9a32025149cb not found: ID does not exist" Jun 08 16:04:43.460015 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.459983 2567 scope.go:117] "RemoveContainer" containerID="a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2" Jun 08 16:04:43.460308 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.460286 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2"} err="failed to get container status \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": rpc error: code = NotFound desc = could not find container \"a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2\": container with ID starting with a2c0b1dc567670673e265299c16dbcdb939e4faf09b463c91e47166623acbba2 not found: ID does not exist" Jun 08 16:04:43.460426 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.460407 2567 scope.go:117] "RemoveContainer" containerID="2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb" Jun 08 16:04:43.460797 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.460705 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb"} err="failed to get container status \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": rpc error: code = NotFound desc = could not find container \"2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb\": container with ID starting with 2347d0edaf6cee9f7bf9f8599b31179857f4213f9589e736a715fb3f043e96bb not found: ID does not exist" Jun 08 16:04:43.460797 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.460733 2567 scope.go:117] "RemoveContainer" containerID="79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae" Jun 08 16:04:43.461162 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.461133 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae"} err="failed to get container status \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": rpc error: code = NotFound desc = could not find container \"79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae\": container with ID starting with 79f8c50d71d704de016e2232d3bd0dd50d7efc3618d7c7c7b8f1362428c434ae not found: ID does not exist" Jun 08 16:04:43.462181 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.462162 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 16:04:43.468203 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.468179 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 16:04:43.498960 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.498927 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:43.567569 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567569 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567736 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567736 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567736 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567736 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567715 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-config\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567867 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567737 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567867 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567761 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567867 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567778 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sxs2\" (UniqueName: \"kubernetes.io/projected/5fcee106-369e-4fdc-8502-96b1d19161ea-kube-api-access-4sxs2\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567867 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567796 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567867 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567817 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567867 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567867 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fcee106-369e-4fdc-8502-96b1d19161ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.567867 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.568097 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567946 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fcee106-369e-4fdc-8502-96b1d19161ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.568097 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.568097 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.568097 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.567995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.568097 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.568016 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.568097 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.568042 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.668816 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.668683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.668816 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.668727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.668907 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.668829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.668907 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.668856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.668907 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.668871 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669136 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669090 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669231 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669231 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669359 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669231 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669359 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669295 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-config\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669359 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669321 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669359 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669348 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669545 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sxs2\" (UniqueName: \"kubernetes.io/projected/5fcee106-369e-4fdc-8502-96b1d19161ea-kube-api-access-4sxs2\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669545 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669545 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669436 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669545 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669545 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669467 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669545 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669490 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fcee106-369e-4fdc-8502-96b1d19161ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669545 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669890 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669566 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fcee106-369e-4fdc-8502-96b1d19161ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669890 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669670 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.669890 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.669694 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.671577 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.671544 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.672606 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.672576 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.672926 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.672880 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.674016 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.673630 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.674723 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.674100 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.674723 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.674225 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.674872 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.674767 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.675082 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.675033 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.675488 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.675464 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fcee106-369e-4fdc-8502-96b1d19161ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.676559 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.676533 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5fcee106-369e-4fdc-8502-96b1d19161ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.677556 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.677536 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.677640 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.677565 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.677971 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.677846 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fcee106-369e-4fdc-8502-96b1d19161ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.678481 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.678455 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.678591 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.678572 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.679498 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.679470 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5fcee106-369e-4fdc-8502-96b1d19161ea-config\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.682664 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.682641 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sxs2\" (UniqueName: \"kubernetes.io/projected/5fcee106-369e-4fdc-8502-96b1d19161ea-kube-api-access-4sxs2\") pod \"prometheus-k8s-0\" (UID: \"5fcee106-369e-4fdc-8502-96b1d19161ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.765453 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.765423 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:43.911706 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:43.911671 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 16:04:43.914600 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:04:43.914570 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fcee106_369e_4fdc_8502_96b1d19161ea.slice/crio-5525bd467e2aa2e3c183648e964cc9cc3069cf4673ab7e7e67496a512efeb5ac WatchSource:0}: Error finding container 5525bd467e2aa2e3c183648e964cc9cc3069cf4673ab7e7e67496a512efeb5ac: Status 404 returned error can't find the container with id 5525bd467e2aa2e3c183648e964cc9cc3069cf4673ab7e7e67496a512efeb5ac Jun 08 16:04:44.399666 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:44.399628 2567 generic.go:356] "Generic (PLEG): container finished" podID="5fcee106-369e-4fdc-8502-96b1d19161ea" containerID="8825dfd6322e0ff32a8305a00338f11768da80026ed795ca65cd65b685a36b13" exitCode=0 Jun 08 16:04:44.400159 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:44.399686 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fcee106-369e-4fdc-8502-96b1d19161ea","Type":"ContainerDied","Data":"8825dfd6322e0ff32a8305a00338f11768da80026ed795ca65cd65b685a36b13"} Jun 08 16:04:44.400159 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:44.399756 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fcee106-369e-4fdc-8502-96b1d19161ea","Type":"ContainerStarted","Data":"5525bd467e2aa2e3c183648e964cc9cc3069cf4673ab7e7e67496a512efeb5ac"} Jun 08 16:04:44.762618 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:44.762582 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d136d0b-55e8-453d-9636-5d00f664df9b" path="/var/lib/kubelet/pods/8d136d0b-55e8-453d-9636-5d00f664df9b/volumes" Jun 08 16:04:45.406975 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:45.406939 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fcee106-369e-4fdc-8502-96b1d19161ea","Type":"ContainerStarted","Data":"7dc460d2251daa80edfeb22eb4b9e136ec98de5f425f5d7b5a4e67cba498b774"} Jun 08 16:04:45.407358 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:45.407025 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fcee106-369e-4fdc-8502-96b1d19161ea","Type":"ContainerStarted","Data":"a8b3edc10dc879a3d90bd0e2ebc3bf13df1b0390fdbd0b9c703a5cd403b5b40f"} Jun 08 16:04:45.407358 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:45.407074 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fcee106-369e-4fdc-8502-96b1d19161ea","Type":"ContainerStarted","Data":"3a6e90ca8c0987d5305878f8bf20562128710f76f116e8813acae9ee1d506bdc"} Jun 08 16:04:45.407358 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:45.407118 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fcee106-369e-4fdc-8502-96b1d19161ea","Type":"ContainerStarted","Data":"5f7bcf414e9725a26204f41ba839a159175b850cb4f3ba7e0969a4a9dd2b967c"} Jun 08 16:04:45.407358 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:45.407158 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fcee106-369e-4fdc-8502-96b1d19161ea","Type":"ContainerStarted","Data":"b9b3ab4a6cc9b34f44f5df03f9f254b302276047feb5193d68b27bb3876e753b"} Jun 08 16:04:45.407358 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:45.407190 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fcee106-369e-4fdc-8502-96b1d19161ea","Type":"ContainerStarted","Data":"6779180ecba0f748de0d94b760b803a9b6bd17c6f3382ac3f5db888896147219"} Jun 08 16:04:45.409078 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:45.409052 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" event={"ID":"59ab6ff4-228c-4d73-8642-597655f3ca2a","Type":"ContainerStarted","Data":"4ce3d186c02d86e5f7b6a4cab1416f4f4b662aee92c2693d96cee420d88fb503"} Jun 08 16:04:45.409191 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:45.409109 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" event={"ID":"59ab6ff4-228c-4d73-8642-597655f3ca2a","Type":"ContainerStarted","Data":"dfee20f486a15245bea56c601c725c4e4ff7e0a043f403d328a6ae1a6aa7ef51"} Jun 08 16:04:45.409191 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:45.409130 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" event={"ID":"59ab6ff4-228c-4d73-8642-597655f3ca2a","Type":"ContainerStarted","Data":"e0c596d29723a3cbd7a5412c0cffa6c040db6bae887180c6d0e0be508722516b"} Jun 08 16:04:45.434211 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:45.434160 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.416414479 podStartE2EDuration="2.434139091s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.724612ms" isStatefulPod=false podCreationTimestamp="2026-06-08 16:04:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:04:45.433065228 +0000 UTC m=+127.120711464" watchObservedRunningTime="2026-06-08 16:04:45.434139091 +0000 UTC m=+127.121785339" Jun 08 16:04:45.456815 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:45.456756 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-bdc4579dd-h8dh8" podStartSLOduration=1.3061957419999999 podStartE2EDuration="3.456736717s" totalImagesPullingTime="2.150540975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:04:45.454919845 +0000 UTC m=+127.142566106" watchObservedRunningTime="2026-06-08 16:04:45.456736717 +0000 UTC m=+127.144382954" Jun 08 16:04:46.298089 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:46.298055 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:46.349583 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:46.349550 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:48.765529 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:48.765503 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:04:57.320112 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:57.320075 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:57.377039 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:57.377009 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:04:57.438218 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:04:57.438187 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:05:43.766047 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:05:43.766005 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:05:43.781569 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:05:43.781546 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:05:44.664954 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:05:44.664928 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 16:05:52.585882 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:05:52.585845 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:05:52.644597 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:05:52.644566 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:01.517761 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:01.517720 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:01.582169 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:01.582132 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:01.679859 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:01.679827 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:01.780498 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:01.780408 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:02.253620 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:02.253586 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:04.425716 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:04.425680 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:04.481323 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:04.481289 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:08.732507 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:08.732460 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:10.311690 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:10.311651 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:10.410686 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:10.410651 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:12.619510 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:12.619475 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:12.676880 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:12.676849 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:12.731644 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:12.731613 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:42.167758 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:42.167724 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:43.321833 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:43.321801 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:59.213556 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:59.213475 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:06:59.314471 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:06:59.314436 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:25.882086 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:25.882048 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:26.722245 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:26.722216 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:29.537713 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:29.537677 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:29.667068 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:29.667037 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:30.704905 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:30.704867 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:30.799722 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:30.799654 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:33.579091 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.579055 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-chsx2"] Jun 08 16:07:33.582221 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.582203 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" Jun 08 16:07:33.584788 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.584768 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 16:07:33.585816 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.585796 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 16:07:33.585816 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.585811 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rx89z\"" Jun 08 16:07:33.593813 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.593794 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-chsx2"] Jun 08 16:07:33.633625 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.633592 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-chsx2\" (UID: \"373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" Jun 08 16:07:33.633625 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.633627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4qs8\" (UniqueName: \"kubernetes.io/projected/373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf-kube-api-access-g4qs8\") pod \"cert-manager-webhook-7dc76cbb94-chsx2\" (UID: \"373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" Jun 08 16:07:33.734550 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.734512 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-chsx2\" (UID: \"373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" Jun 08 16:07:33.734550 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.734552 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4qs8\" (UniqueName: \"kubernetes.io/projected/373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf-kube-api-access-g4qs8\") pod \"cert-manager-webhook-7dc76cbb94-chsx2\" (UID: \"373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" Jun 08 16:07:33.743491 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.743464 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-chsx2\" (UID: \"373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" Jun 08 16:07:33.743682 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.743659 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4qs8\" (UniqueName: \"kubernetes.io/projected/373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf-kube-api-access-g4qs8\") pod \"cert-manager-webhook-7dc76cbb94-chsx2\" (UID: \"373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" Jun 08 16:07:33.899241 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.899156 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" Jun 08 16:07:33.992783 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:33.992731 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:34.032516 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:34.028471 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-chsx2"] Jun 08 16:07:34.034772 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:07:34.034742 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod373f019e_7cce_4b6c_b6d3_6ed6ed64fbbf.slice/crio-d8fcc55f5c0ef35905dc39ceff3254e1d9f6166efca7d97ab5249bcc5c7b9064 WatchSource:0}: Error finding container d8fcc55f5c0ef35905dc39ceff3254e1d9f6166efca7d97ab5249bcc5c7b9064: Status 404 returned error can't find the container with id d8fcc55f5c0ef35905dc39ceff3254e1d9f6166efca7d97ab5249bcc5c7b9064 Jun 08 16:07:34.092769 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:34.092726 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" event={"ID":"373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf","Type":"ContainerStarted","Data":"d8fcc55f5c0ef35905dc39ceff3254e1d9f6166efca7d97ab5249bcc5c7b9064"} Jun 08 16:07:34.300890 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:34.300842 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:34.399896 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:34.399856 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:34.586754 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:34.586655 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:37.108419 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:37.108385 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" event={"ID":"373f019e-7cce-4b6c-b6d3-6ed6ed64fbbf","Type":"ContainerStarted","Data":"3f034f4cfd1d68063dcbbc288b5c20e7e793d7254710c741f261f12be609bc09"} Jun 08 16:07:37.108811 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:37.108510 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" Jun 08 16:07:37.147369 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:37.147315 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" podStartSLOduration=1.193948719 podStartE2EDuration="4.147293699s" totalImagesPullingTime="2.95334498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:07:37.145384004 +0000 UTC m=+298.833030240" watchObservedRunningTime="2026-06-08 16:07:37.147293699 +0000 UTC m=+298.834939936" Jun 08 16:07:38.017939 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:38.017900 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:38.700670 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:38.700642 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/ovn-acl-logging/0.log" Jun 08 16:07:38.702961 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:38.702940 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/ovn-acl-logging/0.log" Jun 08 16:07:38.714641 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:38.714617 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 16:07:42.383943 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:42.383876 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:43.115614 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:43.115580 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-chsx2" Jun 08 16:07:52.498475 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:52.498443 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-cghw6"] Jun 08 16:07:52.500779 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:52.500763 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-cghw6" Jun 08 16:07:52.503429 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:52.503411 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kvdfj\"" Jun 08 16:07:52.510874 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:52.510841 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-cghw6"] Jun 08 16:07:52.604633 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:52.604598 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a8dc2d9-3f62-451b-b02d-fea8c8bcac38-bound-sa-token\") pod \"cert-manager-59c77684cc-cghw6\" (UID: \"8a8dc2d9-3f62-451b-b02d-fea8c8bcac38\") " pod="cert-manager/cert-manager-59c77684cc-cghw6" Jun 08 16:07:52.604813 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:52.604644 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgvdk\" (UniqueName: \"kubernetes.io/projected/8a8dc2d9-3f62-451b-b02d-fea8c8bcac38-kube-api-access-cgvdk\") pod \"cert-manager-59c77684cc-cghw6\" (UID: \"8a8dc2d9-3f62-451b-b02d-fea8c8bcac38\") " pod="cert-manager/cert-manager-59c77684cc-cghw6" Jun 08 16:07:52.706196 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:52.706143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a8dc2d9-3f62-451b-b02d-fea8c8bcac38-bound-sa-token\") pod \"cert-manager-59c77684cc-cghw6\" (UID: \"8a8dc2d9-3f62-451b-b02d-fea8c8bcac38\") " pod="cert-manager/cert-manager-59c77684cc-cghw6" Jun 08 16:07:52.706196 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:52.706199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgvdk\" (UniqueName: \"kubernetes.io/projected/8a8dc2d9-3f62-451b-b02d-fea8c8bcac38-kube-api-access-cgvdk\") pod \"cert-manager-59c77684cc-cghw6\" (UID: \"8a8dc2d9-3f62-451b-b02d-fea8c8bcac38\") " pod="cert-manager/cert-manager-59c77684cc-cghw6" Jun 08 16:07:52.715419 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:52.715390 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a8dc2d9-3f62-451b-b02d-fea8c8bcac38-bound-sa-token\") pod \"cert-manager-59c77684cc-cghw6\" (UID: \"8a8dc2d9-3f62-451b-b02d-fea8c8bcac38\") " pod="cert-manager/cert-manager-59c77684cc-cghw6" Jun 08 16:07:52.715529 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:52.715419 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgvdk\" (UniqueName: \"kubernetes.io/projected/8a8dc2d9-3f62-451b-b02d-fea8c8bcac38-kube-api-access-cgvdk\") pod \"cert-manager-59c77684cc-cghw6\" (UID: \"8a8dc2d9-3f62-451b-b02d-fea8c8bcac38\") " pod="cert-manager/cert-manager-59c77684cc-cghw6" Jun 08 16:07:52.809502 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:52.809430 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-cghw6" Jun 08 16:07:52.938104 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:52.937979 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-cghw6"] Jun 08 16:07:52.940983 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:07:52.940956 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a8dc2d9_3f62_451b_b02d_fea8c8bcac38.slice/crio-bc593a51f8dde627d31522dff68112511dcc32ccd11213b46c3c6cda24e34cba WatchSource:0}: Error finding container bc593a51f8dde627d31522dff68112511dcc32ccd11213b46c3c6cda24e34cba: Status 404 returned error can't find the container with id bc593a51f8dde627d31522dff68112511dcc32ccd11213b46c3c6cda24e34cba Jun 08 16:07:53.175624 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:53.175595 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-cghw6" event={"ID":"8a8dc2d9-3f62-451b-b02d-fea8c8bcac38","Type":"ContainerStarted","Data":"f7e2788f9fc9f5bd35a451c699bd72f896d6dc11ba511b913f574edf9e0319a0"} Jun 08 16:07:53.175792 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:53.175632 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-cghw6" event={"ID":"8a8dc2d9-3f62-451b-b02d-fea8c8bcac38","Type":"ContainerStarted","Data":"bc593a51f8dde627d31522dff68112511dcc32ccd11213b46c3c6cda24e34cba"} Jun 08 16:07:53.195380 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:53.195321 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-cghw6" podStartSLOduration=1.19529994 podStartE2EDuration="1.19529994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:07:53.195006636 +0000 UTC m=+314.882652874" watchObservedRunningTime="2026-06-08 16:07:53.19529994 +0000 UTC m=+314.882946190" Jun 08 16:07:53.398197 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:53.398156 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:07:53.491579 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:07:53.491461 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:03.231424 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:03.231390 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:03.331321 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:03.331287 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:04.983011 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:04.982977 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:05.080316 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:05.080286 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:14.128447 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:14.128405 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:14.881145 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:14.881100 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:14.987255 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:14.987221 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:16.939528 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:16.939493 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:24.718289 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:24.718242 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:24.775455 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:24.775424 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:31.279755 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:31.279672 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:31.382171 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:31.382137 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:34.337470 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:34.337440 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:34.707225 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:34.707188 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:08:38.850054 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:08:38.850017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:10:29.208468 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.208431 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:10:29.285802 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.285769 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:10:29.290093 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.290066 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm"] Jun 08 16:10:29.292391 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.292374 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm" Jun 08 16:10:29.294964 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.294943 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-djf88\"/\"kube-root-ca.crt\"" Jun 08 16:10:29.295097 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.295001 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-djf88\"/\"default-dockercfg-jnhff\"" Jun 08 16:10:29.295993 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.295980 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-djf88\"/\"openshift-service-ca.crt\"" Jun 08 16:10:29.308191 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.308170 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm"] Jun 08 16:10:29.463459 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.463376 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twnx7\" (UniqueName: \"kubernetes.io/projected/a93dd210-5d91-437c-8599-58563111e73f-kube-api-access-twnx7\") pod \"test-trainjob-zhwxl-node-0-0-x2kkm\" (UID: \"a93dd210-5d91-437c-8599-58563111e73f\") " pod="test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm" Jun 08 16:10:29.564163 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.564132 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twnx7\" (UniqueName: \"kubernetes.io/projected/a93dd210-5d91-437c-8599-58563111e73f-kube-api-access-twnx7\") pod \"test-trainjob-zhwxl-node-0-0-x2kkm\" (UID: \"a93dd210-5d91-437c-8599-58563111e73f\") " pod="test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm" Jun 08 16:10:29.573381 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.573357 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twnx7\" (UniqueName: \"kubernetes.io/projected/a93dd210-5d91-437c-8599-58563111e73f-kube-api-access-twnx7\") pod \"test-trainjob-zhwxl-node-0-0-x2kkm\" (UID: \"a93dd210-5d91-437c-8599-58563111e73f\") " pod="test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm" Jun 08 16:10:29.601062 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.601038 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm" Jun 08 16:10:29.732070 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.732045 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm"] Jun 08 16:10:29.738306 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.738284 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 16:10:29.826955 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:29.826918 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm" event={"ID":"a93dd210-5d91-437c-8599-58563111e73f","Type":"ContainerStarted","Data":"e0e2264c61333fa5bd4988b7db7b810efc5cd63e5f2215faf2e982c11ac3ca98"} Jun 08 16:10:35.838987 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:35.838945 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:10:35.901195 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:35.901147 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:10:46.818307 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:46.818251 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:10:46.919405 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:46.919369 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:10:46.975852 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:10:46.975808 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:11:16.370726 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:11:16.370687 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:11:16.443448 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:11:16.443414 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:11:36.276023 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:11:36.275929 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:11:57.274766 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:11:57.274731 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm" event={"ID":"a93dd210-5d91-437c-8599-58563111e73f","Type":"ContainerStarted","Data":"043741e714e50a4216cfa7281eaee361400b0cada4db79c0268f1c7b7febad2a"} Jun 08 16:11:57.296805 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:11:57.296757 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm" podStartSLOduration=1.42113297 podStartE2EDuration="1m28.296741656s" totalImagesPullingTime="1m26.875608686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:11:57.295331288 +0000 UTC m=+558.982977527" watchObservedRunningTime="2026-06-08 16:11:57.296741656 +0000 UTC m=+558.984387892" Jun 08 16:11:59.171421 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:11:59.171387 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-djf88_test-trainjob-zhwxl-node-0-0-x2kkm_a93dd210-5d91-437c-8599-58563111e73f/node/0.log" Jun 08 16:12:00.288982 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:00.288951 2567 generic.go:356] "Generic (PLEG): container finished" podID="a93dd210-5d91-437c-8599-58563111e73f" containerID="043741e714e50a4216cfa7281eaee361400b0cada4db79c0268f1c7b7febad2a" exitCode=0 Jun 08 16:12:00.289424 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:00.289030 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm" event={"ID":"a93dd210-5d91-437c-8599-58563111e73f","Type":"ContainerDied","Data":"043741e714e50a4216cfa7281eaee361400b0cada4db79c0268f1c7b7febad2a"} Jun 08 16:12:01.428141 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:01.428114 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm" Jun 08 16:12:01.607891 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:01.607802 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twnx7\" (UniqueName: \"kubernetes.io/projected/a93dd210-5d91-437c-8599-58563111e73f-kube-api-access-twnx7\") pod \"a93dd210-5d91-437c-8599-58563111e73f\" (UID: \"a93dd210-5d91-437c-8599-58563111e73f\") " Jun 08 16:12:01.610033 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:01.609994 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a93dd210-5d91-437c-8599-58563111e73f-kube-api-access-twnx7" (OuterVolumeSpecName: "kube-api-access-twnx7") pod "a93dd210-5d91-437c-8599-58563111e73f" (UID: "a93dd210-5d91-437c-8599-58563111e73f"). InnerVolumeSpecName "kube-api-access-twnx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:12:01.708890 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:01.708839 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twnx7\" (UniqueName: \"kubernetes.io/projected/a93dd210-5d91-437c-8599-58563111e73f-kube-api-access-twnx7\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:12:02.143867 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:02.143838 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-djf88_test-trainjob-zhwxl-node-0-0-x2kkm_a93dd210-5d91-437c-8599-58563111e73f/node/0.log" Jun 08 16:12:02.298491 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:02.298464 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm" Jun 08 16:12:02.298650 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:02.298463 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm" event={"ID":"a93dd210-5d91-437c-8599-58563111e73f","Type":"ContainerDied","Data":"e0e2264c61333fa5bd4988b7db7b810efc5cd63e5f2215faf2e982c11ac3ca98"} Jun 08 16:12:02.298650 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:02.298583 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0e2264c61333fa5bd4988b7db7b810efc5cd63e5f2215faf2e982c11ac3ca98" Jun 08 16:12:02.596751 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:02.596723 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-djf88_test-trainjob-zhwxl-node-0-0-x2kkm_a93dd210-5d91-437c-8599-58563111e73f/node/0.log" Jun 08 16:12:02.697630 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:02.697592 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:12:04.093193 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.093159 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6577x/must-gather-2cfhf"] Jun 08 16:12:04.093584 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.093529 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a93dd210-5d91-437c-8599-58563111e73f" containerName="node" Jun 08 16:12:04.093584 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.093540 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a93dd210-5d91-437c-8599-58563111e73f" containerName="node" Jun 08 16:12:04.093658 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.093600 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a93dd210-5d91-437c-8599-58563111e73f" containerName="node" Jun 08 16:12:04.096060 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.096032 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:12:04.098910 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.098877 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6577x\"/\"openshift-service-ca.crt\"" Jun 08 16:12:04.099039 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.098934 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6577x\"/\"kube-root-ca.crt\"" Jun 08 16:12:04.100079 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.100063 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6577x\"/\"default-dockercfg-pnhnf\"" Jun 08 16:12:04.107891 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.107865 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6577x/must-gather-2cfhf"] Jun 08 16:12:04.114007 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.113982 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:12:04.131393 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.131361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d0fa833b-e40c-4a9a-9b15-c12a356a0389-must-gather-output\") pod \"must-gather-2cfhf\" (UID: \"d0fa833b-e40c-4a9a-9b15-c12a356a0389\") " pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:12:04.131393 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.131390 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzspr\" (UniqueName: \"kubernetes.io/projected/d0fa833b-e40c-4a9a-9b15-c12a356a0389-kube-api-access-wzspr\") pod \"must-gather-2cfhf\" (UID: \"d0fa833b-e40c-4a9a-9b15-c12a356a0389\") " pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:12:04.166734 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.166709 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:12:04.231873 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.231827 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d0fa833b-e40c-4a9a-9b15-c12a356a0389-must-gather-output\") pod \"must-gather-2cfhf\" (UID: \"d0fa833b-e40c-4a9a-9b15-c12a356a0389\") " pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:12:04.231873 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.231876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzspr\" (UniqueName: \"kubernetes.io/projected/d0fa833b-e40c-4a9a-9b15-c12a356a0389-kube-api-access-wzspr\") pod \"must-gather-2cfhf\" (UID: \"d0fa833b-e40c-4a9a-9b15-c12a356a0389\") " pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:12:04.232199 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.232176 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d0fa833b-e40c-4a9a-9b15-c12a356a0389-must-gather-output\") pod \"must-gather-2cfhf\" (UID: \"d0fa833b-e40c-4a9a-9b15-c12a356a0389\") " pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:12:04.240494 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.240468 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzspr\" (UniqueName: \"kubernetes.io/projected/d0fa833b-e40c-4a9a-9b15-c12a356a0389-kube-api-access-wzspr\") pod \"must-gather-2cfhf\" (UID: \"d0fa833b-e40c-4a9a-9b15-c12a356a0389\") " pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:12:04.405340 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.405219 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:12:04.529554 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:04.529504 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6577x/must-gather-2cfhf"] Jun 08 16:12:04.533197 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:12:04.533166 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0fa833b_e40c_4a9a_9b15_c12a356a0389.slice/crio-fe455d3b31ce36f9112c7caeb34dca817067967081108c3e47d9213781893eca WatchSource:0}: Error finding container fe455d3b31ce36f9112c7caeb34dca817067967081108c3e47d9213781893eca: Status 404 returned error can't find the container with id fe455d3b31ce36f9112c7caeb34dca817067967081108c3e47d9213781893eca Jun 08 16:12:05.312726 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:05.312693 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6577x/must-gather-2cfhf" event={"ID":"d0fa833b-e40c-4a9a-9b15-c12a356a0389","Type":"ContainerStarted","Data":"fe455d3b31ce36f9112c7caeb34dca817067967081108c3e47d9213781893eca"} Jun 08 16:12:07.654518 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:07.654478 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm"] Jun 08 16:12:07.660569 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:07.660528 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-djf88/test-trainjob-zhwxl-node-0-0-x2kkm"] Jun 08 16:12:08.155023 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:08.154984 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:12:08.763832 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:08.763801 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a93dd210-5d91-437c-8599-58563111e73f" path="/var/lib/kubelet/pods/a93dd210-5d91-437c-8599-58563111e73f/volumes" Jun 08 16:12:08.770289 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:08.770236 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:12:08.849496 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:08.849445 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:12:12.351102 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:12.351070 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6577x/must-gather-2cfhf" event={"ID":"d0fa833b-e40c-4a9a-9b15-c12a356a0389","Type":"ContainerStarted","Data":"03f292570d50c16aa41cb987e265d0e759f6a40d377cae668f3aefaef8ef9e3b"} Jun 08 16:12:12.351592 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:12.351112 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6577x/must-gather-2cfhf" event={"ID":"d0fa833b-e40c-4a9a-9b15-c12a356a0389","Type":"ContainerStarted","Data":"b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1"} Jun 08 16:12:12.368341 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:12.368257 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6577x/must-gather-2cfhf" podStartSLOduration=1.636369032 podStartE2EDuration="8.3682404s" totalImagesPullingTime="6.731871368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 16:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:12:12.366681344 +0000 UTC m=+574.054327583" watchObservedRunningTime="2026-06-08 16:12:12.3682404 +0000 UTC m=+574.055886635" Jun 08 16:12:38.743404 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:38.743371 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/ovn-acl-logging/0.log" Jun 08 16:12:38.745047 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:38.745027 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/ovn-acl-logging/0.log" Jun 08 16:12:59.580370 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:59.580339 2567 generic.go:356] "Generic (PLEG): container finished" podID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" containerID="b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1" exitCode=0 Jun 08 16:12:59.580778 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:59.580383 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6577x/must-gather-2cfhf" event={"ID":"d0fa833b-e40c-4a9a-9b15-c12a356a0389","Type":"ContainerDied","Data":"b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1"} Jun 08 16:12:59.580778 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:59.580687 2567 scope.go:117] "RemoveContainer" containerID="b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1" Jun 08 16:12:59.858056 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:12:59.857977 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6577x_must-gather-2cfhf_d0fa833b-e40c-4a9a-9b15-c12a356a0389/gather/0.log" Jun 08 16:13:00.231669 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:00.231630 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:13:00.374043 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:00.374011 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:13:00.476571 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:00.476537 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:13:02.889898 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:02.889869 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jtdfn_5d749a0d-b6b8-429f-a970-e1ea1b8bff6f/global-pull-secret-syncer/0.log" Jun 08 16:13:03.024615 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:03.024560 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" Jun 08 16:13:03.156601 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:03.156575 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-187.ec2.internal_9d9a7da251adaa160bd8e8117559b219/haproxy/0.log" Jun 08 16:13:05.210478 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.210446 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-6577x/must-gather-2cfhf"] Jun 08 16:13:05.210859 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.210621 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-6577x/must-gather-2cfhf" podUID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" containerName="copy" containerID="cri-o://03f292570d50c16aa41cb987e265d0e759f6a40d377cae668f3aefaef8ef9e3b" gracePeriod=2 Jun 08 16:13:05.212981 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:13:05.212944 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-2cfhf\" is forbidden: User \"system:node:ip-10-0-138-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6577x\": no relationship found between node 'ip-10-0-138-187.ec2.internal' and this object" podUID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:13:05.214705 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.214365 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-6577x/must-gather-2cfhf"] Jun 08 16:13:05.447903 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.447881 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6577x_must-gather-2cfhf_d0fa833b-e40c-4a9a-9b15-c12a356a0389/copy/0.log" Jun 08 16:13:05.449522 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.449502 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:13:05.452144 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:13:05.452121 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-2cfhf\" is forbidden: User \"system:node:ip-10-0-138-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6577x\": no relationship found between node 'ip-10-0-138-187.ec2.internal' and this object" podUID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:13:05.506192 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.506123 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d0fa833b-e40c-4a9a-9b15-c12a356a0389-must-gather-output\") pod \"d0fa833b-e40c-4a9a-9b15-c12a356a0389\" (UID: \"d0fa833b-e40c-4a9a-9b15-c12a356a0389\") " Jun 08 16:13:05.506192 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.506172 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzspr\" (UniqueName: \"kubernetes.io/projected/d0fa833b-e40c-4a9a-9b15-c12a356a0389-kube-api-access-wzspr\") pod \"d0fa833b-e40c-4a9a-9b15-c12a356a0389\" (UID: \"d0fa833b-e40c-4a9a-9b15-c12a356a0389\") " Jun 08 16:13:05.508326 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.508295 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fa833b-e40c-4a9a-9b15-c12a356a0389-kube-api-access-wzspr" (OuterVolumeSpecName: "kube-api-access-wzspr") pod "d0fa833b-e40c-4a9a-9b15-c12a356a0389" (UID: "d0fa833b-e40c-4a9a-9b15-c12a356a0389"). InnerVolumeSpecName "kube-api-access-wzspr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 16:13:05.508454 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.508428 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fa833b-e40c-4a9a-9b15-c12a356a0389-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "d0fa833b-e40c-4a9a-9b15-c12a356a0389" (UID: "d0fa833b-e40c-4a9a-9b15-c12a356a0389"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 16:13:05.606304 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.606278 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6577x_must-gather-2cfhf_d0fa833b-e40c-4a9a-9b15-c12a356a0389/copy/0.log" Jun 08 16:13:05.606647 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.606622 2567 generic.go:356] "Generic (PLEG): container finished" podID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" containerID="03f292570d50c16aa41cb987e265d0e759f6a40d377cae668f3aefaef8ef9e3b" exitCode=143 Jun 08 16:13:05.606746 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.606674 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:13:05.606746 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.606730 2567 scope.go:117] "RemoveContainer" containerID="03f292570d50c16aa41cb987e265d0e759f6a40d377cae668f3aefaef8ef9e3b" Jun 08 16:13:05.607013 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.606996 2567 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d0fa833b-e40c-4a9a-9b15-c12a356a0389-must-gather-output\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:13:05.607094 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.607065 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzspr\" (UniqueName: \"kubernetes.io/projected/d0fa833b-e40c-4a9a-9b15-c12a356a0389-kube-api-access-wzspr\") on node \"ip-10-0-138-187.ec2.internal\" DevicePath \"\"" Jun 08 16:13:05.609133 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:13:05.609106 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-2cfhf\" is forbidden: User \"system:node:ip-10-0-138-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6577x\": no relationship found between node 'ip-10-0-138-187.ec2.internal' and this object" podUID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:13:05.614929 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.614909 2567 scope.go:117] "RemoveContainer" containerID="b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1" Jun 08 16:13:05.617027 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:13:05.617004 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-2cfhf\" is forbidden: User \"system:node:ip-10-0-138-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6577x\": no relationship found between node 'ip-10-0-138-187.ec2.internal' and this object" podUID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" pod="openshift-must-gather-6577x/must-gather-2cfhf" Jun 08 16:13:05.626161 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.626143 2567 scope.go:117] "RemoveContainer" containerID="03f292570d50c16aa41cb987e265d0e759f6a40d377cae668f3aefaef8ef9e3b" Jun 08 16:13:05.626442 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:13:05.626416 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03f292570d50c16aa41cb987e265d0e759f6a40d377cae668f3aefaef8ef9e3b\": container with ID starting with 03f292570d50c16aa41cb987e265d0e759f6a40d377cae668f3aefaef8ef9e3b not found: ID does not exist" containerID="03f292570d50c16aa41cb987e265d0e759f6a40d377cae668f3aefaef8ef9e3b" Jun 08 16:13:05.626536 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.626448 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03f292570d50c16aa41cb987e265d0e759f6a40d377cae668f3aefaef8ef9e3b"} err="failed to get container status \"03f292570d50c16aa41cb987e265d0e759f6a40d377cae668f3aefaef8ef9e3b\": rpc error: code = NotFound desc = could not find container \"03f292570d50c16aa41cb987e265d0e759f6a40d377cae668f3aefaef8ef9e3b\": container with ID starting with 03f292570d50c16aa41cb987e265d0e759f6a40d377cae668f3aefaef8ef9e3b not found: ID does not exist" Jun 08 16:13:05.626536 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.626464 2567 scope.go:117] "RemoveContainer" containerID="b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1" Jun 08 16:13:05.626744 ip-10-0-138-187 kubenswrapper[2567]: E0608 16:13:05.626726 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1\": container with ID starting with b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1 not found: ID does not exist" containerID="b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1" Jun 08 16:13:05.626796 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.626752 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1"} err="failed to get container status \"b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1\": rpc error: code = NotFound desc = could not find container \"b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1\": container with ID starting with b7f41adc4c155a5e05e06b631b056434afd91a86281773f9ec49986117aad3c1 not found: ID does not exist" Jun 08 16:13:05.779488 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.779414 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:13:05.841745 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:05.841719 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:13:06.529564 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.529537 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df5e6b3-dd90-4b22-9741-0f9d70329ac8/alertmanager/0.log" Jun 08 16:13:06.554837 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.554796 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df5e6b3-dd90-4b22-9741-0f9d70329ac8/config-reloader/0.log" Jun 08 16:13:06.581313 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.581285 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df5e6b3-dd90-4b22-9741-0f9d70329ac8/kube-rbac-proxy-web/0.log" Jun 08 16:13:06.610713 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.610691 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df5e6b3-dd90-4b22-9741-0f9d70329ac8/kube-rbac-proxy/0.log" Jun 08 16:13:06.642202 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.642177 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df5e6b3-dd90-4b22-9741-0f9d70329ac8/kube-rbac-proxy-metric/0.log" Jun 08 16:13:06.679554 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.679534 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df5e6b3-dd90-4b22-9741-0f9d70329ac8/prom-label-proxy/0.log" Jun 08 16:13:06.705021 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.704974 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2df5e6b3-dd90-4b22-9741-0f9d70329ac8/init-config-reloader/0.log" Jun 08 16:13:06.761753 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.761723 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" path="/var/lib/kubelet/pods/d0fa833b-e40c-4a9a-9b15-c12a356a0389/volumes" Jun 08 16:13:06.773733 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.773708 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-9wgrz_7121dcf0-771f-42fe-9fc7-5b6d0265581d/kube-state-metrics/0.log" Jun 08 16:13:06.801530 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.801450 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-9wgrz_7121dcf0-771f-42fe-9fc7-5b6d0265581d/kube-rbac-proxy-main/0.log" Jun 08 16:13:06.834116 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.834094 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-9wgrz_7121dcf0-771f-42fe-9fc7-5b6d0265581d/kube-rbac-proxy-self/0.log" Jun 08 16:13:06.875810 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.875790 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7cfffff594-x98sv_1a5f7eb9-87d2-4650-a922-66f5bae46a59/metrics-server/0.log" Jun 08 16:13:06.921553 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:06.921532 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-wwg45_90cc21de-7d86-4cdc-8de4-3dcdbdfd7e08/monitoring-plugin/0.log" Jun 08 16:13:07.061275 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.061191 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p79cr_46abebef-8e71-4f0b-a6dd-689ad0177dec/node-exporter/0.log" Jun 08 16:13:07.086746 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.086726 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p79cr_46abebef-8e71-4f0b-a6dd-689ad0177dec/kube-rbac-proxy/0.log" Jun 08 16:13:07.111404 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.111387 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p79cr_46abebef-8e71-4f0b-a6dd-689ad0177dec/init-textfile/0.log" Jun 08 16:13:07.228419 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.228392 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-vkmtk_bbf50c4c-9086-495a-bf4d-da284db46409/kube-rbac-proxy-main/0.log" Jun 08 16:13:07.253374 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.253350 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-vkmtk_bbf50c4c-9086-495a-bf4d-da284db46409/kube-rbac-proxy-self/0.log" Jun 08 16:13:07.278994 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.278968 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-vkmtk_bbf50c4c-9086-495a-bf4d-da284db46409/openshift-state-metrics/0.log" Jun 08 16:13:07.322665 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.322580 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fcee106-369e-4fdc-8502-96b1d19161ea/prometheus/0.log" Jun 08 16:13:07.371177 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.371157 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fcee106-369e-4fdc-8502-96b1d19161ea/config-reloader/0.log" Jun 08 16:13:07.442248 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.442225 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fcee106-369e-4fdc-8502-96b1d19161ea/thanos-sidecar/0.log" Jun 08 16:13:07.490319 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.490285 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fcee106-369e-4fdc-8502-96b1d19161ea/kube-rbac-proxy-web/0.log" Jun 08 16:13:07.537083 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.537059 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fcee106-369e-4fdc-8502-96b1d19161ea/kube-rbac-proxy/0.log" Jun 08 16:13:07.586117 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.586052 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fcee106-369e-4fdc-8502-96b1d19161ea/kube-rbac-proxy-thanos/0.log" Jun 08 16:13:07.635048 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.635026 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fcee106-369e-4fdc-8502-96b1d19161ea/init-config-reloader/0.log" Jun 08 16:13:07.696967 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.696943 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-q88xh_4283851c-10eb-4881-8e55-ad00d79c0e3d/prometheus-operator/0.log" Jun 08 16:13:07.762058 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.762031 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-q88xh_4283851c-10eb-4881-8e55-ad00d79c0e3d/kube-rbac-proxy/0.log" Jun 08 16:13:07.847194 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.847126 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-8k25d_c328b617-d701-4358-b7dd-e3b9dd10461f/prometheus-operator-admission-webhook/0.log" Jun 08 16:13:07.919141 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.919112 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bdc4579dd-h8dh8_59ab6ff4-228c-4d73-8642-597655f3ca2a/telemeter-client/0.log" Jun 08 16:13:07.969008 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:07.968986 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bdc4579dd-h8dh8_59ab6ff4-228c-4d73-8642-597655f3ca2a/reload/0.log" Jun 08 16:13:08.017200 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:08.017176 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bdc4579dd-h8dh8_59ab6ff4-228c-4d73-8642-597655f3ca2a/kube-rbac-proxy/0.log" Jun 08 16:13:08.071495 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:08.071464 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-757f97d5cd-xnq44_44d2006a-2d2a-43c1-8ddc-2a7ad441accf/thanos-query/0.log" Jun 08 16:13:08.117140 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:08.117074 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-757f97d5cd-xnq44_44d2006a-2d2a-43c1-8ddc-2a7ad441accf/kube-rbac-proxy-web/0.log" Jun 08 16:13:08.148283 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:08.148225 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:13:08.160107 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:08.160089 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-757f97d5cd-xnq44_44d2006a-2d2a-43c1-8ddc-2a7ad441accf/kube-rbac-proxy/0.log" Jun 08 16:13:08.206081 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:08.206056 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-757f97d5cd-xnq44_44d2006a-2d2a-43c1-8ddc-2a7ad441accf/prom-label-proxy/0.log" Jun 08 16:13:08.206215 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:08.206197 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mmd6_5ef00d38-4d8f-457c-aadd-720dbc72d8c2/konnectivity-agent/0.log" limit=1024 Jun 08 16:13:08.262098 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:08.262069 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-757f97d5cd-xnq44_44d2006a-2d2a-43c1-8ddc-2a7ad441accf/kube-rbac-proxy-rules/0.log" Jun 08 16:13:08.314128 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:08.314104 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-757f97d5cd-xnq44_44d2006a-2d2a-43c1-8ddc-2a7ad441accf/kube-rbac-proxy-metrics/0.log" Jun 08 16:13:10.378126 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.378090 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f"] Jun 08 16:13:10.378835 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.378809 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" containerName="gather" Jun 08 16:13:10.378835 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.378835 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" containerName="gather" Jun 08 16:13:10.379059 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.378874 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" containerName="copy" Jun 08 16:13:10.379059 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.378883 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" containerName="copy" Jun 08 16:13:10.379059 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.379048 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" containerName="gather" Jun 08 16:13:10.379222 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.379067 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0fa833b-e40c-4a9a-9b15-c12a356a0389" containerName="copy" Jun 08 16:13:10.383673 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.383647 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.387643 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.387620 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4wnkl\"/\"kube-root-ca.crt\"" Jun 08 16:13:10.387859 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.387761 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4wnkl\"/\"openshift-service-ca.crt\"" Jun 08 16:13:10.388606 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.388585 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4wnkl\"/\"default-dockercfg-7smts\"" Jun 08 16:13:10.389441 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.389416 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f"] Jun 08 16:13:10.450386 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.450359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-proc\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.450536 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.450400 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-podres\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.450536 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.450447 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-sys\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.450536 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.450496 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmdg2\" (UniqueName: \"kubernetes.io/projected/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-kube-api-access-jmdg2\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.450653 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.450547 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-lib-modules\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.551759 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.551728 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmdg2\" (UniqueName: \"kubernetes.io/projected/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-kube-api-access-jmdg2\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.551895 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.551764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-lib-modules\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.551895 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.551797 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-proc\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.551895 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.551822 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-podres\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.551895 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.551860 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-sys\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.552041 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.551922 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-proc\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.552041 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.551921 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-lib-modules\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.552041 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.551949 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-sys\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.552041 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.551988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-podres\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.559670 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.559647 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmdg2\" (UniqueName: \"kubernetes.io/projected/6fdc4f74-833f-4a5b-b13b-030fdb8f5e81-kube-api-access-jmdg2\") pod \"perf-node-gather-daemonset-bzm9f\" (UID: \"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81\") " pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.694599 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.694578 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:10.820060 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:10.820038 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f"] Jun 08 16:13:10.822456 ip-10-0-138-187 kubenswrapper[2567]: W0608 16:13:10.822426 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6fdc4f74_833f_4a5b_b13b_030fdb8f5e81.slice/crio-de47817d099244dbe9eb5bdccf38bfe90c145c73d8c1460904c8b2a67c59e847 WatchSource:0}: Error finding container de47817d099244dbe9eb5bdccf38bfe90c145c73d8c1460904c8b2a67c59e847: Status 404 returned error can't find the container with id de47817d099244dbe9eb5bdccf38bfe90c145c73d8c1460904c8b2a67c59e847 Jun 08 16:13:11.633901 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:11.633863 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" event={"ID":"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81","Type":"ContainerStarted","Data":"ab32ab858fb049e4dfccced3e9a5041f4afaaecf8791f9f0135d5e1964737b06"} Jun 08 16:13:11.634312 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:11.633926 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" event={"ID":"6fdc4f74-833f-4a5b-b13b-030fdb8f5e81","Type":"ContainerStarted","Data":"de47817d099244dbe9eb5bdccf38bfe90c145c73d8c1460904c8b2a67c59e847"} Jun 08 16:13:11.634312 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:11.633987 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:11.650557 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:11.650513 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" podStartSLOduration=1.65049785 podStartE2EDuration="1.65049785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 16:13:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 16:13:11.648921776 +0000 UTC m=+633.336568027" watchObservedRunningTime="2026-06-08 16:13:11.65049785 +0000 UTC m=+633.338144086" Jun 08 16:13:11.694560 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:11.694538 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6tzdp_e783704c-5050-482f-b2fe-7757fafdde0f/dns/0.log" Jun 08 16:13:11.718128 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:11.718103 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6tzdp_e783704c-5050-482f-b2fe-7757fafdde0f/kube-rbac-proxy/0.log" Jun 08 16:13:11.869159 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:11.869130 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kr566_e961beec-d71c-4045-9141-cf0114549316/dns-node-resolver/0.log" Jun 08 16:13:12.334798 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:12.334771 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qzhm8_97a38f50-42ab-4195-a445-e65e696a54a2/node-ca/0.log" Jun 08 16:13:13.453774 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:13.453751 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t5qtp_ff74e2ca-4f18-464a-87e0-268afb2a34be/serve-healthcheck-canary/0.log" Jun 08 16:13:13.847526 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:13.847438 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2h6k8_cd4839c2-6dbd-4078-ac0c-5135146c93e9/kube-rbac-proxy/0.log" Jun 08 16:13:13.871148 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:13.871124 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2h6k8_cd4839c2-6dbd-4078-ac0c-5135146c93e9/exporter/0.log" Jun 08 16:13:13.894372 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:13.894340 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2h6k8_cd4839c2-6dbd-4078-ac0c-5135146c93e9/extractor/0.log" Jun 08 16:13:17.648360 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:17.648333 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4wnkl/perf-node-gather-daemonset-bzm9f" Jun 08 16:13:20.012758 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:20.012731 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jg2qf_7bb13c11-b1d3-4936-9ad2-9b594fe91a0b/kube-multus-additional-cni-plugins/0.log" Jun 08 16:13:20.037161 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:20.037132 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jg2qf_7bb13c11-b1d3-4936-9ad2-9b594fe91a0b/egress-router-binary-copy/0.log" Jun 08 16:13:20.062941 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:20.062919 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jg2qf_7bb13c11-b1d3-4936-9ad2-9b594fe91a0b/cni-plugins/0.log" Jun 08 16:13:20.089303 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:20.089208 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jg2qf_7bb13c11-b1d3-4936-9ad2-9b594fe91a0b/bond-cni-plugin/0.log" Jun 08 16:13:20.115607 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:20.115580 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jg2qf_7bb13c11-b1d3-4936-9ad2-9b594fe91a0b/routeoverride-cni/0.log" Jun 08 16:13:20.139185 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:20.139151 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jg2qf_7bb13c11-b1d3-4936-9ad2-9b594fe91a0b/whereabouts-cni-bincopy/0.log" Jun 08 16:13:20.161981 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:20.161951 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jg2qf_7bb13c11-b1d3-4936-9ad2-9b594fe91a0b/whereabouts-cni/0.log" Jun 08 16:13:20.372681 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:20.372617 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jlznc_47016bc9-ac6f-4c3e-aae7-4a825aa959f0/kube-multus/0.log" Jun 08 16:13:20.507532 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:20.507500 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ps27h_b1df1dda-f1d7-4d55-afad-f80e3256cf0f/network-metrics-daemon/0.log" Jun 08 16:13:20.531012 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:20.530985 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ps27h_b1df1dda-f1d7-4d55-afad-f80e3256cf0f/kube-rbac-proxy/0.log" Jun 08 16:13:21.850167 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:21.850138 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/ovn-controller/0.log" Jun 08 16:13:21.873122 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:21.873100 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/ovn-acl-logging/0.log" Jun 08 16:13:21.873122 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:21.873122 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/ovn-acl-logging/1.log" Jun 08 16:13:21.894604 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:21.894583 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/kube-rbac-proxy-node/0.log" Jun 08 16:13:21.916931 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:21.916909 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/kube-rbac-proxy-ovn-metrics/0.log" Jun 08 16:13:21.942115 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:21.942095 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/northd/0.log" Jun 08 16:13:21.963585 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:21.963560 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/nbdb/0.log" Jun 08 16:13:21.985483 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:21.985465 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/sbdb/0.log" Jun 08 16:13:22.025397 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:22.025364 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqj2d_dcc3c005-3b85-4892-a0af-bfb57b816951/ovnkube-controller/0.log" Jun 08 16:13:23.093105 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:23.093077 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dmr5k_3c774e0b-5f8d-48a1-9d0e-2f7671a7c3e4/network-check-target-container/0.log" Jun 08 16:13:23.980377 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:23.980351 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-mwpwg_3fc1d906-60d3-4e77-b11d-f353e39348ef/iptables-alerter/0.log" Jun 08 16:13:24.656544 ip-10-0-138-187 kubenswrapper[2567]: I0608 16:13:24.656517 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-rq462_b5e10afe-54a1-42cd-9ad3-bce820a97e56/tuned/0.log"