Jun 09 15:54:48.437790 ip-10-0-129-90 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 15:54:48.437800 ip-10-0-129-90 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 15:54:48.437809 ip-10-0-129-90 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 15:54:48.437964 ip-10-0-129-90 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 15:54:58.674721 ip-10-0-129-90 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 15:54:58.674741 ip-10-0-129-90 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0812c52c921746b387ed136492b8f58b -- Jun 09 15:57:46.104217 ip-10-0-129-90 systemd[1]: Starting Kubernetes Kubelet... Jun 09 15:57:46.556996 ip-10-0-129-90 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:57:46.556996 ip-10-0-129-90 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 15:57:46.556996 ip-10-0-129-90 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:57:46.556996 ip-10-0-129-90 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 15:57:46.556996 ip-10-0-129-90 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:57:46.557740 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.557087 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 15:57:46.563443 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563410 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:57:46.563443 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563437 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:57:46.563443 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563441 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:57:46.563443 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563445 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563448 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563451 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563454 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563457 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563477 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563480 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563482 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563485 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563488 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563490 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563493 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563497 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563500 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563502 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563505 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563508 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563511 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563513 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563516 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:57:46.563577 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563518 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563521 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563523 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563526 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563529 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563531 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563535 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563539 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563543 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563547 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563551 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563555 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563558 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563560 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563564 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563567 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563570 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563573 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:57:46.564125 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563577 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563580 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563583 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563585 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563588 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563591 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563593 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563596 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563599 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563601 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563605 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563608 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563610 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563613 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563615 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563618 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563621 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563623 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563626 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563628 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:57:46.564592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563632 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563635 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563638 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563640 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563643 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563646 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563648 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563651 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563655 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563657 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563660 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563663 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563665 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563670 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563673 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563675 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563678 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563681 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563685 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563689 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:57:46.565306 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563691 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563694 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563696 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563699 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563701 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563704 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563706 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563709 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563712 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563714 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563717 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563720 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563723 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563725 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563728 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563730 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563733 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:57:46.566150 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.563736 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566281 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566302 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566308 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566314 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566318 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566332 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566337 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566342 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566347 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566352 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566357 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566361 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566365 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566370 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566375 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566379 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566383 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566388 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566392 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:57:46.566987 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566396 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566401 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566405 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566409 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566422 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566428 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566432 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566436 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566441 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566445 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566449 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566454 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566458 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566462 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566468 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566473 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566478 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566482 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566487 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566491 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:57:46.567824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566495 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566499 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566506 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566510 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566515 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566520 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566524 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566528 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566532 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566536 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566541 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566546 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566551 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566558 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566564 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566568 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566573 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566577 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566581 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566586 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:57:46.568722 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566590 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566596 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566602 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566607 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566611 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566615 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566621 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566626 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566630 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566634 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566638 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566642 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566647 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566651 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566655 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566659 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566664 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566668 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566673 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:57:46.569648 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566678 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566682 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566686 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566693 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566697 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566702 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566708 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566715 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566721 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566726 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566730 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566735 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566739 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566744 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566748 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566752 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566756 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566760 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566763 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:57:46.570156 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566769 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.566773 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567458 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567468 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567472 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567478 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567482 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567487 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567492 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567496 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567501 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567505 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567512 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567519 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567524 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567529 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567534 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567540 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567546 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:57:46.570725 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567550 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567555 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567560 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567564 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567569 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567573 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567578 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567582 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567587 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567591 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567595 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567600 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567604 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567609 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567613 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567618 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567622 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567627 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567631 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:57:46.571339 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567644 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567651 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567656 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567662 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567667 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567672 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567676 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567680 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567685 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567689 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567694 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567698 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567702 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567707 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567712 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567717 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567721 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567725 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567729 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567733 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:57:46.571945 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567738 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567742 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567746 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567751 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567755 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567759 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567764 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567768 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567772 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567776 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567780 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567785 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567789 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567795 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567799 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567803 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567807 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567811 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567815 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567819 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:57:46.572440 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567823 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567827 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567831 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567835 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567839 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567843 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567847 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567852 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567856 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567860 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567886 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567892 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567897 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567901 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567906 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567910 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567914 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567918 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567923 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567927 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:57:46.573054 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567931 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567936 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.567940 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568047 2552 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568059 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568068 2552 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568076 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568083 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568088 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568095 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568102 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568107 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568112 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568117 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568123 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568128 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568133 2552 flags.go:64] FLAG: --cgroup-root="" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568137 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568142 2552 flags.go:64] FLAG: --client-ca-file="" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568148 2552 flags.go:64] FLAG: --cloud-provider="external" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568153 2552 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568161 2552 flags.go:64] FLAG: --cluster-domain="" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568166 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568171 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 15:57:46.573543 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568176 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568182 2552 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568189 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568194 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568198 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568204 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568214 2552 flags.go:64] FLAG: --contention-profiling="false" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568219 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568224 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568230 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568235 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568241 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568246 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568251 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568256 2552 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568261 2552 flags.go:64] FLAG: --enable-server="true" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568266 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568273 2552 flags.go:64] FLAG: --event-burst="100" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568278 2552 flags.go:64] FLAG: --event-qps="50" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568282 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568287 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568292 2552 flags.go:64] FLAG: --eviction-hard="" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568299 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568304 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568310 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 15:57:46.574170 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568315 2552 flags.go:64] FLAG: --eviction-soft="" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568320 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568325 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568330 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568335 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568340 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568345 2552 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568350 2552 flags.go:64] FLAG: --feature-gates="" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568356 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568361 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568367 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568372 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568376 2552 flags.go:64] FLAG: --healthz-port="10248" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568384 2552 flags.go:64] FLAG: --help="false" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568389 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568394 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568399 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568404 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568409 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568415 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568420 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568425 2552 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568430 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 15:57:46.574780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568434 2552 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568439 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568444 2552 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568449 2552 flags.go:64] FLAG: --kube-reserved="" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568454 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568458 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568463 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568468 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568472 2552 flags.go:64] FLAG: --lock-file="" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568477 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568482 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568487 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568496 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568501 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568506 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568511 2552 flags.go:64] FLAG: --logging-format="text" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568516 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568522 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568527 2552 flags.go:64] FLAG: --manifest-url="" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568532 2552 flags.go:64] FLAG: --manifest-url-header="" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568539 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568544 2552 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568552 2552 flags.go:64] FLAG: --max-pods="110" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568566 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568572 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 15:57:46.575387 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568577 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568581 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568586 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568591 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568596 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568609 2552 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568614 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568619 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568623 2552 flags.go:64] FLAG: --pod-cidr="" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568628 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568638 2552 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568643 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568648 2552 flags.go:64] FLAG: --pods-per-core="0" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568653 2552 flags.go:64] FLAG: --port="10250" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568657 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568662 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fc79a7bdf6adb1c7" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568668 2552 flags.go:64] FLAG: --qos-reserved="" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568672 2552 flags.go:64] FLAG: --read-only-port="10255" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568677 2552 flags.go:64] FLAG: --register-node="true" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568682 2552 flags.go:64] FLAG: --register-with-taints="" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568695 2552 flags.go:64] FLAG: --registry-burst="10" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568701 2552 flags.go:64] FLAG: --registry-qps="5" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568706 2552 flags.go:64] FLAG: --reserved-cpus="" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568715 2552 flags.go:64] FLAG: --reserved-memory="" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568721 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 15:57:46.576113 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568726 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568731 2552 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568735 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568740 2552 flags.go:64] FLAG: --runonce="false" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568746 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568751 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568756 2552 flags.go:64] FLAG: --seccomp-default="false" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568761 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568766 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568771 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568776 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568781 2552 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568786 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568791 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568795 2552 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568800 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568806 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568811 2552 flags.go:64] FLAG: --system-cgroups="" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568815 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568824 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568829 2552 flags.go:64] FLAG: --tls-cert-file="" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568835 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568844 2552 flags.go:64] FLAG: --tls-min-version="" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568848 2552 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568853 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 15:57:46.576755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568859 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568879 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568884 2552 flags.go:64] FLAG: --v="2" Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568891 2552 flags.go:64] FLAG: --version="false" Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568898 2552 flags.go:64] FLAG: --vmodule="" Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568906 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.568912 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569141 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569149 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569155 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569160 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569167 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569172 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569177 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569181 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569186 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569191 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569196 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569200 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569204 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569208 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:57:46.577405 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569213 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569217 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569222 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569226 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569231 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569235 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569239 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569244 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569248 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569252 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569257 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569261 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569265 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569270 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569274 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569278 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569285 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569290 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569295 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569299 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:57:46.577936 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569303 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569307 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569314 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569321 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569326 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569330 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569335 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569340 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569344 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569349 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569353 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569357 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569361 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569366 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569370 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569375 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569379 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569384 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569388 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569392 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:57:46.578435 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569397 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569401 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569407 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569411 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569416 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569420 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569424 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569428 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569434 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569439 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569444 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569448 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569452 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569456 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569462 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569466 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569471 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569475 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569480 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569484 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:57:46.578975 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569489 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569493 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569498 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569502 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569508 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569513 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569517 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569522 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569526 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569530 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569535 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569539 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569544 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569548 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569553 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569557 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569561 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569565 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569571 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:57:46.579470 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569577 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569583 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569588 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569594 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569599 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.569605 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.570335 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.577490 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.577515 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.577537 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.577546 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577614 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577620 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577623 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:57:46.579993 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577626 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577629 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577632 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577637 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577642 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577646 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577650 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577654 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577657 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577660 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577664 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577667 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577669 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577672 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577675 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577677 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577680 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577683 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577685 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:57:46.580355 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577688 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577690 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577693 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577696 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577699 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577702 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577705 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577709 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577712 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577714 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577717 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577720 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577722 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577725 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577727 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577730 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577733 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577737 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577739 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577742 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:57:46.580824 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577745 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577748 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577750 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577753 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577756 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577759 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577761 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577764 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577767 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577769 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577772 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577775 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577777 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577779 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577784 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577788 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577791 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577794 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577796 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:57:46.581342 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577799 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577803 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577806 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577809 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577811 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577814 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577816 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577819 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577821 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577824 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577827 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577829 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577832 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577835 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577837 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577840 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577843 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577845 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577848 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577851 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:57:46.581814 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577853 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577856 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577858 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577861 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577879 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577882 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577886 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577889 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577892 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577894 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577897 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577900 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577902 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577905 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577909 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577912 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577914 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:57:46.582309 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.577917 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.577922 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578046 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578050 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578054 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578057 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578060 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578063 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578066 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578069 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578071 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578074 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578076 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578079 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578082 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:57:46.582733 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578084 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578087 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578089 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578092 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578095 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578097 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578101 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578105 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578108 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578112 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578115 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578118 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578121 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578124 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578127 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578130 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578133 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578136 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578138 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578141 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:57:46.583261 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578144 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578148 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578150 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578153 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578156 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578159 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578162 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578164 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578167 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578169 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578172 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578175 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578178 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578181 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578183 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578186 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578189 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578191 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578194 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578197 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:57:46.583745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578199 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578202 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578205 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578208 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578210 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578213 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578215 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578218 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578221 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578224 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578227 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578230 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578232 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578235 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578238 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578240 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578243 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578245 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578248 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578250 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:57:46.584246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578253 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578255 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578258 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578260 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578264 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578268 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578270 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578273 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578276 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578278 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578281 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578284 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578287 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578289 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578292 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578294 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578297 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578300 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578302 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578306 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:57:46.584745 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578309 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:57:46.585246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578312 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:57:46.585246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578315 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:57:46.585246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578317 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:57:46.585246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578320 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:57:46.585246 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:46.578322 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:57:46.585246 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.578334 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:57:46.585246 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.578474 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 15:57:46.585246 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.580625 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 15:57:46.585246 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.582161 2552 server.go:1019] "Starting client certificate rotation" Jun 09 15:57:46.585246 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.582262 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:57:46.585246 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.582297 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:57:46.585246 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.585101 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:57:46.586648 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.586615 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:57:46.602497 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.602465 2552 log.go:25] "Validated CRI v1 runtime API" Jun 09 15:57:46.605474 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.605452 2552 log.go:25] "Validated CRI v1 image API" Jun 09 15:57:46.606362 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.606343 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 15:57:46.609735 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.609709 2552 fs.go:135] Filesystem UUIDs: map[13dae8e5-7910-4b5a-96fb-b6bd5e8efa30:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b1077a8b-fa27-4ac4-8cc6-444b47b7a123:/dev/nvme0n1p3] Jun 09 15:57:46.609812 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.609733 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 15:57:46.615420 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.615296 2552 manager.go:216] Machine: {Timestamp:2026-06-09 15:57:46.61373765 +0000 UTC m=+0.376109161 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103987 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec210111f64fa60096bdae8fc90aa7a2 SystemUUID:ec210111-f64f-a600-96bd-ae8fc90aa7a2 BootID:0812c52c-9217-46b3-87ed-136492b8f58b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2a:df:40:50:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2a:df:40:50:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:28:fe:81:a3:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 15:57:46.615420 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.615414 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 15:57:46.615536 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.615516 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 15:57:46.616682 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.616663 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:57:46.619007 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.618978 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 15:57:46.619160 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.619013 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 15:57:46.619835 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.619824 2552 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 15:57:46.619885 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.619839 2552 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 15:57:46.619885 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.619847 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:57:46.619885 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.619859 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:57:46.620764 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.620753 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 15:57:46.624106 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.624094 2552 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:57:46.624237 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.624227 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 15:57:46.624273 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.624269 2552 kubelet.go:486] "Attempting to sync node with API server" Jun 09 15:57:46.624303 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.624288 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 15:57:46.624331 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.624303 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 15:57:46.624331 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.624314 2552 kubelet.go:398] "Adding apiserver pod source" Jun 09 15:57:46.624398 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.624332 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 15:57:46.625183 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.625163 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:57:46.625279 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.625184 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:57:46.627968 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.627939 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 15:57:46.629598 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.629581 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 15:57:46.629649 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.629615 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 15:57:46.630672 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.630659 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 15:57:46.630715 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.630677 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 15:57:46.630715 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.630683 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 15:57:46.630715 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.630692 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 15:57:46.630715 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.630705 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 15:57:46.630715 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.630711 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 15:57:46.630843 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.630719 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 15:57:46.630843 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.630724 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 15:57:46.630843 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.630731 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 15:57:46.630843 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.630737 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 15:57:46.630843 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.630745 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 15:57:46.630843 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.630750 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 15:57:46.631830 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.631804 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 15:57:46.631912 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.631830 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 15:57:46.633579 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.633547 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 15:57:46.633780 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.633723 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 15:57:46.633916 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.633799 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-90.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 15:57:46.634916 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.634896 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ll2vv" Jun 09 15:57:46.636130 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.636111 2552 server.go:1268] "Started kubelet" Jun 09 15:57:46.636234 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.636177 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 15:57:46.636293 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.636249 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 15:57:46.636343 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.636309 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 15:57:46.637101 ip-10-0-129-90 systemd[1]: Started Kubernetes Kubelet. Jun 09 15:57:46.638358 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.638339 2552 server.go:310] "Adding debug handlers to kubelet server" Jun 09 15:57:46.638477 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.638463 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 15:57:46.642143 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.642126 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ll2vv" Jun 09 15:57:46.642418 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.641378 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-90.ec2.internal.18b774dc2c790de8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-90.ec2.internal,UID:ip-10-0-129-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-90.ec2.internal,},FirstTimestamp:2026-06-09 15:57:46.636078568 +0000 UTC m=+0.398450078,LastTimestamp:2026-06-09 15:57:46.636078568 +0000 UTC m=+0.398450078,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-90.ec2.internal,}" Jun 09 15:57:46.643735 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.643719 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 15:57:46.645997 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.645980 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 15:57:46.645997 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.645988 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 15:57:46.646116 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.646056 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-90.ec2.internal\" not found" Jun 09 15:57:46.646685 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.646632 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 15:57:46.646685 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.646682 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 15:57:46.646839 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.646697 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 15:57:46.646916 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.646850 2552 reconstruct.go:97] "Volume reconstruction finished" Jun 09 15:57:46.646916 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.646860 2552 reconciler.go:29] "Reconciler: start to sync state" Jun 09 15:57:46.646916 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.646901 2552 factory.go:55] Registering systemd factory Jun 09 15:57:46.647035 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.646938 2552 factory.go:223] Registration of the systemd container factory successfully Jun 09 15:57:46.647219 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.647204 2552 factory.go:153] Registering CRI-O factory Jun 09 15:57:46.647279 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.647223 2552 factory.go:223] Registration of the crio container factory successfully Jun 09 15:57:46.647279 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.647275 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 15:57:46.647350 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.647296 2552 factory.go:103] Registering Raw factory Jun 09 15:57:46.647350 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.647313 2552 manager.go:1196] Started watching for new ooms in manager Jun 09 15:57:46.647986 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.647972 2552 manager.go:349] Starting recovery of all containers Jun 09 15:57:46.655695 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.655515 2552 manager.go:354] Recovery completed Jun 09 15:57:46.658476 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.658456 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:57:46.661658 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.661634 2552 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-90.ec2.internal\" not found" node="ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.663048 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.662973 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:57:46.665187 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.665166 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:57:46.665264 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.665205 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:57:46.665264 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.665217 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:57:46.665785 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.665770 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 15:57:46.665785 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.665780 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:57:46.665861 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.665784 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 15:57:46.665861 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.665805 2552 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:57:46.666535 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.666520 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:57:46.666594 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.666549 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:57:46.666594 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.666563 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:57:46.667093 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.667080 2552 policy_none.go:49] "None policy: Start" Jun 09 15:57:46.667125 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.667097 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 15:57:46.667125 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.667108 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 15:57:46.668223 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.668211 2552 policy_none.go:47] "Start" Jun 09 15:57:46.702617 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.702585 2552 manager.go:337] "Starting Device Plugin manager" Jun 09 15:57:46.702763 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.702629 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 15:57:46.702763 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.702642 2552 server.go:87] "Starting device plugin registration server" Jun 09 15:57:46.703002 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.702986 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 15:57:46.703072 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.703007 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 15:57:46.703186 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.703161 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 15:57:46.703290 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.703274 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 15:57:46.703290 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.703283 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 15:57:46.704064 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.703916 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 15:57:46.704064 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.703972 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-90.ec2.internal\" not found" Jun 09 15:57:46.719922 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.718809 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 15:57:46.720075 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.720007 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 15:57:46.720075 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.720047 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 15:57:46.720075 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.720073 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 15:57:46.720240 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.720109 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 15:57:46.722802 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.722778 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:57:46.803406 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.803360 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:57:46.804455 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.804437 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:57:46.804601 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.804467 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:57:46.804601 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.804477 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:57:46.804601 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.804502 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.811846 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.811780 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.811846 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.811808 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-90.ec2.internal\": node \"ip-10-0-129-90.ec2.internal\" not found" Jun 09 15:57:46.820586 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.820541 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-90.ec2.internal"] Jun 09 15:57:46.820683 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.820645 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:57:46.822140 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.822122 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:57:46.822245 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.822157 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:57:46.822245 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.822173 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:57:46.823467 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.823449 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:57:46.823582 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.823564 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.823635 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.823595 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:57:46.824229 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.824213 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:57:46.824314 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.824243 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:57:46.824314 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.824254 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:57:46.824314 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.824213 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:57:46.824314 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.824308 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:57:46.824455 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.824320 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:57:46.825555 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.825538 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.825599 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.825574 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:57:46.826336 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.826320 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:57:46.826397 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.826352 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:57:46.826397 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.826366 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:57:46.829420 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.829403 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-90.ec2.internal\" not found" Jun 09 15:57:46.839593 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.839568 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-90.ec2.internal\" not found" node="ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.843464 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.843448 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-90.ec2.internal\" not found" node="ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.847627 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.847606 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7ff145d601f4218d51d2ab742f579b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal\" (UID: \"b7ff145d601f4218d51d2ab742f579b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.847698 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.847636 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7ff145d601f4218d51d2ab742f579b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal\" (UID: \"b7ff145d601f4218d51d2ab742f579b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.847698 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.847656 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9f0f8ac9348fb900d92b838474a523e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-90.ec2.internal\" (UID: \"b9f0f8ac9348fb900d92b838474a523e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.929817 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:46.929783 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-90.ec2.internal\" not found" Jun 09 15:57:46.948495 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.948459 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7ff145d601f4218d51d2ab742f579b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal\" (UID: \"b7ff145d601f4218d51d2ab742f579b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.948561 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.948502 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9f0f8ac9348fb900d92b838474a523e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-90.ec2.internal\" (UID: \"b9f0f8ac9348fb900d92b838474a523e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.948561 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.948524 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7ff145d601f4218d51d2ab742f579b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal\" (UID: \"b7ff145d601f4218d51d2ab742f579b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.948627 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.948571 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7ff145d601f4218d51d2ab742f579b3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal\" (UID: \"b7ff145d601f4218d51d2ab742f579b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.948627 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.948588 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9f0f8ac9348fb900d92b838474a523e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-90.ec2.internal\" (UID: \"b9f0f8ac9348fb900d92b838474a523e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-90.ec2.internal" Jun 09 15:57:46.948687 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:46.948576 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b7ff145d601f4218d51d2ab742f579b3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal\" (UID: \"b7ff145d601f4218d51d2ab742f579b3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" Jun 09 15:57:47.030797 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.030763 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-90.ec2.internal\" not found" Jun 09 15:57:47.131618 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.131524 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-90.ec2.internal\" not found" Jun 09 15:57:47.143723 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.143694 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" Jun 09 15:57:47.147913 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.147651 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-90.ec2.internal" Jun 09 15:57:47.231667 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.231631 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-90.ec2.internal\" not found" Jun 09 15:57:47.332200 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.332157 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-90.ec2.internal\" not found" Jun 09 15:57:47.432680 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.432648 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-90.ec2.internal\" not found" Jun 09 15:57:47.453754 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.453725 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:57:47.547188 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.547152 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-90.ec2.internal" Jun 09 15:57:47.557958 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.557923 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:57:47.559880 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.559845 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" Jun 09 15:57:47.569494 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.569464 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:57:47.574716 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.574686 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:57:47.582093 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.582062 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 15:57:47.582283 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.582252 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:57:47.582283 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.582267 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:57:47.582437 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.582263 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:57:47.582437 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.582263 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:57:47.625596 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.625424 2552 apiserver.go:52] "Watching apiserver" Jun 09 15:57:47.637592 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:47.637553 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ff145d601f4218d51d2ab742f579b3.slice/crio-cc5fd6c79e698d4bb2ff6366da60383392a165fe8346eb212e1d8fa71261d199 WatchSource:0}: Error finding container cc5fd6c79e698d4bb2ff6366da60383392a165fe8346eb212e1d8fa71261d199: Status 404 returned error can't find the container with id cc5fd6c79e698d4bb2ff6366da60383392a165fe8346eb212e1d8fa71261d199 Jun 09 15:57:47.637997 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:47.637978 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f0f8ac9348fb900d92b838474a523e.slice/crio-89f8a4592df5314463c3f0a3c7d044831bb90cdbbf021b79c1fe5ecf3b641ac7 WatchSource:0}: Error finding container 89f8a4592df5314463c3f0a3c7d044831bb90cdbbf021b79c1fe5ecf3b641ac7: Status 404 returned error can't find the container with id 89f8a4592df5314463c3f0a3c7d044831bb90cdbbf021b79c1fe5ecf3b641ac7 Jun 09 15:57:47.642051 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.641041 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 15:57:47.642051 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.641949 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-vvz9l","openshift-image-registry/node-ca-pf7mr","openshift-multus/multus-jmm92","openshift-ovn-kubernetes/ovnkube-node-bgvmw","kube-system/global-pull-secret-syncer-78c48","kube-system/kube-apiserver-proxy-ip-10-0-129-90.ec2.internal","openshift-dns/node-resolver-hrjwl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal","openshift-multus/multus-additional-cni-plugins-5bd6f","openshift-multus/network-metrics-daemon-sls78","openshift-network-diagnostics/network-check-target-6hlgk","openshift-network-operator/iptables-alerter-hl6q2","kube-system/konnectivity-agent-9ntcd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp"] Jun 09 15:57:47.644563 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.644536 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hrjwl" Jun 09 15:57:47.645727 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.645707 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9ntcd" Jun 09 15:57:47.646211 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.646105 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 15:57:47.646380 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.646359 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 15:57:47.646380 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.646373 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 15:57:47.646516 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.646426 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l5jz7\"" Jun 09 15:57:47.646964 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.646923 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:57:47.646964 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.646932 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.647805 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.647677 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 15:57:47.647805 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.647694 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 15:57:47.647805 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.647722 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fnmq9\"" Jun 09 15:57:47.648155 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.647827 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 15:52:46 +0000 UTC" deadline="2028-01-15 20:19:01.723742448 +0000 UTC" Jun 09 15:57:47.648155 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.647882 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14044h21m14.075881243s" Jun 09 15:57:47.648388 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.648370 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.649073 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.649047 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 15:57:47.649190 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.649171 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wntrw\"" Jun 09 15:57:47.649256 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.649214 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 15:57:47.649256 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.649223 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 15:57:47.649459 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.649432 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 15:57:47.649702 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.649684 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:47.649776 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.649755 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:57:47.650485 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.650466 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 15:57:47.650619 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.650586 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 15:57:47.650711 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.650595 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 15:57:47.651021 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.650940 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.651188 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.651170 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 15:57:47.651397 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.651381 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 15:57:47.651457 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.651403 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-78l9t\"" Jun 09 15:57:47.651457 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.651420 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 15:57:47.652313 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652297 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.652413 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652387 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-run-multus-certs\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652568 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652415 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-etc-kubernetes\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652568 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652443 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a28ca345-3d41-4027-a7ac-dddc8bc731bb-konnectivity-ca\") pod \"konnectivity-agent-9ntcd\" (UID: \"a28ca345-3d41-4027-a7ac-dddc8bc731bb\") " pod="kube-system/konnectivity-agent-9ntcd" Jun 09 15:57:47.652568 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652465 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-multus-cni-dir\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652568 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652491 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-cnibin\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652568 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652514 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-multus-socket-dir-parent\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652568 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652536 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-run-netns\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652568 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652568 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-var-lib-cni-multus\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652608 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72560997-9dd8-4a00-b6fa-46956d8a83ba-tmp-dir\") pod \"node-resolver-hrjwl\" (UID: \"72560997-9dd8-4a00-b6fa-46956d8a83ba\") " pod="openshift-dns/node-resolver-hrjwl" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652640 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn6f7\" (UniqueName: \"kubernetes.io/projected/72560997-9dd8-4a00-b6fa-46956d8a83ba-kube-api-access-nn6f7\") pod \"node-resolver-hrjwl\" (UID: \"72560997-9dd8-4a00-b6fa-46956d8a83ba\") " pod="openshift-dns/node-resolver-hrjwl" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652677 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a28ca345-3d41-4027-a7ac-dddc8bc731bb-agent-certs\") pod \"konnectivity-agent-9ntcd\" (UID: \"a28ca345-3d41-4027-a7ac-dddc8bc731bb\") " pod="kube-system/konnectivity-agent-9ntcd" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652705 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-os-release\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652730 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-run-k8s-cni-cncf-io\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652765 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-var-lib-cni-bin\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652804 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-multus-conf-dir\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652827 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mhr4\" (UniqueName: \"kubernetes.io/projected/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-kube-api-access-2mhr4\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652844 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72560997-9dd8-4a00-b6fa-46956d8a83ba-hosts-file\") pod \"node-resolver-hrjwl\" (UID: \"72560997-9dd8-4a00-b6fa-46956d8a83ba\") " pod="openshift-dns/node-resolver-hrjwl" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652862 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-system-cni-dir\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652902 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-cni-binary-copy\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652945 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-var-lib-kubelet\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652964 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-hostroot\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.652980 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.652977 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-multus-daemon-config\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.653855 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.653590 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.654345 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.654330 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 15:57:47.654963 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.654945 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pf7mr" Jun 09 15:57:47.655700 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.655677 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 15:57:47.655793 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.655721 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 15:57:47.656083 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.656063 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w8dct\"" Jun 09 15:57:47.656174 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.656082 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 15:57:47.656174 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.656103 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 15:57:47.656174 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.656155 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 15:57:47.656174 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.656160 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4nbgb\"" Jun 09 15:57:47.656504 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.656479 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2th9x\"" Jun 09 15:57:47.656504 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.656490 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:57:47.656643 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.656527 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:47.656643 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.656598 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:57:47.656990 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.656975 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 15:57:47.657213 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.657199 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mfn98\"" Jun 09 15:57:47.657298 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.657284 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 15:57:47.657466 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.657445 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 15:57:47.657849 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.657832 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:47.657983 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.657960 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:57:47.659037 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.659020 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:57:47.659181 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.659161 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hl6q2" Jun 09 15:57:47.661190 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.661171 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h8mvs\"" Jun 09 15:57:47.662136 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.661914 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:57:47.662136 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.661996 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 15:57:47.662347 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.662331 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 15:57:47.692100 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.692081 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zb9gr" Jun 09 15:57:47.699966 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.699941 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zb9gr" Jun 09 15:57:47.723807 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.723759 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-90.ec2.internal" event={"ID":"b9f0f8ac9348fb900d92b838474a523e","Type":"ContainerStarted","Data":"89f8a4592df5314463c3f0a3c7d044831bb90cdbbf021b79c1fe5ecf3b641ac7"} Jun 09 15:57:47.724769 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.724746 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" event={"ID":"b7ff145d601f4218d51d2ab742f579b3","Type":"ContainerStarted","Data":"cc5fd6c79e698d4bb2ff6366da60383392a165fe8346eb212e1d8fa71261d199"} Jun 09 15:57:47.747628 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.747600 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 15:57:47.753801 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.753780 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-run-k8s-cni-cncf-io\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.753941 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.753808 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-var-lib-cni-bin\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.753941 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.753845 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-node-log\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.753941 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.753862 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24727568-0efb-4a24-9df1-0e2d64e92576-host\") pod \"node-ca-pf7mr\" (UID: \"24727568-0efb-4a24-9df1-0e2d64e92576\") " pod="openshift-image-registry/node-ca-pf7mr" Jun 09 15:57:47.753941 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.753909 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-run-k8s-cni-cncf-io\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.753941 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.753932 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-run-multus-certs\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.753929 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-var-lib-cni-bin\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.753954 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-etc-kubernetes\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.753965 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-run-multus-certs\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.753980 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-systemd-units\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754007 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-etc-kubernetes\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754018 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-slash\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754045 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-run-openvswitch\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754069 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xcf7\" (UniqueName: \"kubernetes.io/projected/94b8e0a3-fb65-4130-b76b-916f8bb17946-kube-api-access-6xcf7\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754095 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754122 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-os-release\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754145 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94b8e0a3-fb65-4130-b76b-916f8bb17946-ovnkube-script-lib\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754170 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:47.754191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754193 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-modprobe-d\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754216 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-run\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754241 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6rdk\" (UniqueName: \"kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk\") pod \"network-check-target-6hlgk\" (UID: \"3ce16e3d-4739-4cd1-8db0-7a049e3d1208\") " pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754266 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knkvs\" (UniqueName: \"kubernetes.io/projected/792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2-kube-api-access-knkvs\") pod \"iptables-alerter-hl6q2\" (UID: \"792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2\") " pod="openshift-network-operator/iptables-alerter-hl6q2" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754292 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-run-netns\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754319 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-var-lib-cni-multus\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754344 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-run-ovn\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754365 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a28ca345-3d41-4027-a7ac-dddc8bc731bb-agent-certs\") pod \"konnectivity-agent-9ntcd\" (UID: \"a28ca345-3d41-4027-a7ac-dddc8bc731bb\") " pod="kube-system/konnectivity-agent-9ntcd" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754374 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-var-lib-cni-multus\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754374 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-run-netns\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754417 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-multus-conf-dir\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754442 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-multus-conf-dir\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754463 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/60a22ce0-7c31-4359-80b4-f60d0c3b6867-dbus\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754493 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-registration-dir\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754517 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-device-dir\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754543 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-sysconfig\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754572 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-sysctl-d\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.754742 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754599 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdfxh\" (UniqueName: \"kubernetes.io/projected/24727568-0efb-4a24-9df1-0e2d64e92576-kube-api-access-sdfxh\") pod \"node-ca-pf7mr\" (UID: \"24727568-0efb-4a24-9df1-0e2d64e92576\") " pod="openshift-image-registry/node-ca-pf7mr" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754626 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-hostroot\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754651 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-kubelet\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754672 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94b8e0a3-fb65-4130-b76b-916f8bb17946-env-overrides\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754699 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-hostroot\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754710 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2-host-slash\") pod \"iptables-alerter-hl6q2\" (UID: \"792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2\") " pod="openshift-network-operator/iptables-alerter-hl6q2" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754736 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a28ca345-3d41-4027-a7ac-dddc8bc731bb-konnectivity-ca\") pod \"konnectivity-agent-9ntcd\" (UID: \"a28ca345-3d41-4027-a7ac-dddc8bc731bb\") " pod="kube-system/konnectivity-agent-9ntcd" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754710 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754753 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-system-cni-dir\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754771 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5np7\" (UniqueName: \"kubernetes.io/projected/7cccabbb-102d-4dd3-b772-af5ece21429f-kube-api-access-w5np7\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754786 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn6f7\" (UniqueName: \"kubernetes.io/projected/72560997-9dd8-4a00-b6fa-46956d8a83ba-kube-api-access-nn6f7\") pod \"node-resolver-hrjwl\" (UID: \"72560997-9dd8-4a00-b6fa-46956d8a83ba\") " pod="openshift-dns/node-resolver-hrjwl" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754899 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldc8l\" (UniqueName: \"kubernetes.io/projected/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-kube-api-access-ldc8l\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754947 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-systemd\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.754979 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69x9v\" (UniqueName: \"kubernetes.io/projected/6b270631-0238-4c2b-91b3-1aa287ae5c27-kube-api-access-69x9v\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755005 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-os-release\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755029 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94b8e0a3-fb65-4130-b76b-916f8bb17946-ovnkube-config\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755070 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.755448 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755103 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-os-release\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755111 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-lib-modules\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755149 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-etc-selinux\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755173 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-cni-binary-copy\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755196 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-multus-daemon-config\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755256 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a28ca345-3d41-4027-a7ac-dddc8bc731bb-konnectivity-ca\") pod \"konnectivity-agent-9ntcd\" (UID: \"a28ca345-3d41-4027-a7ac-dddc8bc731bb\") " pod="kube-system/konnectivity-agent-9ntcd" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755292 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-etc-openvswitch\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755331 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-log-socket\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755365 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94b8e0a3-fb65-4130-b76b-916f8bb17946-ovn-node-metrics-cert\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755387 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755408 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755443 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-var-lib-openvswitch\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755496 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-sys\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755531 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-tuned\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755553 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b270631-0238-4c2b-91b3-1aa287ae5c27-tmp\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755577 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/24727568-0efb-4a24-9df1-0e2d64e92576-serviceca\") pod \"node-ca-pf7mr\" (UID: \"24727568-0efb-4a24-9df1-0e2d64e92576\") " pod="openshift-image-registry/node-ca-pf7mr" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755611 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-cnibin\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.756240 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755638 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-multus-socket-dir-parent\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755661 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72560997-9dd8-4a00-b6fa-46956d8a83ba-tmp-dir\") pod \"node-resolver-hrjwl\" (UID: \"72560997-9dd8-4a00-b6fa-46956d8a83ba\") " pod="openshift-dns/node-resolver-hrjwl" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755686 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-cni-netd\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755711 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/60a22ce0-7c31-4359-80b4-f60d0c3b6867-kubelet-config\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755723 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-cnibin\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755735 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-cnibin\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755740 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-multus-socket-dir-parent\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755758 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755760 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-cni-binary-copy\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755783 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mhr4\" (UniqueName: \"kubernetes.io/projected/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-kube-api-access-2mhr4\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755809 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72560997-9dd8-4a00-b6fa-46956d8a83ba-hosts-file\") pod \"node-resolver-hrjwl\" (UID: \"72560997-9dd8-4a00-b6fa-46956d8a83ba\") " pod="openshift-dns/node-resolver-hrjwl" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755831 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-cni-bin\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755839 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-multus-daemon-config\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755851 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-kubernetes\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755888 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-sysctl-conf\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755900 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72560997-9dd8-4a00-b6fa-46956d8a83ba-hosts-file\") pod \"node-resolver-hrjwl\" (UID: \"72560997-9dd8-4a00-b6fa-46956d8a83ba\") " pod="openshift-dns/node-resolver-hrjwl" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755918 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2-iptables-alerter-script\") pod \"iptables-alerter-hl6q2\" (UID: \"792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2\") " pod="openshift-network-operator/iptables-alerter-hl6q2" Jun 09 15:57:47.756765 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755951 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-system-cni-dir\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.755991 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72560997-9dd8-4a00-b6fa-46956d8a83ba-tmp-dir\") pod \"node-resolver-hrjwl\" (UID: \"72560997-9dd8-4a00-b6fa-46956d8a83ba\") " pod="openshift-dns/node-resolver-hrjwl" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756011 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-var-lib-kubelet\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756053 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-run-ovn-kubernetes\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756072 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-host-var-lib-kubelet\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756078 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756087 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-system-cni-dir\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756107 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-var-lib-kubelet\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756128 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-host\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756155 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-multus-cni-dir\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756191 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-run-systemd\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756200 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-multus-cni-dir\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756218 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756247 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjjj4\" (UniqueName: \"kubernetes.io/projected/3651e66a-a1f9-4d54-bf2d-734512c1b132-kube-api-access-hjjj4\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756272 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-run-netns\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756296 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-socket-dir\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.757263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.756343 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-sys-fs\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.758220 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.758192 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a28ca345-3d41-4027-a7ac-dddc8bc731bb-agent-certs\") pod \"konnectivity-agent-9ntcd\" (UID: \"a28ca345-3d41-4027-a7ac-dddc8bc731bb\") " pod="kube-system/konnectivity-agent-9ntcd" Jun 09 15:57:47.765071 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.765044 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mhr4\" (UniqueName: \"kubernetes.io/projected/c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7-kube-api-access-2mhr4\") pod \"multus-jmm92\" (UID: \"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7\") " pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.765257 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.765234 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn6f7\" (UniqueName: \"kubernetes.io/projected/72560997-9dd8-4a00-b6fa-46956d8a83ba-kube-api-access-nn6f7\") pod \"node-resolver-hrjwl\" (UID: \"72560997-9dd8-4a00-b6fa-46956d8a83ba\") " pod="openshift-dns/node-resolver-hrjwl" Jun 09 15:57:47.857093 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857052 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-node-log\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.857093 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857091 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24727568-0efb-4a24-9df1-0e2d64e92576-host\") pod \"node-ca-pf7mr\" (UID: \"24727568-0efb-4a24-9df1-0e2d64e92576\") " pod="openshift-image-registry/node-ca-pf7mr" Jun 09 15:57:47.857335 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857108 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-systemd-units\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.857335 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857149 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24727568-0efb-4a24-9df1-0e2d64e92576-host\") pod \"node-ca-pf7mr\" (UID: \"24727568-0efb-4a24-9df1-0e2d64e92576\") " pod="openshift-image-registry/node-ca-pf7mr" Jun 09 15:57:47.857335 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857162 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-node-log\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.857335 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857191 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-slash\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.857335 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857173 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-slash\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.857335 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857219 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-run-openvswitch\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.857335 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857239 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xcf7\" (UniqueName: \"kubernetes.io/projected/94b8e0a3-fb65-4130-b76b-916f8bb17946-kube-api-access-6xcf7\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.857335 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857236 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-systemd-units\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.857335 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857255 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.857335 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857274 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-os-release\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.857335 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857290 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-run-openvswitch\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.857335 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857299 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94b8e0a3-fb65-4130-b76b-916f8bb17946-ovnkube-script-lib\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857343 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857436 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-os-release\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857474 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857496 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-modprobe-d\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857512 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-run\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857528 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rdk\" (UniqueName: \"kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk\") pod \"network-check-target-6hlgk\" (UID: \"3ce16e3d-4739-4cd1-8db0-7a049e3d1208\") " pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857543 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knkvs\" (UniqueName: \"kubernetes.io/projected/792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2-kube-api-access-knkvs\") pod \"iptables-alerter-hl6q2\" (UID: \"792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2\") " pod="openshift-network-operator/iptables-alerter-hl6q2" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857565 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-run-ovn\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857580 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-run\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.857590 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.857674 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret podName:60a22ce0-7c31-4359-80b4-f60d0c3b6867 nodeName:}" failed. No retries permitted until 2026-06-09 15:57:48.357650481 +0000 UTC m=+2.120021990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret") pod "global-pull-secret-syncer-78c48" (UID: "60a22ce0-7c31-4359-80b4-f60d0c3b6867") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857684 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-modprobe-d\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857711 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-run-ovn\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857742 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/60a22ce0-7c31-4359-80b4-f60d0c3b6867-dbus\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857770 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-registration-dir\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857795 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-device-dir\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.857829 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857810 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-sysconfig\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857825 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-sysctl-d\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857848 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdfxh\" (UniqueName: \"kubernetes.io/projected/24727568-0efb-4a24-9df1-0e2d64e92576-kube-api-access-sdfxh\") pod \"node-ca-pf7mr\" (UID: \"24727568-0efb-4a24-9df1-0e2d64e92576\") " pod="openshift-image-registry/node-ca-pf7mr" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857887 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/60a22ce0-7c31-4359-80b4-f60d0c3b6867-dbus\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857897 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-registration-dir\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857893 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-kubelet\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857939 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-sysconfig\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857950 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94b8e0a3-fb65-4130-b76b-916f8bb17946-env-overrides\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857938 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-device-dir\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857942 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94b8e0a3-fb65-4130-b76b-916f8bb17946-ovnkube-script-lib\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857976 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2-host-slash\") pod \"iptables-alerter-hl6q2\" (UID: \"792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2\") " pod="openshift-network-operator/iptables-alerter-hl6q2" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.857973 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-sysctl-d\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858003 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-system-cni-dir\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858026 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2-host-slash\") pod \"iptables-alerter-hl6q2\" (UID: \"792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2\") " pod="openshift-network-operator/iptables-alerter-hl6q2" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858029 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5np7\" (UniqueName: \"kubernetes.io/projected/7cccabbb-102d-4dd3-b772-af5ece21429f-kube-api-access-w5np7\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858036 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-system-cni-dir\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858003 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-kubelet\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.858575 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858069 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldc8l\" (UniqueName: \"kubernetes.io/projected/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-kube-api-access-ldc8l\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858087 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-systemd\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858102 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x9v\" (UniqueName: \"kubernetes.io/projected/6b270631-0238-4c2b-91b3-1aa287ae5c27-kube-api-access-69x9v\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858132 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94b8e0a3-fb65-4130-b76b-916f8bb17946-ovnkube-config\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858152 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-systemd\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858161 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858185 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-lib-modules\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858213 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-etc-selinux\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858239 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-etc-openvswitch\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858263 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-log-socket\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858305 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94b8e0a3-fb65-4130-b76b-916f8bb17946-ovn-node-metrics-cert\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858326 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94b8e0a3-fb65-4130-b76b-916f8bb17946-env-overrides\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858354 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-etc-selinux\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858331 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858384 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-log-socket\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858378 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858398 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.859429 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858430 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-etc-openvswitch\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858435 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-var-lib-openvswitch\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858463 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-var-lib-openvswitch\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858470 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-sys\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858497 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-tuned\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858507 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-lib-modules\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858520 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b270631-0238-4c2b-91b3-1aa287ae5c27-tmp\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858543 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/24727568-0efb-4a24-9df1-0e2d64e92576-serviceca\") pod \"node-ca-pf7mr\" (UID: \"24727568-0efb-4a24-9df1-0e2d64e92576\") " pod="openshift-image-registry/node-ca-pf7mr" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858555 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-sys\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858571 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-cni-netd\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858594 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/60a22ce0-7c31-4359-80b4-f60d0c3b6867-kubelet-config\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858618 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-cnibin\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858642 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858668 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-cni-bin\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858684 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94b8e0a3-fb65-4130-b76b-916f8bb17946-ovnkube-config\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858704 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-cni-netd\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858691 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-kubernetes\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858736 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-kubernetes\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.859996 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858752 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-sysctl-conf\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858796 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2-iptables-alerter-script\") pod \"iptables-alerter-hl6q2\" (UID: \"792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2\") " pod="openshift-network-operator/iptables-alerter-hl6q2" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858786 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/60a22ce0-7c31-4359-80b4-f60d0c3b6867-kubelet-config\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858839 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-run-ovn-kubernetes\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858911 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858980 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.858996 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859008 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-var-lib-kubelet\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859043 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-host\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859046 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-run-ovn-kubernetes\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859061 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-sysctl-conf\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859084 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-run-systemd\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859095 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-host\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.859108 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859114 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859142 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b270631-0238-4c2b-91b3-1aa287ae5c27-var-lib-kubelet\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.860489 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859145 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjjj4\" (UniqueName: \"kubernetes.io/projected/3651e66a-a1f9-4d54-bf2d-734512c1b132-kube-api-access-hjjj4\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.859167 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs podName:7cccabbb-102d-4dd3-b772-af5ece21429f nodeName:}" failed. No retries permitted until 2026-06-09 15:57:48.359150905 +0000 UTC m=+2.121522416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs") pod "network-metrics-daemon-sls78" (UID: "7cccabbb-102d-4dd3-b772-af5ece21429f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859185 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-run-systemd\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859191 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859207 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-run-netns\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859228 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-cnibin\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859231 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/24727568-0efb-4a24-9df1-0e2d64e92576-serviceca\") pod \"node-ca-pf7mr\" (UID: \"24727568-0efb-4a24-9df1-0e2d64e92576\") " pod="openshift-image-registry/node-ca-pf7mr" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859269 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-run-netns\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859234 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-socket-dir\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859280 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94b8e0a3-fb65-4130-b76b-916f8bb17946-host-cni-bin\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859307 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-sys-fs\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859312 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-socket-dir\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859385 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3651e66a-a1f9-4d54-bf2d-734512c1b132-sys-fs\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859523 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.859676 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2-iptables-alerter-script\") pod \"iptables-alerter-hl6q2\" (UID: \"792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2\") " pod="openshift-network-operator/iptables-alerter-hl6q2" Jun 09 15:57:47.861103 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.860791 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94b8e0a3-fb65-4130-b76b-916f8bb17946-ovn-node-metrics-cert\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.861592 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.861129 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6b270631-0238-4c2b-91b3-1aa287ae5c27-etc-tuned\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.861592 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.861177 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b270631-0238-4c2b-91b3-1aa287ae5c27-tmp\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.864445 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.864268 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:57:47.864445 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.864290 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:57:47.864445 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.864305 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d6rdk for pod openshift-network-diagnostics/network-check-target-6hlgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:57:47.864445 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:47.864418 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk podName:3ce16e3d-4739-4cd1-8db0-7a049e3d1208 nodeName:}" failed. No retries permitted until 2026-06-09 15:57:48.364398573 +0000 UTC m=+2.126770074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d6rdk" (UniqueName: "kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk") pod "network-check-target-6hlgk" (UID: "3ce16e3d-4739-4cd1-8db0-7a049e3d1208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:57:47.865719 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.865686 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knkvs\" (UniqueName: \"kubernetes.io/projected/792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2-kube-api-access-knkvs\") pod \"iptables-alerter-hl6q2\" (UID: \"792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2\") " pod="openshift-network-operator/iptables-alerter-hl6q2" Jun 09 15:57:47.866060 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.866036 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xcf7\" (UniqueName: \"kubernetes.io/projected/94b8e0a3-fb65-4130-b76b-916f8bb17946-kube-api-access-6xcf7\") pod \"ovnkube-node-bgvmw\" (UID: \"94b8e0a3-fb65-4130-b76b-916f8bb17946\") " pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.866399 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.866381 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69x9v\" (UniqueName: \"kubernetes.io/projected/6b270631-0238-4c2b-91b3-1aa287ae5c27-kube-api-access-69x9v\") pod \"tuned-vvz9l\" (UID: \"6b270631-0238-4c2b-91b3-1aa287ae5c27\") " pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.866700 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.866683 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdfxh\" (UniqueName: \"kubernetes.io/projected/24727568-0efb-4a24-9df1-0e2d64e92576-kube-api-access-sdfxh\") pod \"node-ca-pf7mr\" (UID: \"24727568-0efb-4a24-9df1-0e2d64e92576\") " pod="openshift-image-registry/node-ca-pf7mr" Jun 09 15:57:47.866856 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.866840 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjjj4\" (UniqueName: \"kubernetes.io/projected/3651e66a-a1f9-4d54-bf2d-734512c1b132-kube-api-access-hjjj4\") pod \"aws-ebs-csi-driver-node-lscnp\" (UID: \"3651e66a-a1f9-4d54-bf2d-734512c1b132\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.867124 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.867105 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldc8l\" (UniqueName: \"kubernetes.io/projected/34bcdd03-cb64-42f6-8ae1-02f6487f05e9-kube-api-access-ldc8l\") pod \"multus-additional-cni-plugins-5bd6f\" (UID: \"34bcdd03-cb64-42f6-8ae1-02f6487f05e9\") " pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.867249 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.867234 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5np7\" (UniqueName: \"kubernetes.io/projected/7cccabbb-102d-4dd3-b772-af5ece21429f-kube-api-access-w5np7\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:47.955753 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.955661 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hrjwl" Jun 09 15:57:47.964006 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.963984 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9ntcd" Jun 09 15:57:47.970951 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.970932 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jmm92" Jun 09 15:57:47.971943 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:47.971921 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda28ca345_3d41_4027_a7ac_dddc8bc731bb.slice/crio-ee0b467c97b05c74a225fdc74f2a1b7b3d4a45664a01acc9550cba808fe51dff WatchSource:0}: Error finding container ee0b467c97b05c74a225fdc74f2a1b7b3d4a45664a01acc9550cba808fe51dff: Status 404 returned error can't find the container with id ee0b467c97b05c74a225fdc74f2a1b7b3d4a45664a01acc9550cba808fe51dff Jun 09 15:57:47.975404 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.975386 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:57:47.980825 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.980802 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" Jun 09 15:57:47.981401 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:47.981353 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f4d7fc_b333_4c1b_8115_3eb2dc05caf7.slice/crio-c8e13ec0a92de349e77b09e448d4d545685b46ce21d8f89228863d2c85aeb447 WatchSource:0}: Error finding container c8e13ec0a92de349e77b09e448d4d545685b46ce21d8f89228863d2c85aeb447: Status 404 returned error can't find the container with id c8e13ec0a92de349e77b09e448d4d545685b46ce21d8f89228863d2c85aeb447 Jun 09 15:57:47.985999 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.985983 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5bd6f" Jun 09 15:57:47.986432 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:47.986398 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b8e0a3_fb65_4130_b76b_916f8bb17946.slice/crio-d95a135ddbcb80af96596f499f645764183ebe45ad8e1d45a15f14df6ed9ac8a WatchSource:0}: Error finding container d95a135ddbcb80af96596f499f645764183ebe45ad8e1d45a15f14df6ed9ac8a: Status 404 returned error can't find the container with id d95a135ddbcb80af96596f499f645764183ebe45ad8e1d45a15f14df6ed9ac8a Jun 09 15:57:47.989604 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:47.989489 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3651e66a_a1f9_4d54_bf2d_734512c1b132.slice/crio-f3883c0b86f924aecfa7e0a91cb125bbb083977962e021bd3df57c1c71d735e5 WatchSource:0}: Error finding container f3883c0b86f924aecfa7e0a91cb125bbb083977962e021bd3df57c1c71d735e5: Status 404 returned error can't find the container with id f3883c0b86f924aecfa7e0a91cb125bbb083977962e021bd3df57c1c71d735e5 Jun 09 15:57:47.992763 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.992724 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" Jun 09 15:57:47.994101 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:47.994076 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34bcdd03_cb64_42f6_8ae1_02f6487f05e9.slice/crio-adee77cd289d3e62bb2e6c4ed43d477c466877a584711e25d3946cf96bafc4c1 WatchSource:0}: Error finding container adee77cd289d3e62bb2e6c4ed43d477c466877a584711e25d3946cf96bafc4c1: Status 404 returned error can't find the container with id adee77cd289d3e62bb2e6c4ed43d477c466877a584711e25d3946cf96bafc4c1 Jun 09 15:57:47.997538 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:47.997514 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pf7mr" Jun 09 15:57:48.002056 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:48.002033 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b270631_0238_4c2b_91b3_1aa287ae5c27.slice/crio-f655b45fb82fa34f230923f653f94ac08acf076c59ba7a76faf8de40d85d7e29 WatchSource:0}: Error finding container f655b45fb82fa34f230923f653f94ac08acf076c59ba7a76faf8de40d85d7e29: Status 404 returned error can't find the container with id f655b45fb82fa34f230923f653f94ac08acf076c59ba7a76faf8de40d85d7e29 Jun 09 15:57:48.002162 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.002098 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hl6q2" Jun 09 15:57:48.008049 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:48.008016 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24727568_0efb_4a24_9df1_0e2d64e92576.slice/crio-65572306660d507edb0fe5f447e77c3f54ac32f490dcc9ed6e532ed3b8e1ad35 WatchSource:0}: Error finding container 65572306660d507edb0fe5f447e77c3f54ac32f490dcc9ed6e532ed3b8e1ad35: Status 404 returned error can't find the container with id 65572306660d507edb0fe5f447e77c3f54ac32f490dcc9ed6e532ed3b8e1ad35 Jun 09 15:57:48.011500 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:57:48.011480 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792e9b7e_444f_4ee0_b7f8_6c42e8ebafc2.slice/crio-8380b4b1a3355d3281bd5100e57c7daefa565d45eb29aa5ed32e36aaf1494895 WatchSource:0}: Error finding container 8380b4b1a3355d3281bd5100e57c7daefa565d45eb29aa5ed32e36aaf1494895: Status 404 returned error can't find the container with id 8380b4b1a3355d3281bd5100e57c7daefa565d45eb29aa5ed32e36aaf1494895 Jun 09 15:57:48.363462 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.363355 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:48.363462 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.363413 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:48.363727 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:48.363607 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:57:48.363727 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:48.363690 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs podName:7cccabbb-102d-4dd3-b772-af5ece21429f nodeName:}" failed. No retries permitted until 2026-06-09 15:57:49.363655046 +0000 UTC m=+3.126026547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs") pod "network-metrics-daemon-sls78" (UID: "7cccabbb-102d-4dd3-b772-af5ece21429f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:57:48.363727 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:48.363691 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:57:48.363911 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:48.363753 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret podName:60a22ce0-7c31-4359-80b4-f60d0c3b6867 nodeName:}" failed. No retries permitted until 2026-06-09 15:57:49.363735618 +0000 UTC m=+3.126107131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret") pod "global-pull-secret-syncer-78c48" (UID: "60a22ce0-7c31-4359-80b4-f60d0c3b6867") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:57:48.464719 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.464682 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rdk\" (UniqueName: \"kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk\") pod \"network-check-target-6hlgk\" (UID: \"3ce16e3d-4739-4cd1-8db0-7a049e3d1208\") " pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:48.464937 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:48.464908 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:57:48.464937 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:48.464937 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:57:48.465067 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:48.464950 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d6rdk for pod openshift-network-diagnostics/network-check-target-6hlgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:57:48.465067 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:48.465035 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk podName:3ce16e3d-4739-4cd1-8db0-7a049e3d1208 nodeName:}" failed. No retries permitted until 2026-06-09 15:57:49.465014569 +0000 UTC m=+3.227386091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d6rdk" (UniqueName: "kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk") pod "network-check-target-6hlgk" (UID: "3ce16e3d-4739-4cd1-8db0-7a049e3d1208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:57:48.701613 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.701568 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 15:52:47 +0000 UTC" deadline="2028-01-19 08:18:55.400038738 +0000 UTC" Jun 09 15:57:48.701613 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.701609 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14128h21m6.698434347s" Jun 09 15:57:48.739361 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.739319 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hrjwl" event={"ID":"72560997-9dd8-4a00-b6fa-46956d8a83ba","Type":"ContainerStarted","Data":"0a97739de750f1f303e82499813c9f0eca493b741918be6c5002ac13b9b52a73"} Jun 09 15:57:48.752899 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.752846 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hl6q2" event={"ID":"792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2","Type":"ContainerStarted","Data":"8380b4b1a3355d3281bd5100e57c7daefa565d45eb29aa5ed32e36aaf1494895"} Jun 09 15:57:48.765220 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.765173 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" event={"ID":"3651e66a-a1f9-4d54-bf2d-734512c1b132","Type":"ContainerStarted","Data":"f3883c0b86f924aecfa7e0a91cb125bbb083977962e021bd3df57c1c71d735e5"} Jun 09 15:57:48.773495 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.773384 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" event={"ID":"94b8e0a3-fb65-4130-b76b-916f8bb17946","Type":"ContainerStarted","Data":"d95a135ddbcb80af96596f499f645764183ebe45ad8e1d45a15f14df6ed9ac8a"} Jun 09 15:57:48.775618 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.775537 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pf7mr" event={"ID":"24727568-0efb-4a24-9df1-0e2d64e92576","Type":"ContainerStarted","Data":"65572306660d507edb0fe5f447e77c3f54ac32f490dcc9ed6e532ed3b8e1ad35"} Jun 09 15:57:48.800173 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.800043 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" event={"ID":"6b270631-0238-4c2b-91b3-1aa287ae5c27","Type":"ContainerStarted","Data":"f655b45fb82fa34f230923f653f94ac08acf076c59ba7a76faf8de40d85d7e29"} Jun 09 15:57:48.810562 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.810382 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:57:48.815169 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.815135 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bd6f" event={"ID":"34bcdd03-cb64-42f6-8ae1-02f6487f05e9","Type":"ContainerStarted","Data":"adee77cd289d3e62bb2e6c4ed43d477c466877a584711e25d3946cf96bafc4c1"} Jun 09 15:57:48.829169 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.829129 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jmm92" event={"ID":"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7","Type":"ContainerStarted","Data":"c8e13ec0a92de349e77b09e448d4d545685b46ce21d8f89228863d2c85aeb447"} Jun 09 15:57:48.862885 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:48.859581 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9ntcd" event={"ID":"a28ca345-3d41-4027-a7ac-dddc8bc731bb","Type":"ContainerStarted","Data":"ee0b467c97b05c74a225fdc74f2a1b7b3d4a45664a01acc9550cba808fe51dff"} Jun 09 15:57:49.062506 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:49.062425 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:57:49.341036 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:49.340921 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:57:49.375301 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:49.375249 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:49.375473 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:49.375358 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:49.375533 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:49.375496 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:57:49.375599 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:49.375559 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs podName:7cccabbb-102d-4dd3-b772-af5ece21429f nodeName:}" failed. No retries permitted until 2026-06-09 15:57:51.375539743 +0000 UTC m=+5.137911244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs") pod "network-metrics-daemon-sls78" (UID: "7cccabbb-102d-4dd3-b772-af5ece21429f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:57:49.376051 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:49.376030 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:57:49.376159 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:49.376091 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret podName:60a22ce0-7c31-4359-80b4-f60d0c3b6867 nodeName:}" failed. No retries permitted until 2026-06-09 15:57:51.37607416 +0000 UTC m=+5.138445661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret") pod "global-pull-secret-syncer-78c48" (UID: "60a22ce0-7c31-4359-80b4-f60d0c3b6867") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:57:49.476289 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:49.476248 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rdk\" (UniqueName: \"kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk\") pod \"network-check-target-6hlgk\" (UID: \"3ce16e3d-4739-4cd1-8db0-7a049e3d1208\") " pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:49.476480 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:49.476412 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:57:49.476480 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:49.476434 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:57:49.476480 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:49.476448 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d6rdk for pod openshift-network-diagnostics/network-check-target-6hlgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:57:49.476659 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:49.476511 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk podName:3ce16e3d-4739-4cd1-8db0-7a049e3d1208 nodeName:}" failed. No retries permitted until 2026-06-09 15:57:51.476492373 +0000 UTC m=+5.238863890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d6rdk" (UniqueName: "kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk") pod "network-check-target-6hlgk" (UID: "3ce16e3d-4739-4cd1-8db0-7a049e3d1208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:57:49.702060 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:49.701971 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 15:52:47 +0000 UTC" deadline="2027-11-29 04:41:35.688755502 +0000 UTC" Jun 09 15:57:49.702060 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:49.702039 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12900h43m45.986721203s" Jun 09 15:57:49.720610 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:49.720570 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:49.720771 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:49.720735 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:57:49.721173 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:49.721150 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:49.721286 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:49.721252 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:57:49.721344 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:49.721313 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:49.721418 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:49.721391 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:57:50.175410 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:50.175381 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:57:51.393332 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:51.393004 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:51.393332 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:51.393061 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:51.393332 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:51.393203 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:57:51.393332 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:51.393266 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:57:51.393332 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:51.393275 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret podName:60a22ce0-7c31-4359-80b4-f60d0c3b6867 nodeName:}" failed. No retries permitted until 2026-06-09 15:57:55.393256036 +0000 UTC m=+9.155627539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret") pod "global-pull-secret-syncer-78c48" (UID: "60a22ce0-7c31-4359-80b4-f60d0c3b6867") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:57:51.393332 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:51.393304 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs podName:7cccabbb-102d-4dd3-b772-af5ece21429f nodeName:}" failed. No retries permitted until 2026-06-09 15:57:55.393293653 +0000 UTC m=+9.155665165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs") pod "network-metrics-daemon-sls78" (UID: "7cccabbb-102d-4dd3-b772-af5ece21429f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:57:51.494447 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:51.494386 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rdk\" (UniqueName: \"kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk\") pod \"network-check-target-6hlgk\" (UID: \"3ce16e3d-4739-4cd1-8db0-7a049e3d1208\") " pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:51.494635 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:51.494587 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:57:51.494635 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:51.494603 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:57:51.494635 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:51.494613 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d6rdk for pod openshift-network-diagnostics/network-check-target-6hlgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:57:51.494804 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:51.494659 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk podName:3ce16e3d-4739-4cd1-8db0-7a049e3d1208 nodeName:}" failed. No retries permitted until 2026-06-09 15:57:55.494646207 +0000 UTC m=+9.257017709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d6rdk" (UniqueName: "kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk") pod "network-check-target-6hlgk" (UID: "3ce16e3d-4739-4cd1-8db0-7a049e3d1208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:57:51.720569 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:51.720532 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:51.720716 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:51.720665 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:57:51.721090 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:51.721069 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:51.721188 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:51.721166 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:57:51.721251 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:51.721219 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:51.721316 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:51.721298 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:57:53.720804 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:53.720415 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:53.720804 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:53.720454 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:53.720804 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:53.720415 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:53.720804 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:53.720560 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:57:53.720804 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:53.720635 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:57:53.720804 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:53.720762 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:57:55.431177 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:55.431138 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:55.431662 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:55.431207 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:55.431662 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:55.431267 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:57:55.431662 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:55.431347 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs podName:7cccabbb-102d-4dd3-b772-af5ece21429f nodeName:}" failed. No retries permitted until 2026-06-09 15:58:03.431323319 +0000 UTC m=+17.193694817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs") pod "network-metrics-daemon-sls78" (UID: "7cccabbb-102d-4dd3-b772-af5ece21429f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:57:55.431662 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:55.431348 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:57:55.431662 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:55.431402 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret podName:60a22ce0-7c31-4359-80b4-f60d0c3b6867 nodeName:}" failed. No retries permitted until 2026-06-09 15:58:03.431385738 +0000 UTC m=+17.193757236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret") pod "global-pull-secret-syncer-78c48" (UID: "60a22ce0-7c31-4359-80b4-f60d0c3b6867") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:57:55.532464 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:55.532422 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rdk\" (UniqueName: \"kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk\") pod \"network-check-target-6hlgk\" (UID: \"3ce16e3d-4739-4cd1-8db0-7a049e3d1208\") " pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:55.532668 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:55.532651 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:57:55.532729 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:55.532675 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:57:55.532729 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:55.532689 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d6rdk for pod openshift-network-diagnostics/network-check-target-6hlgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:57:55.532826 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:55.532759 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk podName:3ce16e3d-4739-4cd1-8db0-7a049e3d1208 nodeName:}" failed. No retries permitted until 2026-06-09 15:58:03.5327393 +0000 UTC m=+17.295110819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d6rdk" (UniqueName: "kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk") pod "network-check-target-6hlgk" (UID: "3ce16e3d-4739-4cd1-8db0-7a049e3d1208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:57:55.721252 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:55.720694 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:55.721252 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:55.720829 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:57:55.721252 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:55.720927 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:55.721252 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:55.721041 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:57:55.721252 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:55.721093 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:55.721252 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:55.721161 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:57:57.721304 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:57.721217 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:57.721755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:57.721231 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:57.721755 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:57.721378 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:57.721755 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:57.721343 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:57:57.721755 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:57.721488 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:57:57.721755 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:57.721566 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:57:59.720772 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:59.720738 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:57:59.721192 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:59.720738 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:57:59.721192 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:57:59.720738 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:57:59.721192 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:59.720895 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:57:59.721192 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:59.720933 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:57:59.721192 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:57:59.720998 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:01.721161 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:01.720925 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:01.721599 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:01.720959 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:01.721599 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:01.721265 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:58:01.721599 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:01.720998 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:01.721599 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:01.721320 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:58:01.721599 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:01.721384 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:03.490979 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:03.490880 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:03.490979 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:03.490947 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:03.490979 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:03.490968 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:58:03.491447 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:03.491031 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs podName:7cccabbb-102d-4dd3-b772-af5ece21429f nodeName:}" failed. No retries permitted until 2026-06-09 15:58:19.491016184 +0000 UTC m=+33.253387682 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs") pod "network-metrics-daemon-sls78" (UID: "7cccabbb-102d-4dd3-b772-af5ece21429f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:58:03.491447 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:03.491059 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:58:03.491447 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:03.491126 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret podName:60a22ce0-7c31-4359-80b4-f60d0c3b6867 nodeName:}" failed. No retries permitted until 2026-06-09 15:58:19.491107323 +0000 UTC m=+33.253478827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret") pod "global-pull-secret-syncer-78c48" (UID: "60a22ce0-7c31-4359-80b4-f60d0c3b6867") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:58:03.592215 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:03.592174 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rdk\" (UniqueName: \"kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk\") pod \"network-check-target-6hlgk\" (UID: \"3ce16e3d-4739-4cd1-8db0-7a049e3d1208\") " pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:03.592405 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:03.592360 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:58:03.592405 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:03.592384 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:58:03.592405 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:03.592398 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d6rdk for pod openshift-network-diagnostics/network-check-target-6hlgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:58:03.592545 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:03.592460 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk podName:3ce16e3d-4739-4cd1-8db0-7a049e3d1208 nodeName:}" failed. No retries permitted until 2026-06-09 15:58:19.592444455 +0000 UTC m=+33.354815953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d6rdk" (UniqueName: "kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk") pod "network-check-target-6hlgk" (UID: "3ce16e3d-4739-4cd1-8db0-7a049e3d1208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:58:03.720771 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:03.720730 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:03.720771 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:03.720761 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:03.721040 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:03.720762 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:03.721040 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:03.720884 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:58:03.721040 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:03.720973 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:58:03.721147 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:03.721055 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:05.721077 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:05.721038 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:05.721557 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:05.721053 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:05.721557 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:05.721175 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:05.721557 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:05.721229 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:05.721557 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:05.721322 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:58:05.721557 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:05.721406 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:58:07.720686 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:07.720660 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:07.721025 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:07.720756 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:07.721025 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:07.720782 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:07.721025 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:07.720760 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:07.721025 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:07.720886 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:58:07.721025 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:07.720942 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:58:07.927591 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:07.927526 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-90.ec2.internal" event={"ID":"b9f0f8ac9348fb900d92b838474a523e","Type":"ContainerStarted","Data":"bd62dc54c634746c5da5158e5c3ca9bfaaca80446431a0004939d166bc137039"} Jun 09 15:58:07.941645 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:07.941599 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-90.ec2.internal" podStartSLOduration=20.941585105 podStartE2EDuration="20.941585105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:07.941277735 +0000 UTC m=+21.703649255" watchObservedRunningTime="2026-06-09 15:58:07.941585105 +0000 UTC m=+21.703956624" Jun 09 15:58:08.930817 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:08.930651 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/ovn-acl-logging/0.log" Jun 09 15:58:08.931459 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:08.931118 2552 generic.go:356] "Generic (PLEG): container finished" podID="94b8e0a3-fb65-4130-b76b-916f8bb17946" containerID="2d64eddc3fafa9c0e9c3d453a1cd7a5813c72f9a556ef6d10cf705bd8a3fa88b" exitCode=1 Jun 09 15:58:08.931459 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:08.931179 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" event={"ID":"94b8e0a3-fb65-4130-b76b-916f8bb17946","Type":"ContainerStarted","Data":"26ecdcb2a1d3633507aad429c4c5f7a548b50c7bd15cbe7cbd54918de6923c58"} Jun 09 15:58:08.931459 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:08.931294 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" event={"ID":"94b8e0a3-fb65-4130-b76b-916f8bb17946","Type":"ContainerDied","Data":"2d64eddc3fafa9c0e9c3d453a1cd7a5813c72f9a556ef6d10cf705bd8a3fa88b"} Jun 09 15:58:08.931459 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:08.931326 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" event={"ID":"94b8e0a3-fb65-4130-b76b-916f8bb17946","Type":"ContainerStarted","Data":"e702ddb794418a32ca376df5db95926a7ab636a8a6d9aa31b7222b43140d6b03"} Jun 09 15:58:08.933142 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:08.933112 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" event={"ID":"6b270631-0238-4c2b-91b3-1aa287ae5c27","Type":"ContainerStarted","Data":"29208a244cbc40499dd12d9d88edc7dc72210b1a19d796cc581746d492148dc9"} Jun 09 15:58:08.934770 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:08.934742 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jmm92" event={"ID":"c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7","Type":"ContainerStarted","Data":"8e501645147f857e383c31ffd2c9766ce86bb357a8ea99f9f6dc08303bc96618"} Jun 09 15:58:08.950374 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:08.949767 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vvz9l" podStartSLOduration=3.270017641 podStartE2EDuration="22.949749859s" totalImagesPullingTime="19.679732218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:08.94933175 +0000 UTC m=+22.711703271" watchObservedRunningTime="2026-06-09 15:58:08.949749859 +0000 UTC m=+22.712121380" Jun 09 15:58:09.721182 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.721146 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:09.721380 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.721146 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:09.721380 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:09.721291 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:58:09.721380 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.721146 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:09.721563 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:09.721382 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:58:09.721563 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:09.721473 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:09.938104 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.938064 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hl6q2" event={"ID":"792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2","Type":"ContainerStarted","Data":"a69d0bdf36a6c26f9243b0884f734c40e74b50fa442b3cb5584532f942d9c274"} Jun 09 15:58:09.939551 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.939526 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" event={"ID":"3651e66a-a1f9-4d54-bf2d-734512c1b132","Type":"ContainerStarted","Data":"715bb418bf3597f64e169586a39b3dd6c622eccd0cbd6a6edaf8793f5cc0fda1"} Jun 09 15:58:09.942221 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.942202 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/ovn-acl-logging/0.log" Jun 09 15:58:09.942564 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.942546 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" event={"ID":"94b8e0a3-fb65-4130-b76b-916f8bb17946","Type":"ContainerStarted","Data":"0781dc6372ecaef1d10f23dcd962ed2ecd41dc9bda82d80cf6a0c41de1bfe2f5"} Jun 09 15:58:09.942633 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.942614 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" event={"ID":"94b8e0a3-fb65-4130-b76b-916f8bb17946","Type":"ContainerStarted","Data":"ebe59bf15289a061383a9646dfd852a19fcae1e26beb1bd869ff38452ad89362"} Jun 09 15:58:09.942746 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.942663 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" event={"ID":"94b8e0a3-fb65-4130-b76b-916f8bb17946","Type":"ContainerStarted","Data":"636efdf0c498100345107bd5214b98271d39b88e151764edfc53ba90f0b4f96e"} Jun 09 15:58:09.943934 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.943906 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pf7mr" event={"ID":"24727568-0efb-4a24-9df1-0e2d64e92576","Type":"ContainerStarted","Data":"1d7bf2965b1b8238b8d5940adfd1c0b38715223a3843fbc59e89b60a67b4e32d"} Jun 09 15:58:09.945414 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.945359 2552 generic.go:356] "Generic (PLEG): container finished" podID="34bcdd03-cb64-42f6-8ae1-02f6487f05e9" containerID="a1176eea5c7e277913de87f4568fbc53ec465affd5267713c350da84034147a0" exitCode=0 Jun 09 15:58:09.945498 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.945440 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bd6f" event={"ID":"34bcdd03-cb64-42f6-8ae1-02f6487f05e9","Type":"ContainerDied","Data":"a1176eea5c7e277913de87f4568fbc53ec465affd5267713c350da84034147a0"} Jun 09 15:58:09.946833 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.946812 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9ntcd" event={"ID":"a28ca345-3d41-4027-a7ac-dddc8bc731bb","Type":"ContainerStarted","Data":"e2fd3ffad1ee09ce62cc876b8bb3e2f03f3af4ca11837a1867b14783696ff0c9"} Jun 09 15:58:09.948161 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.948144 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hrjwl" event={"ID":"72560997-9dd8-4a00-b6fa-46956d8a83ba","Type":"ContainerStarted","Data":"fcd098e1a96779b1e142c44f6f9838feea14858c2fa2c81b864216b5f2073a73"} Jun 09 15:58:09.949602 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.949578 2552 generic.go:356] "Generic (PLEG): container finished" podID="b7ff145d601f4218d51d2ab742f579b3" containerID="59cc7b1f4d369ffc9e1d199690abc4433f1151bc92b46a025eeee45a0bd0a6e3" exitCode=0 Jun 09 15:58:09.949676 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.949651 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" event={"ID":"b7ff145d601f4218d51d2ab742f579b3","Type":"ContainerDied","Data":"59cc7b1f4d369ffc9e1d199690abc4433f1151bc92b46a025eeee45a0bd0a6e3"} Jun 09 15:58:09.952260 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.952219 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jmm92" podStartSLOduration=4.21248254 podStartE2EDuration="23.952204713s" totalImagesPullingTime="19.739722173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:08.966427875 +0000 UTC m=+22.728799418" watchObservedRunningTime="2026-06-09 15:58:09.952204713 +0000 UTC m=+23.714576232" Jun 09 15:58:09.952733 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:09.952703 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hl6q2" podStartSLOduration=4.285846155 podStartE2EDuration="23.952694334s" totalImagesPullingTime="19.666848179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:09.95220075 +0000 UTC m=+23.714572269" watchObservedRunningTime="2026-06-09 15:58:09.952694334 +0000 UTC m=+23.715065854" Jun 09 15:58:10.031539 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:10.031483 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pf7mr" podStartSLOduration=4.372864971 podStartE2EDuration="24.031465656s" totalImagesPullingTime="19.658600685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:10.014002188 +0000 UTC m=+23.776373709" watchObservedRunningTime="2026-06-09 15:58:10.031465656 +0000 UTC m=+23.793837178" Jun 09 15:58:10.031783 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:10.031764 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hrjwl" podStartSLOduration=4.329664048 podStartE2EDuration="24.031758903s" totalImagesPullingTime="19.702094855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:10.031201538 +0000 UTC m=+23.793573058" watchObservedRunningTime="2026-06-09 15:58:10.031758903 +0000 UTC m=+23.794130420" Jun 09 15:58:10.046192 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:10.046154 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9ntcd" podStartSLOduration=4.346057622 podStartE2EDuration="24.046140212s" totalImagesPullingTime="19.70008259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:10.046037171 +0000 UTC m=+23.808408692" watchObservedRunningTime="2026-06-09 15:58:10.046140212 +0000 UTC m=+23.808511745" Jun 09 15:58:10.281932 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:10.281852 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 15:58:10.714242 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:10.714141 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T15:58:10.281883069Z","UUID":"1fffc98e-0e51-4d58-b458-1845fd73bbe0","Handler":null,"Name":"","Endpoint":""} Jun 09 15:58:10.715670 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:10.715645 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 15:58:10.715806 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:10.715682 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 15:58:10.954151 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:10.954116 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" event={"ID":"b7ff145d601f4218d51d2ab742f579b3","Type":"ContainerStarted","Data":"629ade5277f1b94ba5c8762a3d74f107662d9be2fc823441c4666402dc9d1a5c"} Jun 09 15:58:10.956175 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:10.956132 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" event={"ID":"3651e66a-a1f9-4d54-bf2d-734512c1b132","Type":"ContainerStarted","Data":"b6151c46e927f1b2abe285fd967d36382893c935966b7f8a6553788c0d816c8f"} Jun 09 15:58:10.971780 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:10.971659 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-90.ec2.internal" podStartSLOduration=23.971637631 podStartE2EDuration="23.971637631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:10.971147789 +0000 UTC m=+24.733519310" watchObservedRunningTime="2026-06-09 15:58:10.971637631 +0000 UTC m=+24.734009153" Jun 09 15:58:11.720827 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:11.720789 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:11.720827 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:11.720829 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:11.721091 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:11.720805 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:11.721091 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:11.720935 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:58:11.721091 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:11.721059 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:58:11.721232 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:11.721151 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:11.966519 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:11.966482 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/ovn-acl-logging/0.log" Jun 09 15:58:11.967005 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:11.966911 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" event={"ID":"94b8e0a3-fb65-4130-b76b-916f8bb17946","Type":"ContainerStarted","Data":"826b3da91fa855d8278b69d16085055b72876a0fd33012bcdf0a7d24ecc04067"} Jun 09 15:58:11.969235 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:11.969208 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" event={"ID":"3651e66a-a1f9-4d54-bf2d-734512c1b132","Type":"ContainerStarted","Data":"96de4905c0cb8493e4835f59457bcbeb1d54cd234f6ed70e7d9daa0b9d619632"} Jun 09 15:58:11.985705 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:11.985599 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lscnp" podStartSLOduration=4.019482488 podStartE2EDuration="25.985583184s" totalImagesPullingTime="21.966100696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:57:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:11.985000014 +0000 UTC m=+25.747371533" watchObservedRunningTime="2026-06-09 15:58:11.985583184 +0000 UTC m=+25.747954704" Jun 09 15:58:12.093687 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:12.093646 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9ntcd" Jun 09 15:58:12.094528 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:12.094504 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9ntcd" Jun 09 15:58:12.972065 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:12.971784 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9ntcd" Jun 09 15:58:12.972533 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:12.972342 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9ntcd" Jun 09 15:58:13.721104 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:13.721019 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:13.721288 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:13.721019 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:13.721288 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:13.721148 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:58:13.721288 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:13.721019 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:13.721288 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:13.721246 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:58:13.721474 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:13.721339 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:14.977639 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:14.977432 2552 generic.go:356] "Generic (PLEG): container finished" podID="34bcdd03-cb64-42f6-8ae1-02f6487f05e9" containerID="838357c7131d38a77212588e1e0c81f892bfc1a2ca70b68c238361679497981b" exitCode=0 Jun 09 15:58:14.978481 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:14.977518 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bd6f" event={"ID":"34bcdd03-cb64-42f6-8ae1-02f6487f05e9","Type":"ContainerDied","Data":"838357c7131d38a77212588e1e0c81f892bfc1a2ca70b68c238361679497981b"} Jun 09 15:58:14.984048 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:14.981699 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/ovn-acl-logging/0.log" Jun 09 15:58:14.984494 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:14.984458 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" event={"ID":"94b8e0a3-fb65-4130-b76b-916f8bb17946","Type":"ContainerStarted","Data":"23b5139674dff6e751011afb14c49e9da814b725a2f3b48d1d6e08dd7bd18882"} Jun 09 15:58:14.984786 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:14.984764 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:58:14.984903 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:14.984857 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:58:14.984981 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:14.984969 2552 scope.go:117] "RemoveContainer" containerID="2d64eddc3fafa9c0e9c3d453a1cd7a5813c72f9a556ef6d10cf705bd8a3fa88b" Jun 09 15:58:15.000764 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:15.000743 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:58:15.721269 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:15.721232 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:15.721478 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:15.721275 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:15.721478 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:15.721325 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:15.721478 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:15.721342 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:58:15.721478 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:15.721403 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:15.721609 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:15.721478 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:58:15.990836 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:15.990761 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/ovn-acl-logging/0.log" Jun 09 15:58:15.991303 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:15.991179 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" event={"ID":"94b8e0a3-fb65-4130-b76b-916f8bb17946","Type":"ContainerStarted","Data":"847218415bccb5e0b71671d6f0fe87d99f0b13e957a7a594c85bac4e87defd0d"} Jun 09 15:58:15.991616 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:15.991548 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:58:16.009234 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:16.009207 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:58:16.017817 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:16.017768 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" podStartSLOduration=9.511862207 podStartE2EDuration="30.017751682s" totalImagesPullingTime="20.505889475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:16.016536229 +0000 UTC m=+29.778907751" watchObservedRunningTime="2026-06-09 15:58:16.017751682 +0000 UTC m=+29.780123202" Jun 09 15:58:16.250362 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:16.250283 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-78c48"] Jun 09 15:58:16.250493 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:16.250449 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:16.250572 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:16.250551 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:58:16.253759 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:16.253726 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6hlgk"] Jun 09 15:58:16.253920 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:16.253850 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:16.253997 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:16.253973 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:16.254404 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:16.254383 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sls78"] Jun 09 15:58:16.254498 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:16.254471 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:16.254557 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:16.254542 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:58:16.995304 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:16.995271 2552 generic.go:356] "Generic (PLEG): container finished" podID="34bcdd03-cb64-42f6-8ae1-02f6487f05e9" containerID="c367c1b79acfe5a945ab88616908a1c34e54bfc4d7fb2932e80f0fdb09b8b930" exitCode=0 Jun 09 15:58:16.995665 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:16.995341 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bd6f" event={"ID":"34bcdd03-cb64-42f6-8ae1-02f6487f05e9","Type":"ContainerDied","Data":"c367c1b79acfe5a945ab88616908a1c34e54bfc4d7fb2932e80f0fdb09b8b930"} Jun 09 15:58:17.720524 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:17.720464 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:17.720524 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:17.720502 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:17.720932 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:17.720622 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:17.720932 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:17.720646 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:17.720932 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:17.720764 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:58:17.720932 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:17.720853 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:58:19.003121 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:19.002835 2552 generic.go:356] "Generic (PLEG): container finished" podID="34bcdd03-cb64-42f6-8ae1-02f6487f05e9" containerID="981cb7adb73ab6858ab94e0480ad3fd72d0e9cae88a5bcfff0889ed753b0bf2c" exitCode=0 Jun 09 15:58:19.003519 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:19.002917 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bd6f" event={"ID":"34bcdd03-cb64-42f6-8ae1-02f6487f05e9","Type":"ContainerDied","Data":"981cb7adb73ab6858ab94e0480ad3fd72d0e9cae88a5bcfff0889ed753b0bf2c"} Jun 09 15:58:19.508564 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:19.508530 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:19.508739 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:19.508580 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:19.508739 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:19.508694 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:58:19.508856 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:19.508765 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs podName:7cccabbb-102d-4dd3-b772-af5ece21429f nodeName:}" failed. No retries permitted until 2026-06-09 15:58:51.508744763 +0000 UTC m=+65.271116266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs") pod "network-metrics-daemon-sls78" (UID: "7cccabbb-102d-4dd3-b772-af5ece21429f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:58:19.508856 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:19.508694 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:58:19.508856 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:19.508821 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret podName:60a22ce0-7c31-4359-80b4-f60d0c3b6867 nodeName:}" failed. No retries permitted until 2026-06-09 15:58:51.508810825 +0000 UTC m=+65.271182338 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret") pod "global-pull-secret-syncer-78c48" (UID: "60a22ce0-7c31-4359-80b4-f60d0c3b6867") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:58:19.609191 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:19.609155 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rdk\" (UniqueName: \"kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk\") pod \"network-check-target-6hlgk\" (UID: \"3ce16e3d-4739-4cd1-8db0-7a049e3d1208\") " pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:19.609381 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:19.609333 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:58:19.609381 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:19.609358 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:58:19.609381 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:19.609373 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d6rdk for pod openshift-network-diagnostics/network-check-target-6hlgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:58:19.609489 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:19.609432 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk podName:3ce16e3d-4739-4cd1-8db0-7a049e3d1208 nodeName:}" failed. No retries permitted until 2026-06-09 15:58:51.609416555 +0000 UTC m=+65.371788054 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d6rdk" (UniqueName: "kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk") pod "network-check-target-6hlgk" (UID: "3ce16e3d-4739-4cd1-8db0-7a049e3d1208") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:58:19.720672 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:19.720631 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:19.720858 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:19.720631 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:19.720858 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:19.720631 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:19.720858 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:19.720768 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:58:19.721129 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:19.720899 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:58:19.721129 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:19.720988 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:21.720514 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:21.720466 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:21.721010 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:21.720581 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:21.721010 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:21.720588 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6hlgk" podUID="3ce16e3d-4739-4cd1-8db0-7a049e3d1208" Jun 09 15:58:21.721010 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:21.720612 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:21.721010 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:21.720695 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78c48" podUID="60a22ce0-7c31-4359-80b4-f60d0c3b6867" Jun 09 15:58:21.721010 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:21.720761 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 15:58:22.087307 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.087277 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-90.ec2.internal" event="NodeReady" Jun 09 15:58:22.087488 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.087419 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 15:58:22.135175 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.134917 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sqd7v"] Jun 09 15:58:22.137627 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.137600 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9vvn8"] Jun 09 15:58:22.137773 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.137758 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.139360 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.139341 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9vvn8" Jun 09 15:58:22.140002 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.139973 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 15:58:22.140002 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.139997 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 15:58:22.140186 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.139979 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vq2xf\"" Jun 09 15:58:22.141212 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.141193 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 15:58:22.141500 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.141482 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ngbwc\"" Jun 09 15:58:22.141818 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.141696 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 15:58:22.141818 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.141736 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 15:58:22.149923 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.149831 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9vvn8"] Jun 09 15:58:22.150092 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.150037 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sqd7v"] Jun 09 15:58:22.229095 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.229059 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.229270 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.229100 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b22de8f2-811c-441c-b602-891e7f8dc8a1-tmp-dir\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.229270 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.229134 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b22de8f2-811c-441c-b602-891e7f8dc8a1-config-volume\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.229270 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.229158 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqwlh\" (UniqueName: \"kubernetes.io/projected/b22de8f2-811c-441c-b602-891e7f8dc8a1-kube-api-access-wqwlh\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.229270 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.229251 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f4d0dca-7701-42d9-9965-0d279ad988c2-cert\") pod \"ingress-canary-9vvn8\" (UID: \"6f4d0dca-7701-42d9-9965-0d279ad988c2\") " pod="openshift-ingress-canary/ingress-canary-9vvn8" Jun 09 15:58:22.229465 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.229300 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n77cm\" (UniqueName: \"kubernetes.io/projected/6f4d0dca-7701-42d9-9965-0d279ad988c2-kube-api-access-n77cm\") pod \"ingress-canary-9vvn8\" (UID: \"6f4d0dca-7701-42d9-9965-0d279ad988c2\") " pod="openshift-ingress-canary/ingress-canary-9vvn8" Jun 09 15:58:22.330380 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.330338 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f4d0dca-7701-42d9-9965-0d279ad988c2-cert\") pod \"ingress-canary-9vvn8\" (UID: \"6f4d0dca-7701-42d9-9965-0d279ad988c2\") " pod="openshift-ingress-canary/ingress-canary-9vvn8" Jun 09 15:58:22.330581 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.330404 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n77cm\" (UniqueName: \"kubernetes.io/projected/6f4d0dca-7701-42d9-9965-0d279ad988c2-kube-api-access-n77cm\") pod \"ingress-canary-9vvn8\" (UID: \"6f4d0dca-7701-42d9-9965-0d279ad988c2\") " pod="openshift-ingress-canary/ingress-canary-9vvn8" Jun 09 15:58:22.330581 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.330454 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.330581 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.330471 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b22de8f2-811c-441c-b602-891e7f8dc8a1-tmp-dir\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.330581 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.330491 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b22de8f2-811c-441c-b602-891e7f8dc8a1-config-volume\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.330581 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.330519 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqwlh\" (UniqueName: \"kubernetes.io/projected/b22de8f2-811c-441c-b602-891e7f8dc8a1-kube-api-access-wqwlh\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.330946 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.330800 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b22de8f2-811c-441c-b602-891e7f8dc8a1-tmp-dir\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.330946 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:22.330802 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:58:22.330946 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:22.330933 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls podName:b22de8f2-811c-441c-b602-891e7f8dc8a1 nodeName:}" failed. No retries permitted until 2026-06-09 15:58:22.83091375 +0000 UTC m=+36.593285261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls") pod "dns-default-sqd7v" (UID: "b22de8f2-811c-441c-b602-891e7f8dc8a1") : secret "dns-default-metrics-tls" not found Jun 09 15:58:22.331104 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.331083 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b22de8f2-811c-441c-b602-891e7f8dc8a1-config-volume\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.335530 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.335507 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f4d0dca-7701-42d9-9965-0d279ad988c2-cert\") pod \"ingress-canary-9vvn8\" (UID: \"6f4d0dca-7701-42d9-9965-0d279ad988c2\") " pod="openshift-ingress-canary/ingress-canary-9vvn8" Jun 09 15:58:22.339033 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.338971 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqwlh\" (UniqueName: \"kubernetes.io/projected/b22de8f2-811c-441c-b602-891e7f8dc8a1-kube-api-access-wqwlh\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.339255 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.339210 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n77cm\" (UniqueName: \"kubernetes.io/projected/6f4d0dca-7701-42d9-9965-0d279ad988c2-kube-api-access-n77cm\") pod \"ingress-canary-9vvn8\" (UID: \"6f4d0dca-7701-42d9-9965-0d279ad988c2\") " pod="openshift-ingress-canary/ingress-canary-9vvn8" Jun 09 15:58:22.459933 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.459894 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9vvn8" Jun 09 15:58:22.833900 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:22.833854 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:22.834524 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:22.834001 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:58:22.834524 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:22.834064 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls podName:b22de8f2-811c-441c-b602-891e7f8dc8a1 nodeName:}" failed. No retries permitted until 2026-06-09 15:58:23.834048547 +0000 UTC m=+37.596420044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls") pod "dns-default-sqd7v" (UID: "b22de8f2-811c-441c-b602-891e7f8dc8a1") : secret "dns-default-metrics-tls" not found Jun 09 15:58:23.436816 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:23.436617 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9vvn8"] Jun 09 15:58:23.440534 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:58:23.440498 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4d0dca_7701_42d9_9965_0d279ad988c2.slice/crio-dde8417c7beb64a4e587a839e992c5fb82c91b0afb702bedfe4a0d9023604cbd WatchSource:0}: Error finding container dde8417c7beb64a4e587a839e992c5fb82c91b0afb702bedfe4a0d9023604cbd: Status 404 returned error can't find the container with id dde8417c7beb64a4e587a839e992c5fb82c91b0afb702bedfe4a0d9023604cbd Jun 09 15:58:23.721136 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:23.721100 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:23.721281 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:23.721153 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:23.721281 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:23.721113 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:23.723792 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:23.723764 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mzrv4\"" Jun 09 15:58:23.724299 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:23.724261 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:58:23.724299 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:23.724288 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:58:23.724299 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:23.724293 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:58:23.724564 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:23.724275 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:58:23.724564 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:23.724383 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x96zf\"" Jun 09 15:58:23.842093 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:23.842002 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:23.842548 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:23.842163 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:58:23.842548 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:23.842236 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls podName:b22de8f2-811c-441c-b602-891e7f8dc8a1 nodeName:}" failed. No retries permitted until 2026-06-09 15:58:25.842216996 +0000 UTC m=+39.604588509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls") pod "dns-default-sqd7v" (UID: "b22de8f2-811c-441c-b602-891e7f8dc8a1") : secret "dns-default-metrics-tls" not found Jun 09 15:58:24.022779 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:24.022745 2552 generic.go:356] "Generic (PLEG): container finished" podID="34bcdd03-cb64-42f6-8ae1-02f6487f05e9" containerID="3defad79360f9c93a07d2263232702ad0e416828c81fa7fdf5395011691bb5ce" exitCode=0 Jun 09 15:58:24.022975 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:24.022843 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bd6f" event={"ID":"34bcdd03-cb64-42f6-8ae1-02f6487f05e9","Type":"ContainerDied","Data":"3defad79360f9c93a07d2263232702ad0e416828c81fa7fdf5395011691bb5ce"} Jun 09 15:58:24.024222 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:24.024187 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9vvn8" event={"ID":"6f4d0dca-7701-42d9-9965-0d279ad988c2","Type":"ContainerStarted","Data":"dde8417c7beb64a4e587a839e992c5fb82c91b0afb702bedfe4a0d9023604cbd"} Jun 09 15:58:25.032521 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:25.032482 2552 generic.go:356] "Generic (PLEG): container finished" podID="34bcdd03-cb64-42f6-8ae1-02f6487f05e9" containerID="63c722c4f43430112c783b4e7e175cf414120eff85156de8d206e7dd62cd82ff" exitCode=0 Jun 09 15:58:25.033027 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:25.032518 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bd6f" event={"ID":"34bcdd03-cb64-42f6-8ae1-02f6487f05e9","Type":"ContainerDied","Data":"63c722c4f43430112c783b4e7e175cf414120eff85156de8d206e7dd62cd82ff"} Jun 09 15:58:25.859490 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:25.859449 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:25.859679 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:25.859652 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:58:25.859766 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:25.859745 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls podName:b22de8f2-811c-441c-b602-891e7f8dc8a1 nodeName:}" failed. No retries permitted until 2026-06-09 15:58:29.859723308 +0000 UTC m=+43.622094815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls") pod "dns-default-sqd7v" (UID: "b22de8f2-811c-441c-b602-891e7f8dc8a1") : secret "dns-default-metrics-tls" not found Jun 09 15:58:26.038694 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:26.038663 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bd6f" event={"ID":"34bcdd03-cb64-42f6-8ae1-02f6487f05e9","Type":"ContainerStarted","Data":"1b3074a9df297a4dbf09d876545f3b29b0403465a3d573d975faffd178b6b618"} Jun 09 15:58:26.040058 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:26.040036 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9vvn8" event={"ID":"6f4d0dca-7701-42d9-9965-0d279ad988c2","Type":"ContainerStarted","Data":"7957d8563060e0fe33419af2e2fb02c387970d400d77fa4245e9b890b759dd61"} Jun 09 15:58:26.058779 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:26.058730 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5bd6f" podStartSLOduration=9.519004062 podStartE2EDuration="40.05869211s" totalImagesPullingTime="30.539688048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:57:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:26.057927999 +0000 UTC m=+39.820299523" watchObservedRunningTime="2026-06-09 15:58:26.05869211 +0000 UTC m=+39.821063629" Jun 09 15:58:26.071493 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:26.071441 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9vvn8" podStartSLOduration=2.279322005 podStartE2EDuration="4.071424756s" totalImagesPullingTime="1.792102751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:26.07107504 +0000 UTC m=+39.833446574" watchObservedRunningTime="2026-06-09 15:58:26.071424756 +0000 UTC m=+39.833796276" Jun 09 15:58:29.888979 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:29.888935 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:29.889413 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:29.889095 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:58:29.889413 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:29.889161 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls podName:b22de8f2-811c-441c-b602-891e7f8dc8a1 nodeName:}" failed. No retries permitted until 2026-06-09 15:58:37.889145479 +0000 UTC m=+51.651516981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls") pod "dns-default-sqd7v" (UID: "b22de8f2-811c-441c-b602-891e7f8dc8a1") : secret "dns-default-metrics-tls" not found Jun 09 15:58:37.947405 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:37.947359 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:37.947922 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:37.947523 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:58:37.947922 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:37.947598 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls podName:b22de8f2-811c-441c-b602-891e7f8dc8a1 nodeName:}" failed. No retries permitted until 2026-06-09 15:58:53.947581615 +0000 UTC m=+67.709953114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls") pod "dns-default-sqd7v" (UID: "b22de8f2-811c-441c-b602-891e7f8dc8a1") : secret "dns-default-metrics-tls" not found Jun 09 15:58:48.011477 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:48.011449 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bgvmw" Jun 09 15:58:51.543946 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.543852 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:58:51.543946 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.543959 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:51.546352 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.546332 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:58:51.546399 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.546335 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:58:51.554940 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:51.554921 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:58:51.555007 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:51.554983 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs podName:7cccabbb-102d-4dd3-b772-af5ece21429f nodeName:}" failed. No retries permitted until 2026-06-09 15:59:55.554966254 +0000 UTC m=+129.317337752 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs") pod "network-metrics-daemon-sls78" (UID: "7cccabbb-102d-4dd3-b772-af5ece21429f") : secret "metrics-daemon-secret" not found Jun 09 15:58:51.558427 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.558400 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a22ce0-7c31-4359-80b4-f60d0c3b6867-original-pull-secret\") pod \"global-pull-secret-syncer-78c48\" (UID: \"60a22ce0-7c31-4359-80b4-f60d0c3b6867\") " pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:51.639087 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.639031 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78c48" Jun 09 15:58:51.644488 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.644459 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rdk\" (UniqueName: \"kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk\") pod \"network-check-target-6hlgk\" (UID: \"3ce16e3d-4739-4cd1-8db0-7a049e3d1208\") " pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:51.646945 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.646926 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:58:51.657286 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.657254 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:58:51.667321 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.667294 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6rdk\" (UniqueName: \"kubernetes.io/projected/3ce16e3d-4739-4cd1-8db0-7a049e3d1208-kube-api-access-d6rdk\") pod \"network-check-target-6hlgk\" (UID: \"3ce16e3d-4739-4cd1-8db0-7a049e3d1208\") " pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:51.770696 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.770660 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-78c48"] Jun 09 15:58:51.774281 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:58:51.774253 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a22ce0_7c31_4359_80b4_f60d0c3b6867.slice/crio-440e174c228df86a5a8eb7ac47f6e77716c6dcb111560f4e46146bf78fcddec1 WatchSource:0}: Error finding container 440e174c228df86a5a8eb7ac47f6e77716c6dcb111560f4e46146bf78fcddec1: Status 404 returned error can't find the container with id 440e174c228df86a5a8eb7ac47f6e77716c6dcb111560f4e46146bf78fcddec1 Jun 09 15:58:51.935079 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.935050 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x96zf\"" Jun 09 15:58:51.943639 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:51.943614 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:52.069235 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:52.069173 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6hlgk"] Jun 09 15:58:52.072599 ip-10-0-129-90 kubenswrapper[2552]: W0609 15:58:52.072569 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce16e3d_4739_4cd1_8db0_7a049e3d1208.slice/crio-592069408cdb6ae8e10556cade93ac158a8bedc53b668bbc7970f86f994e4881 WatchSource:0}: Error finding container 592069408cdb6ae8e10556cade93ac158a8bedc53b668bbc7970f86f994e4881: Status 404 returned error can't find the container with id 592069408cdb6ae8e10556cade93ac158a8bedc53b668bbc7970f86f994e4881 Jun 09 15:58:52.103370 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:52.103333 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6hlgk" event={"ID":"3ce16e3d-4739-4cd1-8db0-7a049e3d1208","Type":"ContainerStarted","Data":"592069408cdb6ae8e10556cade93ac158a8bedc53b668bbc7970f86f994e4881"} Jun 09 15:58:52.104443 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:52.104419 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-78c48" event={"ID":"60a22ce0-7c31-4359-80b4-f60d0c3b6867","Type":"ContainerStarted","Data":"440e174c228df86a5a8eb7ac47f6e77716c6dcb111560f4e46146bf78fcddec1"} Jun 09 15:58:53.961189 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:53.961150 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:58:53.961616 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:53.961325 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:58:53.961616 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:58:53.961411 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls podName:b22de8f2-811c-441c-b602-891e7f8dc8a1 nodeName:}" failed. No retries permitted until 2026-06-09 15:59:25.961388398 +0000 UTC m=+99.723759911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls") pod "dns-default-sqd7v" (UID: "b22de8f2-811c-441c-b602-891e7f8dc8a1") : secret "dns-default-metrics-tls" not found Jun 09 15:58:57.119683 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:57.119646 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-78c48" event={"ID":"60a22ce0-7c31-4359-80b4-f60d0c3b6867","Type":"ContainerStarted","Data":"ed819a4418ca78546c06a2f3fe2540b760f99a65fad1eb47adc4e1ce2283ce47"} Jun 09 15:58:57.121182 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:57.121160 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6hlgk" event={"ID":"3ce16e3d-4739-4cd1-8db0-7a049e3d1208","Type":"ContainerStarted","Data":"17b88fb2e3f7c9b8a6ddf2aabc06826f41baaf4da223415723d6b4c7236eed21"} Jun 09 15:58:57.121311 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:57.121294 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:58:57.137558 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:57.137484 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-78c48" podStartSLOduration=66.458531382 podStartE2EDuration="1m11.137464118s" totalImagesPullingTime="4.678932736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:57.136946592 +0000 UTC m=+70.899318112" watchObservedRunningTime="2026-06-09 15:58:57.137464118 +0000 UTC m=+70.899835639" Jun 09 15:58:57.159263 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:58:57.159213 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6hlgk" podStartSLOduration=66.781990363 podStartE2EDuration="1m11.159197464s" totalImagesPullingTime="4.377207101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:58:57.159111629 +0000 UTC m=+70.921483173" watchObservedRunningTime="2026-06-09 15:58:57.159197464 +0000 UTC m=+70.921568961" Jun 09 15:59:25.981156 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:59:25.981120 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 15:59:25.981509 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:59:25.981262 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:59:25.981509 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:59:25.981319 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls podName:b22de8f2-811c-441c-b602-891e7f8dc8a1 nodeName:}" failed. No retries permitted until 2026-06-09 16:00:29.981305053 +0000 UTC m=+163.743676550 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls") pod "dns-default-sqd7v" (UID: "b22de8f2-811c-441c-b602-891e7f8dc8a1") : secret "dns-default-metrics-tls" not found Jun 09 15:59:28.126637 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:59:28.126603 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6hlgk" Jun 09 15:59:55.579229 ip-10-0-129-90 kubenswrapper[2552]: I0609 15:59:55.579169 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 15:59:55.579712 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:59:55.579334 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:59:55.579712 ip-10-0-129-90 kubenswrapper[2552]: E0609 15:59:55.579415 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs podName:7cccabbb-102d-4dd3-b772-af5ece21429f nodeName:}" failed. No retries permitted until 2026-06-09 16:01:57.579397098 +0000 UTC m=+251.341768596 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs") pod "network-metrics-daemon-sls78" (UID: "7cccabbb-102d-4dd3-b772-af5ece21429f") : secret "metrics-daemon-secret" not found Jun 09 16:00:25.154145 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:00:25.154041 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sqd7v" podUID="b22de8f2-811c-441c-b602-891e7f8dc8a1" Jun 09 16:00:25.327910 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:00:25.327855 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sqd7v" Jun 09 16:00:26.744140 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:00:26.744104 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sls78" podUID="7cccabbb-102d-4dd3-b772-af5ece21429f" Jun 09 16:00:30.009886 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:00:30.009824 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 16:00:30.010300 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:00:30.009992 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 16:00:30.010300 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:00:30.010063 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls podName:b22de8f2-811c-441c-b602-891e7f8dc8a1 nodeName:}" failed. No retries permitted until 2026-06-09 16:02:32.010046201 +0000 UTC m=+285.772417713 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls") pod "dns-default-sqd7v" (UID: "b22de8f2-811c-441c-b602-891e7f8dc8a1") : secret "dns-default-metrics-tls" not found Jun 09 16:00:40.721017 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:00:40.720967 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 16:01:35.800150 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.800112 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl"] Jun 09 16:01:35.801925 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.801904 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:35.804803 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.804780 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c"] Jun 09 16:01:35.805161 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.805128 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wdc79\"" Jun 09 16:01:35.805291 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.805173 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 16:01:35.805291 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.805255 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 16:01:35.805291 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.805270 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 16:01:35.805490 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.805388 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 16:01:35.806472 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.806458 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" Jun 09 16:01:35.808172 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.808154 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m84t5\"" Jun 09 16:01:35.808462 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.808428 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 16:01:35.808571 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.808438 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 16:01:35.808740 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.808723 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 16:01:35.809198 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.809184 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 16:01:35.819536 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.819510 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl"] Jun 09 16:01:35.823035 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.823004 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c"] Jun 09 16:01:35.877088 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.877047 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg8db\" (UniqueName: \"kubernetes.io/projected/46bcf61b-ac98-490e-af9a-93e6e936f7cb-kube-api-access-gg8db\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tvg7c\" (UID: \"46bcf61b-ac98-490e-af9a-93e6e936f7cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" Jun 09 16:01:35.877265 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.877112 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c110805c-1587-445b-b71b-2a2a4a7bb10a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:35.877265 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.877133 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:35.877265 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.877164 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46bcf61b-ac98-490e-af9a-93e6e936f7cb-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tvg7c\" (UID: \"46bcf61b-ac98-490e-af9a-93e6e936f7cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" Jun 09 16:01:35.877265 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.877181 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46bcf61b-ac98-490e-af9a-93e6e936f7cb-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tvg7c\" (UID: \"46bcf61b-ac98-490e-af9a-93e6e936f7cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" Jun 09 16:01:35.877265 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.877197 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcdgf\" (UniqueName: \"kubernetes.io/projected/c110805c-1587-445b-b71b-2a2a4a7bb10a-kube-api-access-qcdgf\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:35.885916 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.885853 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt"] Jun 09 16:01:35.887917 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.887895 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" Jun 09 16:01:35.889976 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.889956 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 16:01:35.890179 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.890166 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2m8d6\"" Jun 09 16:01:35.890222 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.890186 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 16:01:35.890222 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.890170 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 16:01:35.890606 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.890586 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 16:01:35.892275 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.892251 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq"] Jun 09 16:01:35.894558 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.894543 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-mv8nq"] Jun 09 16:01:35.894681 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.894665 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:35.896271 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.896254 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78bd4c8b96-lkbgs"] Jun 09 16:01:35.896427 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.896376 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mv8nq" Jun 09 16:01:35.896516 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.896446 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 16:01:35.896633 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.896618 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 16:01:35.897171 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.897152 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 16:01:35.898137 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.898116 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:35.898967 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.898937 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4jsb6\"" Jun 09 16:01:35.899068 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.898965 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-trkpg\"" Jun 09 16:01:35.899634 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.899612 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt"] Jun 09 16:01:35.900134 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.900105 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6sg9d\"" Jun 09 16:01:35.900225 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.900136 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 16:01:35.900225 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.900141 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 16:01:35.900225 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.900153 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 16:01:35.910901 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.910146 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 16:01:35.910901 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.910200 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq"] Jun 09 16:01:35.911402 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.911381 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-mv8nq"] Jun 09 16:01:35.912571 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.912550 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78bd4c8b96-lkbgs"] Jun 09 16:01:35.978201 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978164 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-installation-pull-secrets\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:35.978201 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978202 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea817a23-a81e-421c-8d71-5ac82251577c-config\") pod \"service-ca-operator-6bc5ff68f5-x5btt\" (UID: \"ea817a23-a81e-421c-8d71-5ac82251577c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" Jun 09 16:01:35.978407 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978226 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-ca-trust-extracted\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:35.978407 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978273 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-certificates\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:35.978407 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978331 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-trusted-ca\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:35.978407 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978355 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rv6s\" (UniqueName: \"kubernetes.io/projected/4f7e237a-1986-4a26-958f-aeb04c91af88-kube-api-access-6rv6s\") pod \"cluster-samples-operator-854f8b96b6-xxqvq\" (UID: \"4f7e237a-1986-4a26-958f-aeb04c91af88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:35.978534 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978421 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c110805c-1587-445b-b71b-2a2a4a7bb10a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:35.978534 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978439 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87zk5\" (UniqueName: \"kubernetes.io/projected/331bb2b6-a530-4028-9376-a752c169e830-kube-api-access-87zk5\") pod \"network-check-source-dbd9cf844-mv8nq\" (UID: \"331bb2b6-a530-4028-9376-a752c169e830\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mv8nq" Jun 09 16:01:35.978534 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978457 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:35.978534 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978515 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea817a23-a81e-421c-8d71-5ac82251577c-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-x5btt\" (UID: \"ea817a23-a81e-421c-8d71-5ac82251577c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" Jun 09 16:01:35.978664 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:35.978532 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 16:01:35.978664 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978550 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46bcf61b-ac98-490e-af9a-93e6e936f7cb-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tvg7c\" (UID: \"46bcf61b-ac98-490e-af9a-93e6e936f7cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" Jun 09 16:01:35.978664 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:35.978583 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls podName:c110805c-1587-445b-b71b-2a2a4a7bb10a nodeName:}" failed. No retries permitted until 2026-06-09 16:01:36.478567054 +0000 UTC m=+230.240938552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-twdnl" (UID: "c110805c-1587-445b-b71b-2a2a4a7bb10a") : secret "cluster-monitoring-operator-tls" not found Jun 09 16:01:35.978664 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978601 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-bound-sa-token\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:35.978664 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978626 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gldsw\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-kube-api-access-gldsw\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:35.978664 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978654 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-image-registry-private-configuration\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:35.978944 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978678 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvgc6\" (UniqueName: \"kubernetes.io/projected/ea817a23-a81e-421c-8d71-5ac82251577c-kube-api-access-bvgc6\") pod \"service-ca-operator-6bc5ff68f5-x5btt\" (UID: \"ea817a23-a81e-421c-8d71-5ac82251577c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" Jun 09 16:01:35.978944 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978710 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46bcf61b-ac98-490e-af9a-93e6e936f7cb-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tvg7c\" (UID: \"46bcf61b-ac98-490e-af9a-93e6e936f7cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" Jun 09 16:01:35.978944 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978757 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcdgf\" (UniqueName: \"kubernetes.io/projected/c110805c-1587-445b-b71b-2a2a4a7bb10a-kube-api-access-qcdgf\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:35.978944 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978913 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:35.979140 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978950 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xxqvq\" (UID: \"4f7e237a-1986-4a26-958f-aeb04c91af88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:35.979140 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.978995 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg8db\" (UniqueName: \"kubernetes.io/projected/46bcf61b-ac98-490e-af9a-93e6e936f7cb-kube-api-access-gg8db\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tvg7c\" (UID: \"46bcf61b-ac98-490e-af9a-93e6e936f7cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" Jun 09 16:01:35.979252 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.979227 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/46bcf61b-ac98-490e-af9a-93e6e936f7cb-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tvg7c\" (UID: \"46bcf61b-ac98-490e-af9a-93e6e936f7cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" Jun 09 16:01:35.979312 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.979291 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c110805c-1587-445b-b71b-2a2a4a7bb10a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:35.980819 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.980796 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46bcf61b-ac98-490e-af9a-93e6e936f7cb-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tvg7c\" (UID: \"46bcf61b-ac98-490e-af9a-93e6e936f7cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" Jun 09 16:01:35.989346 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.989318 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg8db\" (UniqueName: \"kubernetes.io/projected/46bcf61b-ac98-490e-af9a-93e6e936f7cb-kube-api-access-gg8db\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-tvg7c\" (UID: \"46bcf61b-ac98-490e-af9a-93e6e936f7cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" Jun 09 16:01:35.989490 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:35.989468 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcdgf\" (UniqueName: \"kubernetes.io/projected/c110805c-1587-445b-b71b-2a2a4a7bb10a-kube-api-access-qcdgf\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:36.079525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079431 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.079525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079469 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xxqvq\" (UID: \"4f7e237a-1986-4a26-958f-aeb04c91af88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:36.079525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079508 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-installation-pull-secrets\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.079804 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079531 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea817a23-a81e-421c-8d71-5ac82251577c-config\") pod \"service-ca-operator-6bc5ff68f5-x5btt\" (UID: \"ea817a23-a81e-421c-8d71-5ac82251577c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" Jun 09 16:01:36.079804 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079561 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-ca-trust-extracted\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.079804 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079585 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-certificates\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.079804 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:36.079593 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 16:01:36.079804 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079607 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-trusted-ca\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.079804 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079630 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rv6s\" (UniqueName: \"kubernetes.io/projected/4f7e237a-1986-4a26-958f-aeb04c91af88-kube-api-access-6rv6s\") pod \"cluster-samples-operator-854f8b96b6-xxqvq\" (UID: \"4f7e237a-1986-4a26-958f-aeb04c91af88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:36.079804 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:36.079596 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 16:01:36.079804 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:36.079670 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls podName:4f7e237a-1986-4a26-958f-aeb04c91af88 nodeName:}" failed. No retries permitted until 2026-06-09 16:01:36.579649033 +0000 UTC m=+230.342020533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xxqvq" (UID: "4f7e237a-1986-4a26-958f-aeb04c91af88") : secret "samples-operator-tls" not found Jun 09 16:01:36.079804 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:36.079680 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78bd4c8b96-lkbgs: secret "image-registry-tls" not found Jun 09 16:01:36.079804 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079711 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87zk5\" (UniqueName: \"kubernetes.io/projected/331bb2b6-a530-4028-9376-a752c169e830-kube-api-access-87zk5\") pod \"network-check-source-dbd9cf844-mv8nq\" (UID: \"331bb2b6-a530-4028-9376-a752c169e830\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mv8nq" Jun 09 16:01:36.079804 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:36.079753 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls podName:d8895b15-f3c4-4c16-8eaf-8586cf81e70c nodeName:}" failed. No retries permitted until 2026-06-09 16:01:36.579734515 +0000 UTC m=+230.342106022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls") pod "image-registry-78bd4c8b96-lkbgs" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c") : secret "image-registry-tls" not found Jun 09 16:01:36.080388 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079820 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea817a23-a81e-421c-8d71-5ac82251577c-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-x5btt\" (UID: \"ea817a23-a81e-421c-8d71-5ac82251577c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" Jun 09 16:01:36.080388 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079855 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-bound-sa-token\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.080388 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079904 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gldsw\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-kube-api-access-gldsw\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.080388 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079937 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-image-registry-private-configuration\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.080388 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.079977 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvgc6\" (UniqueName: \"kubernetes.io/projected/ea817a23-a81e-421c-8d71-5ac82251577c-kube-api-access-bvgc6\") pod \"service-ca-operator-6bc5ff68f5-x5btt\" (UID: \"ea817a23-a81e-421c-8d71-5ac82251577c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" Jun 09 16:01:36.080388 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.080049 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-ca-trust-extracted\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.080388 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.080264 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea817a23-a81e-421c-8d71-5ac82251577c-config\") pod \"service-ca-operator-6bc5ff68f5-x5btt\" (UID: \"ea817a23-a81e-421c-8d71-5ac82251577c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" Jun 09 16:01:36.080388 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.080333 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-certificates\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.080690 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.080669 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-trusted-ca\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.082396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.082368 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea817a23-a81e-421c-8d71-5ac82251577c-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-x5btt\" (UID: \"ea817a23-a81e-421c-8d71-5ac82251577c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" Jun 09 16:01:36.082396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.082379 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-image-registry-private-configuration\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.082526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.082401 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-installation-pull-secrets\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.089313 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.089288 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87zk5\" (UniqueName: \"kubernetes.io/projected/331bb2b6-a530-4028-9376-a752c169e830-kube-api-access-87zk5\") pod \"network-check-source-dbd9cf844-mv8nq\" (UID: \"331bb2b6-a530-4028-9376-a752c169e830\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mv8nq" Jun 09 16:01:36.089481 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.089455 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rv6s\" (UniqueName: \"kubernetes.io/projected/4f7e237a-1986-4a26-958f-aeb04c91af88-kube-api-access-6rv6s\") pod \"cluster-samples-operator-854f8b96b6-xxqvq\" (UID: \"4f7e237a-1986-4a26-958f-aeb04c91af88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:36.090017 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.089998 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gldsw\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-kube-api-access-gldsw\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.090017 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.090021 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvgc6\" (UniqueName: \"kubernetes.io/projected/ea817a23-a81e-421c-8d71-5ac82251577c-kube-api-access-bvgc6\") pod \"service-ca-operator-6bc5ff68f5-x5btt\" (UID: \"ea817a23-a81e-421c-8d71-5ac82251577c\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" Jun 09 16:01:36.090333 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.090317 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-bound-sa-token\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.117482 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.117434 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" Jun 09 16:01:36.198140 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.198114 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" Jun 09 16:01:36.214431 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.214321 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mv8nq" Jun 09 16:01:36.247478 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.247396 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c"] Jun 09 16:01:36.333575 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.333479 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt"] Jun 09 16:01:36.337803 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:01:36.337778 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea817a23_a81e_421c_8d71_5ac82251577c.slice/crio-e6bdb012c29161918e1ce5241ea4da4878956d892560af01daa3d3f2cf366689 WatchSource:0}: Error finding container e6bdb012c29161918e1ce5241ea4da4878956d892560af01daa3d3f2cf366689: Status 404 returned error can't find the container with id e6bdb012c29161918e1ce5241ea4da4878956d892560af01daa3d3f2cf366689 Jun 09 16:01:36.350141 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.350109 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-mv8nq"] Jun 09 16:01:36.354147 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:01:36.354121 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod331bb2b6_a530_4028_9376_a752c169e830.slice/crio-de28d736cda97be63fde1bcfd0ad7d2e42b812a10ce505ab167e6fccba6c9f4e WatchSource:0}: Error finding container de28d736cda97be63fde1bcfd0ad7d2e42b812a10ce505ab167e6fccba6c9f4e: Status 404 returned error can't find the container with id de28d736cda97be63fde1bcfd0ad7d2e42b812a10ce505ab167e6fccba6c9f4e Jun 09 16:01:36.482998 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.482958 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:36.483172 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:36.483106 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 16:01:36.483217 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:36.483176 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls podName:c110805c-1587-445b-b71b-2a2a4a7bb10a nodeName:}" failed. No retries permitted until 2026-06-09 16:01:37.483160031 +0000 UTC m=+231.245531533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-twdnl" (UID: "c110805c-1587-445b-b71b-2a2a4a7bb10a") : secret "cluster-monitoring-operator-tls" not found Jun 09 16:01:36.502025 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.501991 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" event={"ID":"46bcf61b-ac98-490e-af9a-93e6e936f7cb","Type":"ContainerStarted","Data":"d238711e3d991d5c42b2bd61cf83f38dc9a1d25d6f27748c5ca5d64dbe08a920"} Jun 09 16:01:36.503183 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.503160 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" event={"ID":"ea817a23-a81e-421c-8d71-5ac82251577c","Type":"ContainerStarted","Data":"e6bdb012c29161918e1ce5241ea4da4878956d892560af01daa3d3f2cf366689"} Jun 09 16:01:36.504544 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.504517 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mv8nq" event={"ID":"331bb2b6-a530-4028-9376-a752c169e830","Type":"ContainerStarted","Data":"2b06a1dec1b55583970dc3a2a13267d17da2dfdf5ff5c07f51934cc336996cbe"} Jun 09 16:01:36.504648 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.504563 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mv8nq" event={"ID":"331bb2b6-a530-4028-9376-a752c169e830","Type":"ContainerStarted","Data":"de28d736cda97be63fde1bcfd0ad7d2e42b812a10ce505ab167e6fccba6c9f4e"} Jun 09 16:01:36.519274 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.519226 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-mv8nq" podStartSLOduration=1.5192105809999998 podStartE2EDuration="1.519210581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:01:36.518171305 +0000 UTC m=+230.280542828" watchObservedRunningTime="2026-06-09 16:01:36.519210581 +0000 UTC m=+230.281582104" Jun 09 16:01:36.584354 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.584249 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:36.584354 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:36.584292 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xxqvq\" (UID: \"4f7e237a-1986-4a26-958f-aeb04c91af88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:36.584594 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:36.584430 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 16:01:36.584594 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:36.584454 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78bd4c8b96-lkbgs: secret "image-registry-tls" not found Jun 09 16:01:36.584594 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:36.584460 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 16:01:36.584594 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:36.584526 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls podName:d8895b15-f3c4-4c16-8eaf-8586cf81e70c nodeName:}" failed. No retries permitted until 2026-06-09 16:01:37.584505604 +0000 UTC m=+231.346877101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls") pod "image-registry-78bd4c8b96-lkbgs" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c") : secret "image-registry-tls" not found Jun 09 16:01:36.584594 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:36.584548 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls podName:4f7e237a-1986-4a26-958f-aeb04c91af88 nodeName:}" failed. No retries permitted until 2026-06-09 16:01:37.584536782 +0000 UTC m=+231.346908321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xxqvq" (UID: "4f7e237a-1986-4a26-958f-aeb04c91af88") : secret "samples-operator-tls" not found Jun 09 16:01:37.493457 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:37.493412 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:37.493889 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:37.493590 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 16:01:37.493889 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:37.493687 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls podName:c110805c-1587-445b-b71b-2a2a4a7bb10a nodeName:}" failed. No retries permitted until 2026-06-09 16:01:39.493667588 +0000 UTC m=+233.256039090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-twdnl" (UID: "c110805c-1587-445b-b71b-2a2a4a7bb10a") : secret "cluster-monitoring-operator-tls" not found Jun 09 16:01:37.594659 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:37.594616 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:37.594659 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:37.594660 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xxqvq\" (UID: \"4f7e237a-1986-4a26-958f-aeb04c91af88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:37.594888 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:37.594780 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 16:01:37.594888 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:37.594804 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78bd4c8b96-lkbgs: secret "image-registry-tls" not found Jun 09 16:01:37.594888 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:37.594827 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 16:01:37.594888 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:37.594888 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls podName:4f7e237a-1986-4a26-958f-aeb04c91af88 nodeName:}" failed. No retries permitted until 2026-06-09 16:01:39.594852489 +0000 UTC m=+233.357223987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xxqvq" (UID: "4f7e237a-1986-4a26-958f-aeb04c91af88") : secret "samples-operator-tls" not found Jun 09 16:01:37.595100 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:37.594909 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls podName:d8895b15-f3c4-4c16-8eaf-8586cf81e70c nodeName:}" failed. No retries permitted until 2026-06-09 16:01:39.594896311 +0000 UTC m=+233.357267809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls") pod "image-registry-78bd4c8b96-lkbgs" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c") : secret "image-registry-tls" not found Jun 09 16:01:39.511270 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:39.511234 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:39.511675 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:39.511407 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 16:01:39.511675 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:39.511490 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls podName:c110805c-1587-445b-b71b-2a2a4a7bb10a nodeName:}" failed. No retries permitted until 2026-06-09 16:01:43.511468684 +0000 UTC m=+237.273840195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-twdnl" (UID: "c110805c-1587-445b-b71b-2a2a4a7bb10a") : secret "cluster-monitoring-operator-tls" not found Jun 09 16:01:39.515827 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:39.515792 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" event={"ID":"46bcf61b-ac98-490e-af9a-93e6e936f7cb","Type":"ContainerStarted","Data":"2ad27020c7438bfec5b6e3e26c842b0a04c258e4d51be3ca09d756d0dd168cc9"} Jun 09 16:01:39.517407 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:39.517383 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" event={"ID":"ea817a23-a81e-421c-8d71-5ac82251577c","Type":"ContainerStarted","Data":"81012d1d99816188ed1a03d39e73dca5e4dd677205c52909bee5caf0ae0d8ae9"} Jun 09 16:01:39.530232 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:39.530178 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" podStartSLOduration=1.853470761 podStartE2EDuration="4.530163232s" totalImagesPullingTime="2.676692471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:01:39.529259238 +0000 UTC m=+233.291630760" watchObservedRunningTime="2026-06-09 16:01:39.530163232 +0000 UTC m=+233.292534752" Jun 09 16:01:39.542568 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:39.542509 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" podStartSLOduration=1.950951586 podStartE2EDuration="4.542489415s" totalImagesPullingTime="2.591537829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:01:39.542284413 +0000 UTC m=+233.304655955" watchObservedRunningTime="2026-06-09 16:01:39.542489415 +0000 UTC m=+233.304860936" Jun 09 16:01:39.611785 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:39.611744 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:39.612002 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:39.611799 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xxqvq\" (UID: \"4f7e237a-1986-4a26-958f-aeb04c91af88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:39.612002 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:39.611886 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 16:01:39.612002 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:39.611910 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78bd4c8b96-lkbgs: secret "image-registry-tls" not found Jun 09 16:01:39.612002 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:39.611939 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 16:01:39.612002 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:39.611978 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls podName:d8895b15-f3c4-4c16-8eaf-8586cf81e70c nodeName:}" failed. No retries permitted until 2026-06-09 16:01:43.611956672 +0000 UTC m=+237.374328173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls") pod "image-registry-78bd4c8b96-lkbgs" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c") : secret "image-registry-tls" not found Jun 09 16:01:39.612689 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:39.612541 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls podName:4f7e237a-1986-4a26-958f-aeb04c91af88 nodeName:}" failed. No retries permitted until 2026-06-09 16:01:43.612519474 +0000 UTC m=+237.374890984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xxqvq" (UID: "4f7e237a-1986-4a26-958f-aeb04c91af88") : secret "samples-operator-tls" not found Jun 09 16:01:43.544655 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:43.544616 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:43.545084 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:43.544776 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 16:01:43.545084 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:43.544856 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls podName:c110805c-1587-445b-b71b-2a2a4a7bb10a nodeName:}" failed. No retries permitted until 2026-06-09 16:01:51.544837311 +0000 UTC m=+245.307208832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-twdnl" (UID: "c110805c-1587-445b-b71b-2a2a4a7bb10a") : secret "cluster-monitoring-operator-tls" not found Jun 09 16:01:43.594583 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:43.594557 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hrjwl_72560997-9dd8-4a00-b6fa-46956d8a83ba/dns-node-resolver/0.log" Jun 09 16:01:43.645602 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:43.645554 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:43.645602 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:43.645603 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xxqvq\" (UID: \"4f7e237a-1986-4a26-958f-aeb04c91af88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:43.645818 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:43.645693 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 16:01:43.645818 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:43.645698 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 16:01:43.645818 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:43.645715 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78bd4c8b96-lkbgs: secret "image-registry-tls" not found Jun 09 16:01:43.645818 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:43.645748 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls podName:4f7e237a-1986-4a26-958f-aeb04c91af88 nodeName:}" failed. No retries permitted until 2026-06-09 16:01:51.645732445 +0000 UTC m=+245.408103942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xxqvq" (UID: "4f7e237a-1986-4a26-958f-aeb04c91af88") : secret "samples-operator-tls" not found Jun 09 16:01:43.645818 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:43.645761 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls podName:d8895b15-f3c4-4c16-8eaf-8586cf81e70c nodeName:}" failed. No retries permitted until 2026-06-09 16:01:51.645754761 +0000 UTC m=+245.408126258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls") pod "image-registry-78bd4c8b96-lkbgs" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c") : secret "image-registry-tls" not found Jun 09 16:01:44.794785 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:44.794755 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pf7mr_24727568-0efb-4a24-9df1-0e2d64e92576/node-ca/0.log" Jun 09 16:01:45.194989 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:45.194969 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9vvn8_6f4d0dca-7701-42d9-9965-0d279ad988c2/serve-healthcheck-canary/0.log" Jun 09 16:01:46.196758 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:46.196724 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-tvg7c_46bcf61b-ac98-490e-af9a-93e6e936f7cb/kube-storage-version-migrator-operator/0.log" Jun 09 16:01:51.607928 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:51.607887 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:01:51.608327 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:51.607974 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 16:01:51.608327 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:01:51.608058 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls podName:c110805c-1587-445b-b71b-2a2a4a7bb10a nodeName:}" failed. No retries permitted until 2026-06-09 16:02:07.608041493 +0000 UTC m=+261.370412991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-twdnl" (UID: "c110805c-1587-445b-b71b-2a2a4a7bb10a") : secret "cluster-monitoring-operator-tls" not found Jun 09 16:01:51.708546 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:51.708507 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:51.708546 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:51.708546 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xxqvq\" (UID: \"4f7e237a-1986-4a26-958f-aeb04c91af88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:51.711058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:51.711028 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls\") pod \"image-registry-78bd4c8b96-lkbgs\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:51.711184 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:51.711098 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f7e237a-1986-4a26-958f-aeb04c91af88-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xxqvq\" (UID: \"4f7e237a-1986-4a26-958f-aeb04c91af88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:51.808012 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:51.807964 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4jsb6\"" Jun 09 16:01:51.816424 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:51.816391 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" Jun 09 16:01:51.821158 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:51.821135 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6sg9d\"" Jun 09 16:01:51.829833 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:51.829805 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:51.954141 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:51.954106 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq"] Jun 09 16:01:51.973545 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:51.973511 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78bd4c8b96-lkbgs"] Jun 09 16:01:51.977985 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:01:51.977955 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8895b15_f3c4_4c16_8eaf_8586cf81e70c.slice/crio-12f945ad9801666a45c710a8a80081fe16f5ddb1793cc6473988bb91318d2750 WatchSource:0}: Error finding container 12f945ad9801666a45c710a8a80081fe16f5ddb1793cc6473988bb91318d2750: Status 404 returned error can't find the container with id 12f945ad9801666a45c710a8a80081fe16f5ddb1793cc6473988bb91318d2750 Jun 09 16:01:52.564399 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:52.564359 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" event={"ID":"d8895b15-f3c4-4c16-8eaf-8586cf81e70c","Type":"ContainerStarted","Data":"b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c"} Jun 09 16:01:52.564609 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:52.564437 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:01:52.564609 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:52.564457 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" event={"ID":"d8895b15-f3c4-4c16-8eaf-8586cf81e70c","Type":"ContainerStarted","Data":"12f945ad9801666a45c710a8a80081fe16f5ddb1793cc6473988bb91318d2750"} Jun 09 16:01:52.565643 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:52.565604 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" event={"ID":"4f7e237a-1986-4a26-958f-aeb04c91af88","Type":"ContainerStarted","Data":"a9e85aba8d2879eca78c16d340e0da719c1c09f17806b56246bce6f8734d21c2"} Jun 09 16:01:52.583598 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:52.583540 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" podStartSLOduration=17.583515059 podStartE2EDuration="17.583515059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:01:52.581900206 +0000 UTC m=+246.344271973" watchObservedRunningTime="2026-06-09 16:01:52.583515059 +0000 UTC m=+246.345886580" Jun 09 16:01:54.572785 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:54.572742 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" event={"ID":"4f7e237a-1986-4a26-958f-aeb04c91af88","Type":"ContainerStarted","Data":"4b331dd3eb0429f7a48a9a10e714a6238078bfecd08940c8fd7b111d08072b81"} Jun 09 16:01:54.573274 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:54.572807 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" event={"ID":"4f7e237a-1986-4a26-958f-aeb04c91af88","Type":"ContainerStarted","Data":"87c0989efe65b694610bca6246f11fc540436f1e5f8b7c1a42c7085bf6a898ec"} Jun 09 16:01:54.588637 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:54.588586 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xxqvq" podStartSLOduration=17.603792886 podStartE2EDuration="19.588570029s" totalImagesPullingTime="1.984777143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:01:54.587691019 +0000 UTC m=+248.350062541" watchObservedRunningTime="2026-06-09 16:01:54.588570029 +0000 UTC m=+248.350941586" Jun 09 16:01:57.655197 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:57.655140 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 16:01:57.657616 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:57.657585 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cccabbb-102d-4dd3-b772-af5ece21429f-metrics-certs\") pod \"network-metrics-daemon-sls78\" (UID: \"7cccabbb-102d-4dd3-b772-af5ece21429f\") " pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 16:01:57.823731 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:57.823703 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mzrv4\"" Jun 09 16:01:57.832082 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:57.832049 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sls78" Jun 09 16:01:57.965740 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:57.965703 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sls78"] Jun 09 16:01:57.969327 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:01:57.969298 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cccabbb_102d_4dd3_b772_af5ece21429f.slice/crio-2f38e443acf87e0ff46fa9208b5af0e070b2c405c8a1ce64ac9d131db6faf9fd WatchSource:0}: Error finding container 2f38e443acf87e0ff46fa9208b5af0e070b2c405c8a1ce64ac9d131db6faf9fd: Status 404 returned error can't find the container with id 2f38e443acf87e0ff46fa9208b5af0e070b2c405c8a1ce64ac9d131db6faf9fd Jun 09 16:01:58.585426 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:58.585383 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sls78" event={"ID":"7cccabbb-102d-4dd3-b772-af5ece21429f","Type":"ContainerStarted","Data":"2f38e443acf87e0ff46fa9208b5af0e070b2c405c8a1ce64ac9d131db6faf9fd"} Jun 09 16:01:59.592666 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:59.592625 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sls78" event={"ID":"7cccabbb-102d-4dd3-b772-af5ece21429f","Type":"ContainerStarted","Data":"e35946bb528f8503dce9fffe79894a8881af01fb3db22122b03b31638834543d"} Jun 09 16:01:59.593050 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:59.592719 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sls78" event={"ID":"7cccabbb-102d-4dd3-b772-af5ece21429f","Type":"ContainerStarted","Data":"d25f4a2fe4441d922eae6038f6982cd42e0c8133a52fada050b803f7c49a144a"} Jun 09 16:01:59.606403 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:01:59.606337 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sls78" podStartSLOduration=252.728611839 podStartE2EDuration="4m13.606317476s" totalImagesPullingTime="877.705637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:01:59.60599801 +0000 UTC m=+253.368369527" watchObservedRunningTime="2026-06-09 16:01:59.606317476 +0000 UTC m=+253.368689009" Jun 09 16:02:02.048620 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.048584 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fgw42"] Jun 09 16:02:02.051448 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.051424 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.053646 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.053612 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7xvxb\"" Jun 09 16:02:02.054019 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.053997 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 16:02:02.054237 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.054218 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 16:02:02.054406 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.054269 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 16:02:02.054406 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.054325 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 16:02:02.065245 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.065219 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fgw42"] Jun 09 16:02:02.072728 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.072701 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78bd4c8b96-lkbgs"] Jun 09 16:02:02.129963 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.129928 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c9cc4c75b-kb6hx"] Jun 09 16:02:02.133028 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.133002 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9cc4c75b-kb6hx"] Jun 09 16:02:02.133183 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.133113 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.192354 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.192324 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/891e7674-69f4-46d3-92da-433ceac6762d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.192563 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.192373 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwvc9\" (UniqueName: \"kubernetes.io/projected/891e7674-69f4-46d3-92da-433ceac6762d-kube-api-access-zwvc9\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.192563 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.192398 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/891e7674-69f4-46d3-92da-433ceac6762d-data-volume\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.192563 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.192535 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/891e7674-69f4-46d3-92da-433ceac6762d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.192692 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.192576 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/891e7674-69f4-46d3-92da-433ceac6762d-crio-socket\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.293046 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293004 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/891e7674-69f4-46d3-92da-433ceac6762d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.293046 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293050 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-registry-tls\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.293292 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293084 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg4wj\" (UniqueName: \"kubernetes.io/projected/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-kube-api-access-fg4wj\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.293292 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293104 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-bound-sa-token\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.293292 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293129 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-installation-pull-secrets\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.293292 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293150 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-registry-certificates\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.293292 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293206 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwvc9\" (UniqueName: \"kubernetes.io/projected/891e7674-69f4-46d3-92da-433ceac6762d-kube-api-access-zwvc9\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.293292 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293242 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/891e7674-69f4-46d3-92da-433ceac6762d-data-volume\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.293292 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293273 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-ca-trust-extracted\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.293292 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293289 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-image-registry-private-configuration\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.293666 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293324 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/891e7674-69f4-46d3-92da-433ceac6762d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.293666 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293349 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-trusted-ca\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.293666 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293390 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/891e7674-69f4-46d3-92da-433ceac6762d-crio-socket\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.293666 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293514 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/891e7674-69f4-46d3-92da-433ceac6762d-crio-socket\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.293666 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293572 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/891e7674-69f4-46d3-92da-433ceac6762d-data-volume\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.293832 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.293812 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/891e7674-69f4-46d3-92da-433ceac6762d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.295409 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.295392 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/891e7674-69f4-46d3-92da-433ceac6762d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.301206 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.301146 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwvc9\" (UniqueName: \"kubernetes.io/projected/891e7674-69f4-46d3-92da-433ceac6762d-kube-api-access-zwvc9\") pod \"insights-runtime-extractor-fgw42\" (UID: \"891e7674-69f4-46d3-92da-433ceac6762d\") " pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.361293 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.361252 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fgw42" Jun 09 16:02:02.393756 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.393718 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-registry-tls\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.393756 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.393760 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg4wj\" (UniqueName: \"kubernetes.io/projected/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-kube-api-access-fg4wj\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.394058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.393781 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-bound-sa-token\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.394058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.393808 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-installation-pull-secrets\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.394058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.393835 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-registry-certificates\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.394058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.393899 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-ca-trust-extracted\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.394058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.393917 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-image-registry-private-configuration\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.394058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.393964 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-trusted-ca\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.394506 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.394464 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-ca-trust-extracted\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.394947 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.394920 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-registry-certificates\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.395199 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.395177 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-trusted-ca\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.396975 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.396950 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-registry-tls\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.396975 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.397015 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-installation-pull-secrets\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.396975 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.397052 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-image-registry-private-configuration\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.402117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.402089 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-bound-sa-token\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.402238 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.402221 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg4wj\" (UniqueName: \"kubernetes.io/projected/4cb23b1c-451a-4cb1-a963-cbb8c3c24e33-kube-api-access-fg4wj\") pod \"image-registry-c9cc4c75b-kb6hx\" (UID: \"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33\") " pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.442773 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.442720 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:02.501455 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.501422 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fgw42"] Jun 09 16:02:02.503516 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:02:02.503488 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891e7674_69f4_46d3_92da_433ceac6762d.slice/crio-4a2b5509f1107bfe3038cebc83b3471745c5be1b29975017b2f87709d78ed0bc WatchSource:0}: Error finding container 4a2b5509f1107bfe3038cebc83b3471745c5be1b29975017b2f87709d78ed0bc: Status 404 returned error can't find the container with id 4a2b5509f1107bfe3038cebc83b3471745c5be1b29975017b2f87709d78ed0bc Jun 09 16:02:02.586785 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.586750 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9cc4c75b-kb6hx"] Jun 09 16:02:02.590223 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:02:02.590189 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb23b1c_451a_4cb1_a963_cbb8c3c24e33.slice/crio-d0fac2a31e7c90cb3bdf06924d48c1b0ec23a585b0ed48bb8a6cec1b9f2bec8e WatchSource:0}: Error finding container d0fac2a31e7c90cb3bdf06924d48c1b0ec23a585b0ed48bb8a6cec1b9f2bec8e: Status 404 returned error can't find the container with id d0fac2a31e7c90cb3bdf06924d48c1b0ec23a585b0ed48bb8a6cec1b9f2bec8e Jun 09 16:02:02.605536 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.605500 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" event={"ID":"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33","Type":"ContainerStarted","Data":"d0fac2a31e7c90cb3bdf06924d48c1b0ec23a585b0ed48bb8a6cec1b9f2bec8e"} Jun 09 16:02:02.610024 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.609989 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fgw42" event={"ID":"891e7674-69f4-46d3-92da-433ceac6762d","Type":"ContainerStarted","Data":"60237a13701b84420ca31198984afd0041773001c29ce7b2e1de65378e233133"} Jun 09 16:02:02.610209 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:02.610060 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fgw42" event={"ID":"891e7674-69f4-46d3-92da-433ceac6762d","Type":"ContainerStarted","Data":"4a2b5509f1107bfe3038cebc83b3471745c5be1b29975017b2f87709d78ed0bc"} Jun 09 16:02:03.615081 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:03.614980 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" event={"ID":"4cb23b1c-451a-4cb1-a963-cbb8c3c24e33","Type":"ContainerStarted","Data":"63e716443031bb65ee31dcb54a82eec041274fa93b1d610cffc792afbdffbab4"} Jun 09 16:02:03.615542 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:03.615086 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:03.616680 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:03.616656 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fgw42" event={"ID":"891e7674-69f4-46d3-92da-433ceac6762d","Type":"ContainerStarted","Data":"1e9f7ce5c068a8e02e6fb49703e33015db6f6af57e3b0d9f72c817760a2dd199"} Jun 09 16:02:03.635188 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:03.635131 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" podStartSLOduration=1.63511222 podStartE2EDuration="1.63511222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:02:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:02:03.634460021 +0000 UTC m=+257.396831539" watchObservedRunningTime="2026-06-09 16:02:03.63511222 +0000 UTC m=+257.397483741" Jun 09 16:02:05.627514 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:05.627481 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fgw42" event={"ID":"891e7674-69f4-46d3-92da-433ceac6762d","Type":"ContainerStarted","Data":"234161733ce3165ab1a23032421aef64c545a31aa4952abd30729ceef96acbf4"} Jun 09 16:02:05.644064 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:05.644014 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fgw42" podStartSLOduration=1.105314541 podStartE2EDuration="3.643996689s" totalImagesPullingTime="2.538682148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 16:02:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:02:05.642112413 +0000 UTC m=+259.404483935" watchObservedRunningTime="2026-06-09 16:02:05.643996689 +0000 UTC m=+259.406368210" Jun 09 16:02:07.635447 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:07.635413 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:02:07.637752 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:07.637733 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c110805c-1587-445b-b71b-2a2a4a7bb10a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-twdnl\" (UID: \"c110805c-1587-445b-b71b-2a2a4a7bb10a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:02:07.914486 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:07.914454 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wdc79\"" Jun 09 16:02:07.923202 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:07.923176 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" Jun 09 16:02:08.076413 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:08.076312 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl"] Jun 09 16:02:08.078818 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:02:08.078788 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc110805c_1587_445b_b71b_2a2a4a7bb10a.slice/crio-0e94606843be1257ca050f6375b3778acc31ae401fd996b03b180b346cd28ce8 WatchSource:0}: Error finding container 0e94606843be1257ca050f6375b3778acc31ae401fd996b03b180b346cd28ce8: Status 404 returned error can't find the container with id 0e94606843be1257ca050f6375b3778acc31ae401fd996b03b180b346cd28ce8 Jun 09 16:02:08.637588 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:08.637542 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" event={"ID":"c110805c-1587-445b-b71b-2a2a4a7bb10a","Type":"ContainerStarted","Data":"0e94606843be1257ca050f6375b3778acc31ae401fd996b03b180b346cd28ce8"} Jun 09 16:02:10.646307 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:10.646222 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" event={"ID":"c110805c-1587-445b-b71b-2a2a4a7bb10a","Type":"ContainerStarted","Data":"26c7f6d163de0bbf78c88b452a1b3e39e2be847fca5143475e904db3369ee52f"} Jun 09 16:02:10.665575 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:10.665516 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-twdnl" podStartSLOduration=33.356694721 podStartE2EDuration="35.665497997s" totalImagesPullingTime="2.308803276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:02:10.663858861 +0000 UTC m=+264.426230382" watchObservedRunningTime="2026-06-09 16:02:10.665497997 +0000 UTC m=+264.427869517" Jun 09 16:02:10.860638 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:10.860601 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp"] Jun 09 16:02:10.863804 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:10.863785 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp" Jun 09 16:02:10.865689 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:10.865655 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 16:02:10.865829 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:10.865695 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-p4ppn\"" Jun 09 16:02:10.872238 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:10.872210 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp"] Jun 09 16:02:10.964605 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:10.964565 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55a3c874-01fb-4f71-8b8d-a4dc5335d446-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-67nhp\" (UID: \"55a3c874-01fb-4f71-8b8d-a4dc5335d446\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp" Jun 09 16:02:11.065387 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:11.065350 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55a3c874-01fb-4f71-8b8d-a4dc5335d446-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-67nhp\" (UID: \"55a3c874-01fb-4f71-8b8d-a4dc5335d446\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp" Jun 09 16:02:11.067771 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:11.067740 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55a3c874-01fb-4f71-8b8d-a4dc5335d446-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-67nhp\" (UID: \"55a3c874-01fb-4f71-8b8d-a4dc5335d446\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp" Jun 09 16:02:11.173960 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:11.173919 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp" Jun 09 16:02:11.305804 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:11.305777 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp"] Jun 09 16:02:11.308544 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:02:11.308510 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a3c874_01fb_4f71_8b8d_a4dc5335d446.slice/crio-c82fa60416218e2a8c06614f4e2693be327d5a43c83f02eb9629880e3479a1f4 WatchSource:0}: Error finding container c82fa60416218e2a8c06614f4e2693be327d5a43c83f02eb9629880e3479a1f4: Status 404 returned error can't find the container with id c82fa60416218e2a8c06614f4e2693be327d5a43c83f02eb9629880e3479a1f4 Jun 09 16:02:11.650777 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:11.650689 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp" event={"ID":"55a3c874-01fb-4f71-8b8d-a4dc5335d446","Type":"ContainerStarted","Data":"c82fa60416218e2a8c06614f4e2693be327d5a43c83f02eb9629880e3479a1f4"} Jun 09 16:02:12.078458 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:12.078413 2552 patch_prober.go:28] interesting pod/image-registry-78bd4c8b96-lkbgs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 16:02:12.078685 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:12.078484 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" podUID="d8895b15-f3c4-4c16-8eaf-8586cf81e70c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 16:02:12.655670 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:12.655641 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp" event={"ID":"55a3c874-01fb-4f71-8b8d-a4dc5335d446","Type":"ContainerStarted","Data":"cbed1bb470c3f5115c450b6161842e39ccbdf5e08b6e26b192594fb8b95b7c63"} Jun 09 16:02:12.656143 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:12.655825 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp" Jun 09 16:02:12.660797 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:12.660771 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp" Jun 09 16:02:12.669458 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:12.669410 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-67nhp" podStartSLOduration=1.517646973 podStartE2EDuration="2.669394466s" totalImagesPullingTime="1.151747493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:02:12.668812708 +0000 UTC m=+266.431184228" watchObservedRunningTime="2026-06-09 16:02:12.669394466 +0000 UTC m=+266.431766000" Jun 09 16:02:17.295220 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.295183 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5nqjk"] Jun 09 16:02:17.298563 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.298540 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.300590 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.300562 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 16:02:17.300590 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.300568 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 16:02:17.300774 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.300631 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 16:02:17.300994 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.300976 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 16:02:17.301056 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.301007 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ds8zd\"" Jun 09 16:02:17.416492 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.416445 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-wtmp\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.416492 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.416498 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-tls\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.416736 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.416551 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28e6a4e3-d590-4998-a0cb-d401a7653136-metrics-client-ca\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.416736 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.416594 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-textfile\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.416736 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.416627 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/28e6a4e3-d590-4998-a0cb-d401a7653136-root\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.416736 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.416655 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.416736 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.416689 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm4b8\" (UniqueName: \"kubernetes.io/projected/28e6a4e3-d590-4998-a0cb-d401a7653136-kube-api-access-dm4b8\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.416736 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.416714 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.417010 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.416825 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28e6a4e3-d590-4998-a0cb-d401a7653136-sys\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.517519 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.517482 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28e6a4e3-d590-4998-a0cb-d401a7653136-sys\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.517678 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.517528 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-wtmp\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.517678 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.517548 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-tls\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.517678 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.517568 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28e6a4e3-d590-4998-a0cb-d401a7653136-metrics-client-ca\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.517678 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.517574 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28e6a4e3-d590-4998-a0cb-d401a7653136-sys\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.517678 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.517586 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-textfile\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.517861 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.517733 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-wtmp\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.517861 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.517845 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/28e6a4e3-d590-4998-a0cb-d401a7653136-root\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.517975 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.517900 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.517975 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.517920 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/28e6a4e3-d590-4998-a0cb-d401a7653136-root\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.518077 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.517976 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm4b8\" (UniqueName: \"kubernetes.io/projected/28e6a4e3-d590-4998-a0cb-d401a7653136-kube-api-access-dm4b8\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.518077 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.518018 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.518180 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.518081 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-textfile\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.518264 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.518227 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28e6a4e3-d590-4998-a0cb-d401a7653136-metrics-client-ca\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.518465 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.518447 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.520210 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.520190 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-tls\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.520607 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.520588 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28e6a4e3-d590-4998-a0cb-d401a7653136-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.525231 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.525208 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm4b8\" (UniqueName: \"kubernetes.io/projected/28e6a4e3-d590-4998-a0cb-d401a7653136-kube-api-access-dm4b8\") pod \"node-exporter-5nqjk\" (UID: \"28e6a4e3-d590-4998-a0cb-d401a7653136\") " pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.608367 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.608250 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5nqjk" Jun 09 16:02:17.620317 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:02:17.620289 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e6a4e3_d590_4998_a0cb_d401a7653136.slice/crio-e90386a12e2da7d5d856b359676566dbc3af3b420138a4dc6eb4a3e06fcc16b1 WatchSource:0}: Error finding container e90386a12e2da7d5d856b359676566dbc3af3b420138a4dc6eb4a3e06fcc16b1: Status 404 returned error can't find the container with id e90386a12e2da7d5d856b359676566dbc3af3b420138a4dc6eb4a3e06fcc16b1 Jun 09 16:02:17.674329 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:17.674289 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nqjk" event={"ID":"28e6a4e3-d590-4998-a0cb-d401a7653136","Type":"ContainerStarted","Data":"e90386a12e2da7d5d856b359676566dbc3af3b420138a4dc6eb4a3e06fcc16b1"} Jun 09 16:02:17.960537 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:02:17.960488 2552 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e83446315f4288b43865479673474a3cdcbf9d42919f6cb6b7e76bb897d7d97d: decoding bearer token (last URL \"https://quay.io/v2/auth?account=openshift-release-dev%2Bocm_access_6628ed1260a548e595ee32e9de28abb4&scope=repository%3Aopenshift-release-dev%2Focp-v4.0-art-dev%3Apull&service=quay.io\", body start \"\"): unexpected end of JSON input; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e83446315f4288b43865479673474a3cdcbf9d42919f6cb6b7e76bb897d7d97d" Jun 09 16:02:17.960757 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:02:17.960617 2552 kuberuntime_manager.go:1459] "Unhandled Error" err="init container init-textfile start failed in pod node-exporter-5nqjk_openshift-monitoring(28e6a4e3-d590-4998-a0cb-d401a7653136): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e83446315f4288b43865479673474a3cdcbf9d42919f6cb6b7e76bb897d7d97d: decoding bearer token (last URL \"https://quay.io/v2/auth?account=openshift-release-dev%2Bocm_access_6628ed1260a548e595ee32e9de28abb4&scope=repository%3Aopenshift-release-dev%2Focp-v4.0-art-dev%3Apull&service=quay.io\", body start \"\"): unexpected end of JSON input; artifact err: provided artifact is a container image" logger="UnhandledError" Jun 09 16:02:17.960757 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:02:17.960656 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"init-textfile\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e83446315f4288b43865479673474a3cdcbf9d42919f6cb6b7e76bb897d7d97d: decoding bearer token (last URL \\\"https://quay.io/v2/auth?account=openshift-release-dev%2Bocm_access_6628ed1260a548e595ee32e9de28abb4&scope=repository%3Aopenshift-release-dev%2Focp-v4.0-art-dev%3Apull&service=quay.io\\\", body start \\\"\\\"): unexpected end of JSON input; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/node-exporter-5nqjk" podUID="28e6a4e3-d590-4998-a0cb-d401a7653136" Jun 09 16:02:18.356450 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.356365 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 16:02:18.362763 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.362731 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.364711 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.364682 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 16:02:18.365074 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.364913 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 16:02:18.365074 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.364913 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 16:02:18.365074 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.364948 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 16:02:18.365074 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.364980 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fh4fc\"" Jun 09 16:02:18.365074 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.365010 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 16:02:18.365315 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.365272 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 16:02:18.365440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.365418 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 16:02:18.365519 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.365500 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 16:02:18.366031 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.366018 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 16:02:18.372672 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.372648 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 16:02:18.524767 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.524720 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36d7b9a9-481f-42fd-816f-26a4c2a999c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.524767 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.524772 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36d7b9a9-481f-42fd-816f-26a4c2a999c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.525009 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.524797 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36d7b9a9-481f-42fd-816f-26a4c2a999c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.525009 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.524815 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.525009 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.524832 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.525009 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.524928 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36d7b9a9-481f-42fd-816f-26a4c2a999c3-config-out\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.525009 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.524967 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.525009 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.524994 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-web-config\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.525254 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.525041 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36d7b9a9-481f-42fd-816f-26a4c2a999c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.525254 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.525094 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.525254 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.525121 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2l26\" (UniqueName: \"kubernetes.io/projected/36d7b9a9-481f-42fd-816f-26a4c2a999c3-kube-api-access-g2l26\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.525254 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.525145 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.525254 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.525177 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.625797 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.625702 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36d7b9a9-481f-42fd-816f-26a4c2a999c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.625797 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.625741 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36d7b9a9-481f-42fd-816f-26a4c2a999c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.625797 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.625765 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.626117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.625918 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.626117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.625975 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36d7b9a9-481f-42fd-816f-26a4c2a999c3-config-out\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.626117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.625999 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.626117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.626023 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-web-config\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.626117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.626072 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36d7b9a9-481f-42fd-816f-26a4c2a999c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.626363 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.626138 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.626363 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.626170 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2l26\" (UniqueName: \"kubernetes.io/projected/36d7b9a9-481f-42fd-816f-26a4c2a999c3-kube-api-access-g2l26\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.626363 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.626196 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.626363 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.626225 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36d7b9a9-481f-42fd-816f-26a4c2a999c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.626363 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.626236 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.626363 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.626315 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36d7b9a9-481f-42fd-816f-26a4c2a999c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.627153 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.626806 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36d7b9a9-481f-42fd-816f-26a4c2a999c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.627153 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.626977 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36d7b9a9-481f-42fd-816f-26a4c2a999c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.629345 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.629318 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.629345 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.629333 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.629684 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.629658 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36d7b9a9-481f-42fd-816f-26a4c2a999c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.629895 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.629855 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.629980 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.629923 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.631115 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.631088 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-web-config\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.631177 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.631087 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.631177 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.631126 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36d7b9a9-481f-42fd-816f-26a4c2a999c3-config-out\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.631283 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.631265 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.633753 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.633732 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2l26\" (UniqueName: \"kubernetes.io/projected/36d7b9a9-481f-42fd-816f-26a4c2a999c3-kube-api-access-g2l26\") pod \"alertmanager-main-0\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.674610 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.674578 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:02:18.678578 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:02:18.678543 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"init-textfile\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e83446315f4288b43865479673474a3cdcbf9d42919f6cb6b7e76bb897d7d97d\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e83446315f4288b43865479673474a3cdcbf9d42919f6cb6b7e76bb897d7d97d: decoding bearer token (last URL \\\"https://quay.io/v2/auth?account=openshift-release-dev%2Bocm_access_6628ed1260a548e595ee32e9de28abb4&scope=repository%3Aopenshift-release-dev%2Focp-v4.0-art-dev%3Apull&service=quay.io\\\", body start \\\"\\\"): unexpected end of JSON input; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/node-exporter-5nqjk" podUID="28e6a4e3-d590-4998-a0cb-d401a7653136" Jun 09 16:02:18.820882 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:18.820833 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 16:02:18.823742 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:02:18.823707 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d7b9a9_481f_42fd_816f_26a4c2a999c3.slice/crio-2c73a579554bd1ba4f0ec1d6fef999aa2e3373496825e318e6ed5763bfa7c43d WatchSource:0}: Error finding container 2c73a579554bd1ba4f0ec1d6fef999aa2e3373496825e318e6ed5763bfa7c43d: Status 404 returned error can't find the container with id 2c73a579554bd1ba4f0ec1d6fef999aa2e3373496825e318e6ed5763bfa7c43d Jun 09 16:02:19.268407 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.268368 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d4cf89459-pzrh7"] Jun 09 16:02:19.273280 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.273258 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.275218 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.275192 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 16:02:19.275366 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.275192 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 16:02:19.275436 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.275372 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 16:02:19.275563 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.275543 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 16:02:19.275913 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.275897 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4rm78126udvud\"" Jun 09 16:02:19.276005 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.275927 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 16:02:19.276005 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.275980 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-p959m\"" Jun 09 16:02:19.286906 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.286856 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d4cf89459-pzrh7"] Jun 09 16:02:19.332993 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.332958 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c1ca78-04a6-4240-86bf-7f7b089752bb-metrics-client-ca\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.332993 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.332997 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqs6w\" (UniqueName: \"kubernetes.io/projected/04c1ca78-04a6-4240-86bf-7f7b089752bb-kube-api-access-tqs6w\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.333209 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.333042 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.333209 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.333063 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.333209 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.333080 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.333209 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.333097 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-tls\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.333209 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.333154 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.333209 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.333173 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-grpc-tls\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.434439 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.434404 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.434964 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.434448 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.434964 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.434478 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.434964 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.434497 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-tls\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.434964 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.434531 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.434964 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.434562 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-grpc-tls\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.434964 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.434628 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c1ca78-04a6-4240-86bf-7f7b089752bb-metrics-client-ca\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.434964 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.434659 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqs6w\" (UniqueName: \"kubernetes.io/projected/04c1ca78-04a6-4240-86bf-7f7b089752bb-kube-api-access-tqs6w\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.435723 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.435675 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c1ca78-04a6-4240-86bf-7f7b089752bb-metrics-client-ca\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.437697 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.437647 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.437697 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.437686 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.438094 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.438069 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-grpc-tls\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.438189 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.438130 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.438189 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.438174 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-tls\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.439083 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.439060 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04c1ca78-04a6-4240-86bf-7f7b089752bb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.442369 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.442347 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqs6w\" (UniqueName: \"kubernetes.io/projected/04c1ca78-04a6-4240-86bf-7f7b089752bb-kube-api-access-tqs6w\") pod \"thanos-querier-d4cf89459-pzrh7\" (UID: \"04c1ca78-04a6-4240-86bf-7f7b089752bb\") " pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.583542 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.583436 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:19.683646 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.683612 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerStarted","Data":"2c73a579554bd1ba4f0ec1d6fef999aa2e3373496825e318e6ed5763bfa7c43d"} Jun 09 16:02:19.735634 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:19.735243 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d4cf89459-pzrh7"] Jun 09 16:02:19.878424 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:02:19.878351 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c1ca78_04a6_4240_86bf_7f7b089752bb.slice/crio-d478f8919862c194e2f61238e9deef37128081bf632443a5de6389d134d027a8 WatchSource:0}: Error finding container d478f8919862c194e2f61238e9deef37128081bf632443a5de6389d134d027a8: Status 404 returned error can't find the container with id d478f8919862c194e2f61238e9deef37128081bf632443a5de6389d134d027a8 Jun 09 16:02:20.689067 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:20.689027 2552 generic.go:356] "Generic (PLEG): container finished" podID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerID="2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6" exitCode=0 Jun 09 16:02:20.689545 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:20.689119 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerDied","Data":"2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6"} Jun 09 16:02:20.690274 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:20.690249 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" event={"ID":"04c1ca78-04a6-4240-86bf-7f7b089752bb","Type":"ContainerStarted","Data":"d478f8919862c194e2f61238e9deef37128081bf632443a5de6389d134d027a8"} Jun 09 16:02:21.596646 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.596603 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8595c6cd96-qdb6z"] Jun 09 16:02:21.600531 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.600493 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.602819 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.602583 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kqrq8\"" Jun 09 16:02:21.602819 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.602616 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 16:02:21.602819 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.602597 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 16:02:21.603248 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.603216 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-954j75513filj\"" Jun 09 16:02:21.603377 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.603254 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 16:02:21.603493 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.603478 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 16:02:21.610139 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.609758 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8595c6cd96-qdb6z"] Jun 09 16:02:21.654241 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.654203 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tppwk\" (UniqueName: \"kubernetes.io/projected/c4989818-fa78-4a78-9744-0201edaf73cc-kube-api-access-tppwk\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.654466 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.654263 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c4989818-fa78-4a78-9744-0201edaf73cc-audit-log\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.654466 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.654296 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4989818-fa78-4a78-9744-0201edaf73cc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.654466 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.654363 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c4989818-fa78-4a78-9744-0201edaf73cc-secret-metrics-server-tls\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.654466 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.654397 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4989818-fa78-4a78-9744-0201edaf73cc-client-ca-bundle\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.654683 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.654540 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c4989818-fa78-4a78-9744-0201edaf73cc-metrics-server-audit-profiles\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.654683 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.654581 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c4989818-fa78-4a78-9744-0201edaf73cc-secret-metrics-server-client-certs\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.755676 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.755632 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c4989818-fa78-4a78-9744-0201edaf73cc-metrics-server-audit-profiles\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.756174 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.755682 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c4989818-fa78-4a78-9744-0201edaf73cc-secret-metrics-server-client-certs\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.756174 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.755746 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tppwk\" (UniqueName: \"kubernetes.io/projected/c4989818-fa78-4a78-9744-0201edaf73cc-kube-api-access-tppwk\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.756174 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.755786 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c4989818-fa78-4a78-9744-0201edaf73cc-audit-log\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.756174 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.755817 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4989818-fa78-4a78-9744-0201edaf73cc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.756174 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.755849 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c4989818-fa78-4a78-9744-0201edaf73cc-secret-metrics-server-tls\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.756174 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.755903 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4989818-fa78-4a78-9744-0201edaf73cc-client-ca-bundle\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.756526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.756287 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c4989818-fa78-4a78-9744-0201edaf73cc-audit-log\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.756624 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.756596 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4989818-fa78-4a78-9744-0201edaf73cc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.756825 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.756806 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c4989818-fa78-4a78-9744-0201edaf73cc-metrics-server-audit-profiles\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.758828 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.758806 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4989818-fa78-4a78-9744-0201edaf73cc-client-ca-bundle\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.758974 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.758953 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c4989818-fa78-4a78-9744-0201edaf73cc-secret-metrics-server-tls\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.759131 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.759108 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c4989818-fa78-4a78-9744-0201edaf73cc-secret-metrics-server-client-certs\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.763633 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.763604 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tppwk\" (UniqueName: \"kubernetes.io/projected/c4989818-fa78-4a78-9744-0201edaf73cc-kube-api-access-tppwk\") pod \"metrics-server-8595c6cd96-qdb6z\" (UID: \"c4989818-fa78-4a78-9744-0201edaf73cc\") " pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:21.913594 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:21.913554 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:22.056141 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.056104 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-pff5l"] Jun 09 16:02:22.060358 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.060327 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" Jun 09 16:02:22.062217 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.062188 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 16:02:22.062524 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.062220 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-slgzh\"" Jun 09 16:02:22.068646 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.068578 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-pff5l"] Jun 09 16:02:22.078299 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.078263 2552 patch_prober.go:28] interesting pod/image-registry-78bd4c8b96-lkbgs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 16:02:22.078504 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.078325 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" podUID="d8895b15-f3c4-4c16-8eaf-8586cf81e70c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 16:02:22.159489 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.159454 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8ec653b-8d5f-43db-8cde-875280645f93-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-pff5l\" (UID: \"d8ec653b-8d5f-43db-8cde-875280645f93\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" Jun 09 16:02:22.159489 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.159494 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmgpb\" (UniqueName: \"kubernetes.io/projected/d8ec653b-8d5f-43db-8cde-875280645f93-kube-api-access-gmgpb\") pod \"monitoring-plugin-76b68cc874-pff5l\" (UID: \"d8ec653b-8d5f-43db-8cde-875280645f93\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" Jun 09 16:02:22.193555 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.193520 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8595c6cd96-qdb6z"] Jun 09 16:02:22.260319 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.260271 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8ec653b-8d5f-43db-8cde-875280645f93-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-pff5l\" (UID: \"d8ec653b-8d5f-43db-8cde-875280645f93\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" Jun 09 16:02:22.260319 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.260327 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmgpb\" (UniqueName: \"kubernetes.io/projected/d8ec653b-8d5f-43db-8cde-875280645f93-kube-api-access-gmgpb\") pod \"monitoring-plugin-76b68cc874-pff5l\" (UID: \"d8ec653b-8d5f-43db-8cde-875280645f93\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" Jun 09 16:02:22.263277 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.263250 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8ec653b-8d5f-43db-8cde-875280645f93-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-pff5l\" (UID: \"d8ec653b-8d5f-43db-8cde-875280645f93\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" Jun 09 16:02:22.269056 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.268988 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmgpb\" (UniqueName: \"kubernetes.io/projected/d8ec653b-8d5f-43db-8cde-875280645f93-kube-api-access-gmgpb\") pod \"monitoring-plugin-76b68cc874-pff5l\" (UID: \"d8ec653b-8d5f-43db-8cde-875280645f93\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" Jun 09 16:02:22.374344 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.374312 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" Jun 09 16:02:22.435829 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:02:22.435790 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4989818_fa78_4a78_9744_0201edaf73cc.slice/crio-0d738c60733e7c8929f4d2ee82840d85582615d748ded2310a91b6d0bab4f47e WatchSource:0}: Error finding container 0d738c60733e7c8929f4d2ee82840d85582615d748ded2310a91b6d0bab4f47e: Status 404 returned error can't find the container with id 0d738c60733e7c8929f4d2ee82840d85582615d748ded2310a91b6d0bab4f47e Jun 09 16:02:22.447602 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.447570 2552 patch_prober.go:28] interesting pod/image-registry-c9cc4c75b-kb6hx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 16:02:22.447685 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.447627 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" podUID="4cb23b1c-451a-4cb1-a963-cbb8c3c24e33" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 16:02:22.586695 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.586613 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-pff5l"] Jun 09 16:02:22.594238 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:02:22.594202 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ec653b_8d5f_43db_8cde_875280645f93.slice/crio-5386949ef4f172368d5af471c344b064faea61c634fdfe2793c272e0c26cca9c WatchSource:0}: Error finding container 5386949ef4f172368d5af471c344b064faea61c634fdfe2793c272e0c26cca9c: Status 404 returned error can't find the container with id 5386949ef4f172368d5af471c344b064faea61c634fdfe2793c272e0c26cca9c Jun 09 16:02:22.703827 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.703786 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" event={"ID":"04c1ca78-04a6-4240-86bf-7f7b089752bb","Type":"ContainerStarted","Data":"41102a2b5d6df36a16b86fddf4434e5e11d379ae83908534b8bff3d395834c02"} Jun 09 16:02:22.703960 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.703932 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" event={"ID":"04c1ca78-04a6-4240-86bf-7f7b089752bb","Type":"ContainerStarted","Data":"040b562c3f9c04a5d423e747dbc90a23bc9cc327dbfca7349a5efdc298f12620"} Jun 09 16:02:22.704038 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.703999 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" event={"ID":"04c1ca78-04a6-4240-86bf-7f7b089752bb","Type":"ContainerStarted","Data":"1be158c208477b51f70b09559094bbca3f493e6fb3ea4ab61e67820f06382cc0"} Jun 09 16:02:22.707542 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.707492 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerStarted","Data":"839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09"} Jun 09 16:02:22.707665 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.707586 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerStarted","Data":"79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4"} Jun 09 16:02:22.707665 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.707630 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerStarted","Data":"532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700"} Jun 09 16:02:22.709030 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.709002 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" event={"ID":"c4989818-fa78-4a78-9744-0201edaf73cc","Type":"ContainerStarted","Data":"0d738c60733e7c8929f4d2ee82840d85582615d748ded2310a91b6d0bab4f47e"} Jun 09 16:02:22.710191 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:22.710164 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" event={"ID":"d8ec653b-8d5f-43db-8cde-875280645f93","Type":"ContainerStarted","Data":"5386949ef4f172368d5af471c344b064faea61c634fdfe2793c272e0c26cca9c"} Jun 09 16:02:23.521233 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.521189 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 16:02:23.525984 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.525930 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.529396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.528757 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 16:02:23.529396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.528786 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-42calllhvdm0t\"" Jun 09 16:02:23.529396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.528803 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 16:02:23.529396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.528898 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 16:02:23.529396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.528922 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 16:02:23.529396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.529166 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 16:02:23.529396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.529174 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 16:02:23.529396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.529174 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 16:02:23.529396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.529232 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 16:02:23.529396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.529169 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 16:02:23.529396 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.529393 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 16:02:23.530112 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.529539 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 16:02:23.530112 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.529595 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 16:02:23.530112 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.529646 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pxmqf\"" Jun 09 16:02:23.530112 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.529941 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 16:02:23.533046 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.533019 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 16:02:23.543819 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.543791 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 16:02:23.571117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.570816 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.570892 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b46878ee-d9e9-4162-ab12-2010a877b7b8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.570928 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.570954 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g97gx\" (UniqueName: \"kubernetes.io/projected/b46878ee-d9e9-4162-ab12-2010a877b7b8-kube-api-access-g97gx\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571000 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571040 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571117 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571061 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571143 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571183 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571212 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-web-config\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571275 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571304 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-config\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571330 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571355 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571388 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571421 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571444 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571514 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b46878ee-d9e9-4162-ab12-2010a877b7b8-config-out\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.571587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571583 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.572061 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.571621 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672431 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672391 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672431 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672444 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b46878ee-d9e9-4162-ab12-2010a877b7b8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672688 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672534 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672688 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672582 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g97gx\" (UniqueName: \"kubernetes.io/projected/b46878ee-d9e9-4162-ab12-2010a877b7b8-kube-api-access-g97gx\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672688 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672632 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672688 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672673 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672908 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672696 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672908 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672726 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672908 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672751 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672908 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672775 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-web-config\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672908 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672834 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672908 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672861 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-config\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.672908 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.672906 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.673793 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.673763 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.673911 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.673820 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.673911 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.673885 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.674030 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.673926 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.674030 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.673950 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.674030 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.673983 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b46878ee-d9e9-4162-ab12-2010a877b7b8-config-out\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.674030 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.674018 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.674242 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.674057 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.674242 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.674188 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.674436 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.674414 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.676489 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.675557 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b46878ee-d9e9-4162-ab12-2010a877b7b8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.676489 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.676165 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.676489 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.676405 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.677011 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.676990 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-web-config\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.677367 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.677335 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.678825 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.677615 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.678825 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.678289 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.678997 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.678915 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.679051 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.678947 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.680406 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.679495 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.680406 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.679964 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-config\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.680406 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.680366 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.681636 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.681614 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.681952 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.681892 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b46878ee-d9e9-4162-ab12-2010a877b7b8-config-out\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.682115 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.682072 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.682218 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.682181 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.688360 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.688313 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g97gx\" (UniqueName: \"kubernetes.io/projected/b46878ee-d9e9-4162-ab12-2010a877b7b8-kube-api-access-g97gx\") pod \"prometheus-k8s-0\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:23.718099 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.718058 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerStarted","Data":"b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c"} Jun 09 16:02:23.718270 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.718136 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerStarted","Data":"48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3"} Jun 09 16:02:23.839607 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:23.839529 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:24.528534 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.528507 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 16:02:24.531107 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:02:24.531076 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46878ee_d9e9_4162_ab12_2010a877b7b8.slice/crio-ddc9cc331eb66728f744123699088e57edc7ed4085a22dcc45898ff2f88c3b53 WatchSource:0}: Error finding container ddc9cc331eb66728f744123699088e57edc7ed4085a22dcc45898ff2f88c3b53: Status 404 returned error can't find the container with id ddc9cc331eb66728f744123699088e57edc7ed4085a22dcc45898ff2f88c3b53 Jun 09 16:02:24.628198 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.628160 2552 patch_prober.go:28] interesting pod/image-registry-c9cc4c75b-kb6hx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 16:02:24.628375 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.628226 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" podUID="4cb23b1c-451a-4cb1-a963-cbb8c3c24e33" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 16:02:24.725960 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.725921 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" Jun 09 16:02:24.726136 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.725975 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" event={"ID":"d8ec653b-8d5f-43db-8cde-875280645f93","Type":"ContainerStarted","Data":"af5e001a6f066c83fca444fb70bb7727780ec62d5c060c61302f51bf0839b36c"} Jun 09 16:02:24.728510 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.728476 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" event={"ID":"04c1ca78-04a6-4240-86bf-7f7b089752bb","Type":"ContainerStarted","Data":"86a12b35f3307d68002a97621a6daef938d81c80a37a1f6825b4357e322b6ac1"} Jun 09 16:02:24.728665 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.728551 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" event={"ID":"04c1ca78-04a6-4240-86bf-7f7b089752bb","Type":"ContainerStarted","Data":"4f77ef6d5a12530834959e4f97109f7fd32a2d5a9ec166f49202a784a8a68890"} Jun 09 16:02:24.728665 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.728606 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:24.728665 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.728635 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" event={"ID":"04c1ca78-04a6-4240-86bf-7f7b089752bb","Type":"ContainerStarted","Data":"3dff3b7fb72557385ecefa84161d5a3b432bc71fd74cca5ba1afafd192a6289c"} Jun 09 16:02:24.737342 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.737187 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" Jun 09 16:02:24.738128 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.738093 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerStarted","Data":"9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20"} Jun 09 16:02:24.739986 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.739965 2552 generic.go:356] "Generic (PLEG): container finished" podID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerID="fe7ebc76147ebd5243ec9f021e34c5228039da47d683fa46f609adccb946ea37" exitCode=0 Jun 09 16:02:24.740116 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.740040 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerDied","Data":"fe7ebc76147ebd5243ec9f021e34c5228039da47d683fa46f609adccb946ea37"} Jun 09 16:02:24.740116 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.740101 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerStarted","Data":"ddc9cc331eb66728f744123699088e57edc7ed4085a22dcc45898ff2f88c3b53"} Jun 09 16:02:24.741645 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.741622 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" event={"ID":"c4989818-fa78-4a78-9744-0201edaf73cc","Type":"ContainerStarted","Data":"6ce821e897e786ae613b84ff537c15a70adfe6d1437ffc0513bac582282050ab"} Jun 09 16:02:24.754110 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.754057 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-pff5l" podStartSLOduration=0.976111332 podStartE2EDuration="2.754039912s" totalImagesPullingTime="1.77792858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:02:24.738969906 +0000 UTC m=+278.501341427" watchObservedRunningTime="2026-06-09 16:02:24.754039912 +0000 UTC m=+278.516411806" Jun 09 16:02:24.773897 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.773827 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" podStartSLOduration=1.520876052 podStartE2EDuration="5.773810859s" totalImagesPullingTime="4.252934807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:02:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:02:24.772463784 +0000 UTC m=+278.534835304" watchObservedRunningTime="2026-06-09 16:02:24.773810859 +0000 UTC m=+278.536182401" Jun 09 16:02:24.797043 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.796984 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.339021817 podStartE2EDuration="6.796961383s" totalImagesPullingTime="4.44199675s" totalInitContainerRuntime="15.942816ms" isStatefulPod=false podCreationTimestamp="2026-06-09 16:02:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:02:24.79444652 +0000 UTC m=+278.556818079" watchObservedRunningTime="2026-06-09 16:02:24.796961383 +0000 UTC m=+278.559332904" Jun 09 16:02:24.837616 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:24.837506 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" podStartSLOduration=1.9025203290000001 podStartE2EDuration="3.837489364s" totalImagesPullingTime="1.934969035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:02:24.836024906 +0000 UTC m=+278.598396417" watchObservedRunningTime="2026-06-09 16:02:24.837489364 +0000 UTC m=+278.599860883" Jun 09 16:02:27.093421 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.093346 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" podUID="d8895b15-f3c4-4c16-8eaf-8586cf81e70c" containerName="registry" containerID="cri-o://b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c" gracePeriod=30 Jun 09 16:02:27.338473 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.338446 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:02:27.412781 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.412754 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls\") pod \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " Jun 09 16:02:27.412964 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.412811 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-image-registry-private-configuration\") pod \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " Jun 09 16:02:27.412964 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.412854 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-installation-pull-secrets\") pod \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " Jun 09 16:02:27.412964 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.412920 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-trusted-ca\") pod \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " Jun 09 16:02:27.412964 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.412954 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-bound-sa-token\") pod \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " Jun 09 16:02:27.413165 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.412997 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gldsw\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-kube-api-access-gldsw\") pod \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " Jun 09 16:02:27.413165 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.413036 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-ca-trust-extracted\") pod \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " Jun 09 16:02:27.413165 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.413072 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-certificates\") pod \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\" (UID: \"d8895b15-f3c4-4c16-8eaf-8586cf81e70c\") " Jun 09 16:02:27.413642 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.413484 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d8895b15-f3c4-4c16-8eaf-8586cf81e70c" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 16:02:27.413754 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.413712 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d8895b15-f3c4-4c16-8eaf-8586cf81e70c" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 16:02:27.415447 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.415410 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-kube-api-access-gldsw" (OuterVolumeSpecName: "kube-api-access-gldsw") pod "d8895b15-f3c4-4c16-8eaf-8586cf81e70c" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c"). InnerVolumeSpecName "kube-api-access-gldsw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 16:02:27.415447 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.415443 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d8895b15-f3c4-4c16-8eaf-8586cf81e70c" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 16:02:27.415641 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.415471 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d8895b15-f3c4-4c16-8eaf-8586cf81e70c" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 16:02:27.415641 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.415538 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d8895b15-f3c4-4c16-8eaf-8586cf81e70c" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:02:27.415773 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.415756 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d8895b15-f3c4-4c16-8eaf-8586cf81e70c" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:02:27.422578 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.422550 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d8895b15-f3c4-4c16-8eaf-8586cf81e70c" (UID: "d8895b15-f3c4-4c16-8eaf-8586cf81e70c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 16:02:27.514302 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.514267 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-bound-sa-token\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:02:27.514302 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.514298 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gldsw\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-kube-api-access-gldsw\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:02:27.514302 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.514311 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-ca-trust-extracted\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:02:27.514527 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.514320 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-certificates\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:02:27.514527 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.514328 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-registry-tls\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:02:27.514527 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.514337 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-image-registry-private-configuration\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:02:27.514527 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.514347 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-installation-pull-secrets\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:02:27.514527 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.514357 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8895b15-f3c4-4c16-8eaf-8586cf81e70c-trusted-ca\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:02:27.755686 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.755596 2552 generic.go:356] "Generic (PLEG): container finished" podID="d8895b15-f3c4-4c16-8eaf-8586cf81e70c" containerID="b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c" exitCode=0 Jun 09 16:02:27.755686 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.755650 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" event={"ID":"d8895b15-f3c4-4c16-8eaf-8586cf81e70c","Type":"ContainerDied","Data":"b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c"} Jun 09 16:02:27.755686 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.755657 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" Jun 09 16:02:27.755961 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.755702 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78bd4c8b96-lkbgs" event={"ID":"d8895b15-f3c4-4c16-8eaf-8586cf81e70c","Type":"ContainerDied","Data":"12f945ad9801666a45c710a8a80081fe16f5ddb1793cc6473988bb91318d2750"} Jun 09 16:02:27.755961 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.755729 2552 scope.go:117] "RemoveContainer" containerID="b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c" Jun 09 16:02:27.766034 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.765949 2552 scope.go:117] "RemoveContainer" containerID="b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c" Jun 09 16:02:27.766395 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:02:27.766312 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c\": container with ID starting with b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c not found: ID does not exist" containerID="b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c" Jun 09 16:02:27.766395 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.766349 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c"} err="failed to get container status \"b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c\": rpc error: code = NotFound desc = could not find container \"b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c\": container with ID starting with b184fa8d0c23a39007c56c89d979849448faac404bb96b0531ca1ffb7050986c not found: ID does not exist" Jun 09 16:02:27.777740 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.777714 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78bd4c8b96-lkbgs"] Jun 09 16:02:27.782114 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:27.782090 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78bd4c8b96-lkbgs"] Jun 09 16:02:28.328700 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:02:28.328644 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sqd7v" podUID="b22de8f2-811c-441c-b602-891e7f8dc8a1" Jun 09 16:02:28.727836 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:28.727802 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8895b15-f3c4-4c16-8eaf-8586cf81e70c" path="/var/lib/kubelet/pods/d8895b15-f3c4-4c16-8eaf-8586cf81e70c/volumes" Jun 09 16:02:28.761315 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:28.761288 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sqd7v" Jun 09 16:02:30.753414 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:30.753388 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d4cf89459-pzrh7" Jun 09 16:02:30.772467 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:30.772434 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerStarted","Data":"51ed0374edd33c9c5cffd4a5e27d9494c63f4ec8e05a4887b2bb05d386be8e66"} Jun 09 16:02:30.772619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:30.772502 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerStarted","Data":"b755f0f83dea7ea117e1c386aef6e6cdec505ac03933c94ad5317eb44963e20a"} Jun 09 16:02:30.772619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:30.772530 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerStarted","Data":"44ec46a17ba0a331602c6aa90d5350f3d740c5828e2b7fec7c647c473a3b6b4c"} Jun 09 16:02:30.772619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:30.772553 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerStarted","Data":"9bda20fcc3c2aced1a2c55848ef2c03afe961ee3214401e8feef7276ef848ade"} Jun 09 16:02:30.772619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:30.772586 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerStarted","Data":"f12dc37cfd5b4cd8972071fe41c746d0f62c46779cbbfceb8b30845a82ae6b30"} Jun 09 16:02:30.772619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:30.772610 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerStarted","Data":"a30d2c3f8287ffe212ea78d9fc0d4fb94131728ca4d21801e80c23ac6adcda13"} Jun 09 16:02:30.801051 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:30.800987 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.623133754 podStartE2EDuration="7.800964646s" totalImagesPullingTime="5.146523349s" totalInitContainerRuntime="31.307543ms" isStatefulPod=false podCreationTimestamp="2026-06-09 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:02:30.79972121 +0000 UTC m=+284.562092730" watchObservedRunningTime="2026-06-09 16:02:30.800964646 +0000 UTC m=+284.563336167" Jun 09 16:02:32.059068 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:32.059015 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 16:02:32.061524 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:32.061496 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b22de8f2-811c-441c-b602-891e7f8dc8a1-metrics-tls\") pod \"dns-default-sqd7v\" (UID: \"b22de8f2-811c-441c-b602-891e7f8dc8a1\") " pod="openshift-dns/dns-default-sqd7v" Jun 09 16:02:32.063655 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:32.063636 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vq2xf\"" Jun 09 16:02:32.072141 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:32.072110 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sqd7v" Jun 09 16:02:32.218710 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:32.218688 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sqd7v"] Jun 09 16:02:32.220750 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:02:32.220721 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22de8f2_811c_441c_b602_891e7f8dc8a1.slice/crio-41751bcb9e6d1923b114faf98e7fd8bc1cab5736621e6f5653e13710a18b427d WatchSource:0}: Error finding container 41751bcb9e6d1923b114faf98e7fd8bc1cab5736621e6f5653e13710a18b427d: Status 404 returned error can't find the container with id 41751bcb9e6d1923b114faf98e7fd8bc1cab5736621e6f5653e13710a18b427d Jun 09 16:02:32.447572 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:32.447537 2552 patch_prober.go:28] interesting pod/image-registry-c9cc4c75b-kb6hx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 16:02:32.447719 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:32.447588 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" podUID="4cb23b1c-451a-4cb1-a963-cbb8c3c24e33" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 16:02:32.782358 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:32.782259 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sqd7v" event={"ID":"b22de8f2-811c-441c-b602-891e7f8dc8a1","Type":"ContainerStarted","Data":"41751bcb9e6d1923b114faf98e7fd8bc1cab5736621e6f5653e13710a18b427d"} Jun 09 16:02:33.840244 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:33.840203 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:02:34.627553 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:34.627520 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c9cc4c75b-kb6hx" Jun 09 16:02:34.792614 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:34.792574 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sqd7v" event={"ID":"b22de8f2-811c-441c-b602-891e7f8dc8a1","Type":"ContainerStarted","Data":"c2da437bb0655b724315be33fdf47ad80cc4a1eee82cd440a2da3e5b77e3e5b7"} Jun 09 16:02:34.792782 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:34.792639 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sqd7v" event={"ID":"b22de8f2-811c-441c-b602-891e7f8dc8a1","Type":"ContainerStarted","Data":"8163e2ee13e116eb8f8cc319f40f2dd3a065cc6f3ae063813a33670871910e55"} Jun 09 16:02:34.792782 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:34.792752 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sqd7v" Jun 09 16:02:34.810496 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:34.810439 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sqd7v" podStartSLOduration=251.01104334 podStartE2EDuration="4m12.810417663s" totalImagesPullingTime="1.799374323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:02:34.808002073 +0000 UTC m=+288.570373590" watchObservedRunningTime="2026-06-09 16:02:34.810417663 +0000 UTC m=+288.572789184" Jun 09 16:02:35.798796 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:35.798759 2552 generic.go:356] "Generic (PLEG): container finished" podID="28e6a4e3-d590-4998-a0cb-d401a7653136" containerID="85e80cfeb909f836bc441f157535771fe1e75129bc35f72b62c6ede2ea41fa94" exitCode=0 Jun 09 16:02:35.799215 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:35.798827 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nqjk" event={"ID":"28e6a4e3-d590-4998-a0cb-d401a7653136","Type":"ContainerDied","Data":"85e80cfeb909f836bc441f157535771fe1e75129bc35f72b62c6ede2ea41fa94"} Jun 09 16:02:36.805471 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:36.805438 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nqjk" event={"ID":"28e6a4e3-d590-4998-a0cb-d401a7653136","Type":"ContainerStarted","Data":"6263db71d1b2e71dba56f2a8f117aae9d98b352273fcb28bbba6cb905e56ecd5"} Jun 09 16:02:36.805852 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:36.805505 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nqjk" event={"ID":"28e6a4e3-d590-4998-a0cb-d401a7653136","Type":"ContainerStarted","Data":"101f893de05ef5802d3fe2b0b7ef4b1cec4d1800f8aacd585a815358fc17f885"} Jun 09 16:02:36.827061 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:36.827000 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5nqjk" podStartSLOduration=2.582756096 podStartE2EDuration="19.826975077s" totalImagesPullingTime="17.176285382s" totalInitContainerRuntime="67.933599ms" isStatefulPod=true podCreationTimestamp="2026-06-09 16:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-06-09 16:02:36.825076646 +0000 UTC m=+290.587448168" watchObservedRunningTime="2026-06-09 16:02:36.826975077 +0000 UTC m=+290.589346598" Jun 09 16:02:41.914643 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:41.914606 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:41.915097 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:41.914704 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:02:44.801743 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:44.801714 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sqd7v" Jun 09 16:02:46.682587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:46.682562 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/ovn-acl-logging/0.log" Jun 09 16:02:46.682980 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:46.682964 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/ovn-acl-logging/0.log" Jun 09 16:02:46.685966 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:46.685946 2552 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 16:02:54.886826 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:54.886793 2552 generic.go:356] "Generic (PLEG): container finished" podID="46bcf61b-ac98-490e-af9a-93e6e936f7cb" containerID="2ad27020c7438bfec5b6e3e26c842b0a04c258e4d51be3ca09d756d0dd168cc9" exitCode=0 Jun 09 16:02:54.887274 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:54.886861 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" event={"ID":"46bcf61b-ac98-490e-af9a-93e6e936f7cb","Type":"ContainerDied","Data":"2ad27020c7438bfec5b6e3e26c842b0a04c258e4d51be3ca09d756d0dd168cc9"} Jun 09 16:02:54.887274 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:54.887220 2552 scope.go:117] "RemoveContainer" containerID="2ad27020c7438bfec5b6e3e26c842b0a04c258e4d51be3ca09d756d0dd168cc9" Jun 09 16:02:55.892769 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:55.892734 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-tvg7c" event={"ID":"46bcf61b-ac98-490e-af9a-93e6e936f7cb","Type":"ContainerStarted","Data":"cefdd3d7b86df3c4fbdaa5dd64ffca18f5d21b67d666e549ff06f4db12aa1730"} Jun 09 16:02:59.910281 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:59.910191 2552 generic.go:356] "Generic (PLEG): container finished" podID="ea817a23-a81e-421c-8d71-5ac82251577c" containerID="81012d1d99816188ed1a03d39e73dca5e4dd677205c52909bee5caf0ae0d8ae9" exitCode=0 Jun 09 16:02:59.910281 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:59.910264 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" event={"ID":"ea817a23-a81e-421c-8d71-5ac82251577c","Type":"ContainerDied","Data":"81012d1d99816188ed1a03d39e73dca5e4dd677205c52909bee5caf0ae0d8ae9"} Jun 09 16:02:59.910668 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:02:59.910585 2552 scope.go:117] "RemoveContainer" containerID="81012d1d99816188ed1a03d39e73dca5e4dd677205c52909bee5caf0ae0d8ae9" Jun 09 16:03:00.916390 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:00.916354 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-x5btt" event={"ID":"ea817a23-a81e-421c-8d71-5ac82251577c","Type":"ContainerStarted","Data":"4b80fbb47a4fd117532ff879a07af55ec40acefa03f589c524aa0298d8aea702"} Jun 09 16:03:01.919618 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:01.919592 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:03:01.924210 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:01.924185 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8595c6cd96-qdb6z" Jun 09 16:03:23.840609 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:23.840563 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:23.861168 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:23.861141 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:24.037593 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:24.037565 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:37.574856 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:37.574772 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 16:03:37.575383 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:37.575202 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="alertmanager" containerID="cri-o://532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700" gracePeriod=120 Jun 09 16:03:37.575383 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:37.575285 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="kube-rbac-proxy-metric" containerID="cri-o://b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c" gracePeriod=120 Jun 09 16:03:37.575383 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:37.575319 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="kube-rbac-proxy-web" containerID="cri-o://839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09" gracePeriod=120 Jun 09 16:03:37.575383 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:37.575335 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="prom-label-proxy" containerID="cri-o://9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20" gracePeriod=120 Jun 09 16:03:37.575666 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:37.575397 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="config-reloader" containerID="cri-o://79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4" gracePeriod=120 Jun 09 16:03:37.575666 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:37.575438 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="kube-rbac-proxy" containerID="cri-o://48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3" gracePeriod=120 Jun 09 16:03:38.083969 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.083931 2552 generic.go:356] "Generic (PLEG): container finished" podID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerID="9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20" exitCode=0 Jun 09 16:03:38.083969 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.083961 2552 generic.go:356] "Generic (PLEG): container finished" podID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerID="48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3" exitCode=0 Jun 09 16:03:38.083969 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.083968 2552 generic.go:356] "Generic (PLEG): container finished" podID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerID="79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4" exitCode=0 Jun 09 16:03:38.083969 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.083978 2552 generic.go:356] "Generic (PLEG): container finished" podID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerID="532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700" exitCode=0 Jun 09 16:03:38.084244 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.083997 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerDied","Data":"9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20"} Jun 09 16:03:38.084244 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.084087 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerDied","Data":"48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3"} Jun 09 16:03:38.084244 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.084112 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerDied","Data":"79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4"} Jun 09 16:03:38.084244 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.084137 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerDied","Data":"532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700"} Jun 09 16:03:38.818297 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.818268 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:38.960935 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.960894 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36d7b9a9-481f-42fd-816f-26a4c2a999c3-metrics-client-ca\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.960935 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.960948 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-main-tls\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.961198 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.960968 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2l26\" (UniqueName: \"kubernetes.io/projected/36d7b9a9-481f-42fd-816f-26a4c2a999c3-kube-api-access-g2l26\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.961198 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.960998 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.961198 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961025 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36d7b9a9-481f-42fd-816f-26a4c2a999c3-alertmanager-main-db\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.961198 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961046 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-web-config\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.961198 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961082 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36d7b9a9-481f-42fd-816f-26a4c2a999c3-config-out\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.961198 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961097 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.961198 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961120 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-config-volume\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.961198 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961160 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36d7b9a9-481f-42fd-816f-26a4c2a999c3-alertmanager-trusted-ca-bundle\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.961644 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961217 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36d7b9a9-481f-42fd-816f-26a4c2a999c3-tls-assets\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.961644 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961250 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-cluster-tls-config\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.961644 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961277 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\" (UID: \"36d7b9a9-481f-42fd-816f-26a4c2a999c3\") " Jun 09 16:03:38.961644 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961378 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d7b9a9-481f-42fd-816f-26a4c2a999c3-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 16:03:38.961644 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961615 2552 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/36d7b9a9-481f-42fd-816f-26a4c2a999c3-alertmanager-main-db\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:38.961644 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961382 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36d7b9a9-481f-42fd-816f-26a4c2a999c3-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 16:03:38.961980 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.961656 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36d7b9a9-481f-42fd-816f-26a4c2a999c3-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 16:03:38.963949 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.963918 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:38.964519 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.964145 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36d7b9a9-481f-42fd-816f-26a4c2a999c3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 16:03:38.964519 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.964178 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:38.964519 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.964201 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:38.964519 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.964388 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36d7b9a9-481f-42fd-816f-26a4c2a999c3-kube-api-access-g2l26" (OuterVolumeSpecName: "kube-api-access-g2l26") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "kube-api-access-g2l26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 16:03:38.964519 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.964484 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:38.964761 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.964580 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d7b9a9-481f-42fd-816f-26a4c2a999c3-config-out" (OuterVolumeSpecName: "config-out") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 16:03:38.965847 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.965827 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-config-volume" (OuterVolumeSpecName: "config-volume") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:38.970517 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.970480 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:38.975911 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:38.975879 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-web-config" (OuterVolumeSpecName: "web-config") pod "36d7b9a9-481f-42fd-816f-26a4c2a999c3" (UID: "36d7b9a9-481f-42fd-816f-26a4c2a999c3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:39.062619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.062579 2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-web-config\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:39.062619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.062612 2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36d7b9a9-481f-42fd-816f-26a4c2a999c3-config-out\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:39.062619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.062622 2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:39.062619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.062630 2552 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-config-volume\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:39.062923 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.062640 2552 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36d7b9a9-481f-42fd-816f-26a4c2a999c3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:39.062923 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.062650 2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36d7b9a9-481f-42fd-816f-26a4c2a999c3-tls-assets\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:39.062923 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.062658 2552 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-cluster-tls-config\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:39.062923 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.062667 2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:39.062923 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.062675 2552 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36d7b9a9-481f-42fd-816f-26a4c2a999c3-metrics-client-ca\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:39.062923 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.062683 2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-main-tls\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:39.062923 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.062691 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2l26\" (UniqueName: \"kubernetes.io/projected/36d7b9a9-481f-42fd-816f-26a4c2a999c3-kube-api-access-g2l26\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:39.062923 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.062701 2552 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36d7b9a9-481f-42fd-816f-26a4c2a999c3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:39.091739 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.091699 2552 generic.go:356] "Generic (PLEG): container finished" podID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerID="b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c" exitCode=0 Jun 09 16:03:39.091739 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.091731 2552 generic.go:356] "Generic (PLEG): container finished" podID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerID="839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09" exitCode=0 Jun 09 16:03:39.092006 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.091777 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerDied","Data":"b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c"} Jun 09 16:03:39.092006 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.091806 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.092006 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.091881 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerDied","Data":"839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09"} Jun 09 16:03:39.092006 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.091894 2552 scope.go:117] "RemoveContainer" containerID="9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20" Jun 09 16:03:39.092006 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.091925 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"36d7b9a9-481f-42fd-816f-26a4c2a999c3","Type":"ContainerDied","Data":"2c73a579554bd1ba4f0ec1d6fef999aa2e3373496825e318e6ed5763bfa7c43d"} Jun 09 16:03:39.100685 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.100664 2552 scope.go:117] "RemoveContainer" containerID="b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c" Jun 09 16:03:39.108382 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.108359 2552 scope.go:117] "RemoveContainer" containerID="48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3" Jun 09 16:03:39.116510 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.116468 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 16:03:39.119140 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.118462 2552 scope.go:117] "RemoveContainer" containerID="839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09" Jun 09 16:03:39.125110 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.125081 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 16:03:39.127735 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.127716 2552 scope.go:117] "RemoveContainer" containerID="79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4" Jun 09 16:03:39.135894 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.135849 2552 scope.go:117] "RemoveContainer" containerID="532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700" Jun 09 16:03:39.144267 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.144241 2552 scope.go:117] "RemoveContainer" containerID="2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6" Jun 09 16:03:39.151025 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.150998 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 16:03:39.151331 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151317 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="kube-rbac-proxy-metric" Jun 09 16:03:39.151378 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151333 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="kube-rbac-proxy-metric" Jun 09 16:03:39.151378 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151343 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="prom-label-proxy" Jun 09 16:03:39.151378 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151350 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="prom-label-proxy" Jun 09 16:03:39.151378 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151362 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8895b15-f3c4-4c16-8eaf-8586cf81e70c" containerName="registry" Jun 09 16:03:39.151378 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151370 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8895b15-f3c4-4c16-8eaf-8586cf81e70c" containerName="registry" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151382 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="kube-rbac-proxy" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151388 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="kube-rbac-proxy" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151401 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="kube-rbac-proxy-web" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151406 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="kube-rbac-proxy-web" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151414 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="config-reloader" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151419 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="config-reloader" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151426 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="alertmanager" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151432 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="alertmanager" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151441 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="init-config-reloader" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151449 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="init-config-reloader" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151494 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="prom-label-proxy" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151502 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="kube-rbac-proxy-web" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151508 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="kube-rbac-proxy" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151517 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="kube-rbac-proxy-metric" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151526 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8895b15-f3c4-4c16-8eaf-8586cf81e70c" containerName="registry" Jun 09 16:03:39.151526 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151533 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="alertmanager" Jun 09 16:03:39.151979 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.151540 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" containerName="config-reloader" Jun 09 16:03:39.152543 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.152521 2552 scope.go:117] "RemoveContainer" containerID="9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20" Jun 09 16:03:39.152899 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:03:39.152877 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20\": container with ID starting with 9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20 not found: ID does not exist" containerID="9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20" Jun 09 16:03:39.152981 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.152913 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20"} err="failed to get container status \"9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20\": rpc error: code = NotFound desc = could not find container \"9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20\": container with ID starting with 9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20 not found: ID does not exist" Jun 09 16:03:39.152981 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.152939 2552 scope.go:117] "RemoveContainer" containerID="b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c" Jun 09 16:03:39.153225 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:03:39.153208 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c\": container with ID starting with b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c not found: ID does not exist" containerID="b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c" Jun 09 16:03:39.153265 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.153232 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c"} err="failed to get container status \"b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c\": rpc error: code = NotFound desc = could not find container \"b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c\": container with ID starting with b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c not found: ID does not exist" Jun 09 16:03:39.153265 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.153251 2552 scope.go:117] "RemoveContainer" containerID="48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3" Jun 09 16:03:39.153499 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:03:39.153482 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3\": container with ID starting with 48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3 not found: ID does not exist" containerID="48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3" Jun 09 16:03:39.153539 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.153504 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3"} err="failed to get container status \"48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3\": rpc error: code = NotFound desc = could not find container \"48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3\": container with ID starting with 48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3 not found: ID does not exist" Jun 09 16:03:39.153539 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.153518 2552 scope.go:117] "RemoveContainer" containerID="839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09" Jun 09 16:03:39.153804 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:03:39.153783 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09\": container with ID starting with 839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09 not found: ID does not exist" containerID="839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09" Jun 09 16:03:39.153860 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.153810 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09"} err="failed to get container status \"839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09\": rpc error: code = NotFound desc = could not find container \"839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09\": container with ID starting with 839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09 not found: ID does not exist" Jun 09 16:03:39.153860 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.153829 2552 scope.go:117] "RemoveContainer" containerID="79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4" Jun 09 16:03:39.154124 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:03:39.154107 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4\": container with ID starting with 79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4 not found: ID does not exist" containerID="79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4" Jun 09 16:03:39.154172 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.154129 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4"} err="failed to get container status \"79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4\": rpc error: code = NotFound desc = could not find container \"79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4\": container with ID starting with 79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4 not found: ID does not exist" Jun 09 16:03:39.154172 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.154143 2552 scope.go:117] "RemoveContainer" containerID="532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700" Jun 09 16:03:39.154380 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:03:39.154362 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700\": container with ID starting with 532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700 not found: ID does not exist" containerID="532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700" Jun 09 16:03:39.154445 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.154389 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700"} err="failed to get container status \"532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700\": rpc error: code = NotFound desc = could not find container \"532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700\": container with ID starting with 532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700 not found: ID does not exist" Jun 09 16:03:39.154445 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.154420 2552 scope.go:117] "RemoveContainer" containerID="2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6" Jun 09 16:03:39.154700 ip-10-0-129-90 kubenswrapper[2552]: E0609 16:03:39.154679 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6\": container with ID starting with 2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6 not found: ID does not exist" containerID="2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6" Jun 09 16:03:39.154743 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.154705 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6"} err="failed to get container status \"2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6\": rpc error: code = NotFound desc = could not find container \"2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6\": container with ID starting with 2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6 not found: ID does not exist" Jun 09 16:03:39.154743 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.154718 2552 scope.go:117] "RemoveContainer" containerID="9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20" Jun 09 16:03:39.154962 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.154941 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20"} err="failed to get container status \"9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20\": rpc error: code = NotFound desc = could not find container \"9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20\": container with ID starting with 9ff0e1e95e312ba3fbfa62a3396a0a62357801d7ce3b77b60d871c58a87d5f20 not found: ID does not exist" Jun 09 16:03:39.155039 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.154964 2552 scope.go:117] "RemoveContainer" containerID="b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c" Jun 09 16:03:39.155198 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.155181 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c"} err="failed to get container status \"b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c\": rpc error: code = NotFound desc = could not find container \"b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c\": container with ID starting with b6e49e8227e4f9fe0bc927867cb332489c5d987f380581bc285b385382e9379c not found: ID does not exist" Jun 09 16:03:39.155245 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.155201 2552 scope.go:117] "RemoveContainer" containerID="48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3" Jun 09 16:03:39.155417 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.155399 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3"} err="failed to get container status \"48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3\": rpc error: code = NotFound desc = could not find container \"48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3\": container with ID starting with 48b8e23f4eee756fe78e48bac77ca13567e266570cefe6d2dff630c3732924f3 not found: ID does not exist" Jun 09 16:03:39.155492 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.155418 2552 scope.go:117] "RemoveContainer" containerID="839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09" Jun 09 16:03:39.155653 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.155633 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09"} err="failed to get container status \"839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09\": rpc error: code = NotFound desc = could not find container \"839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09\": container with ID starting with 839cbd8b80f9b6eb10dbd75764896d692c64652938d61dbec5c3f5930cc78d09 not found: ID does not exist" Jun 09 16:03:39.155653 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.155652 2552 scope.go:117] "RemoveContainer" containerID="79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4" Jun 09 16:03:39.155846 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.155830 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4"} err="failed to get container status \"79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4\": rpc error: code = NotFound desc = could not find container \"79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4\": container with ID starting with 79bf73a2347980c2809a93d62293ad525f69f869b652d84bbe629c5c8ff909e4 not found: ID does not exist" Jun 09 16:03:39.155911 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.155846 2552 scope.go:117] "RemoveContainer" containerID="532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700" Jun 09 16:03:39.156044 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.156031 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.156044 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.156035 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700"} err="failed to get container status \"532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700\": rpc error: code = NotFound desc = could not find container \"532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700\": container with ID starting with 532ff84359a8a1c846452a57e39c66f0497aeb0cf616a07aaf36a7ad5f16f700 not found: ID does not exist" Jun 09 16:03:39.156119 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.156049 2552 scope.go:117] "RemoveContainer" containerID="2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6" Jun 09 16:03:39.156274 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.156243 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6"} err="failed to get container status \"2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6\": rpc error: code = NotFound desc = could not find container \"2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6\": container with ID starting with 2dc6a41bd9d885dfb9c2e82681b8740ac0f83cd48e1a39182fc3b61c3357f2b6 not found: ID does not exist" Jun 09 16:03:39.158036 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.158018 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 16:03:39.158156 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.158086 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 16:03:39.158156 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.158114 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 16:03:39.158267 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.158236 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 16:03:39.158422 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.158406 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 16:03:39.158487 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.158469 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 16:03:39.158539 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.158504 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 16:03:39.158596 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.158570 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 16:03:39.158664 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.158647 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fh4fc\"" Jun 09 16:03:39.164228 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.164201 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 16:03:39.167705 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.167676 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 16:03:39.264171 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264076 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.264171 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264117 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64f63e0e-f8bc-4611-b5b7-72b8820aee33-config-out\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.264171 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264137 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68l4w\" (UniqueName: \"kubernetes.io/projected/64f63e0e-f8bc-4611-b5b7-72b8820aee33-kube-api-access-68l4w\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.264436 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264206 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64f63e0e-f8bc-4611-b5b7-72b8820aee33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.264436 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264234 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-config-volume\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.264436 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264267 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f63e0e-f8bc-4611-b5b7-72b8820aee33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.264436 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264328 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.264436 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264355 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.264436 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264421 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64f63e0e-f8bc-4611-b5b7-72b8820aee33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.264633 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264446 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.264633 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264466 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.264633 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264488 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f63e0e-f8bc-4611-b5b7-72b8820aee33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.264633 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.264513 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-web-config\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.365626 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.365587 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64f63e0e-f8bc-4611-b5b7-72b8820aee33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.365626 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.365628 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.365816 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.365652 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.365816 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.365675 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f63e0e-f8bc-4611-b5b7-72b8820aee33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.365816 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.365699 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-web-config\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.365958 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.365911 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.365958 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.365951 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64f63e0e-f8bc-4611-b5b7-72b8820aee33-config-out\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.366058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.365976 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68l4w\" (UniqueName: \"kubernetes.io/projected/64f63e0e-f8bc-4611-b5b7-72b8820aee33-kube-api-access-68l4w\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.366058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.366019 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64f63e0e-f8bc-4611-b5b7-72b8820aee33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.366058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.366047 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-config-volume\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.366199 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.366096 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f63e0e-f8bc-4611-b5b7-72b8820aee33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.366199 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.366165 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.366313 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.366199 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.367497 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.366719 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64f63e0e-f8bc-4611-b5b7-72b8820aee33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.367497 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.367155 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64f63e0e-f8bc-4611-b5b7-72b8820aee33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.368012 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.367959 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64f63e0e-f8bc-4611-b5b7-72b8820aee33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.368845 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.368819 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-web-config\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.368948 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.368846 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64f63e0e-f8bc-4611-b5b7-72b8820aee33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.368948 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.368853 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.369133 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.369099 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64f63e0e-f8bc-4611-b5b7-72b8820aee33-config-out\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.369238 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.369154 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.369403 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.369383 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.369744 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.369729 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-config-volume\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.370285 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.370267 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.370580 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.370565 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64f63e0e-f8bc-4611-b5b7-72b8820aee33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.374248 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.374227 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68l4w\" (UniqueName: \"kubernetes.io/projected/64f63e0e-f8bc-4611-b5b7-72b8820aee33-kube-api-access-68l4w\") pod \"alertmanager-main-0\" (UID: \"64f63e0e-f8bc-4611-b5b7-72b8820aee33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.467458 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.467419 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 16:03:39.609373 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:39.609343 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 16:03:39.612231 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:03:39.612191 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f63e0e_f8bc_4611_b5b7_72b8820aee33.slice/crio-cd8c8ab8ad6d1b5566ee3ce7c9b5dfb0c1364e9b3b81a1fdd2089537c5ba5f0a WatchSource:0}: Error finding container cd8c8ab8ad6d1b5566ee3ce7c9b5dfb0c1364e9b3b81a1fdd2089537c5ba5f0a: Status 404 returned error can't find the container with id cd8c8ab8ad6d1b5566ee3ce7c9b5dfb0c1364e9b3b81a1fdd2089537c5ba5f0a Jun 09 16:03:40.097676 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:40.097638 2552 generic.go:356] "Generic (PLEG): container finished" podID="64f63e0e-f8bc-4611-b5b7-72b8820aee33" containerID="5ea22477509ab29c2a3f4582186c235c05876f42b5e322682ae038a6e0f28abe" exitCode=0 Jun 09 16:03:40.098159 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:40.097729 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f63e0e-f8bc-4611-b5b7-72b8820aee33","Type":"ContainerDied","Data":"5ea22477509ab29c2a3f4582186c235c05876f42b5e322682ae038a6e0f28abe"} Jun 09 16:03:40.098159 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:40.097861 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f63e0e-f8bc-4611-b5b7-72b8820aee33","Type":"ContainerStarted","Data":"cd8c8ab8ad6d1b5566ee3ce7c9b5dfb0c1364e9b3b81a1fdd2089537c5ba5f0a"} Jun 09 16:03:40.726787 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:40.726756 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36d7b9a9-481f-42fd-816f-26a4c2a999c3" path="/var/lib/kubelet/pods/36d7b9a9-481f-42fd-816f-26a4c2a999c3/volumes" Jun 09 16:03:41.105874 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.105781 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f63e0e-f8bc-4611-b5b7-72b8820aee33","Type":"ContainerStarted","Data":"e0ab5d2b2c0b7267e2ff2cd396c3ec2085d0a43a1c2c8b5484df8348c272aa40"} Jun 09 16:03:41.105874 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.105844 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f63e0e-f8bc-4611-b5b7-72b8820aee33","Type":"ContainerStarted","Data":"2276e483f635c95e7b361dc4a71d4a7367bd72f5165558fe600acc6c3c415f13"} Jun 09 16:03:41.106267 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.105891 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f63e0e-f8bc-4611-b5b7-72b8820aee33","Type":"ContainerStarted","Data":"c3b6ac54633bdcf7b28229ac6f8096661dccc115ca416a0cae8fd71fe268df5b"} Jun 09 16:03:41.106267 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.105916 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f63e0e-f8bc-4611-b5b7-72b8820aee33","Type":"ContainerStarted","Data":"7a9ec3e06c5b90437de4dd2505d7e67db74b8ea4387b976793661f168f5ac65f"} Jun 09 16:03:41.106267 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.105940 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f63e0e-f8bc-4611-b5b7-72b8820aee33","Type":"ContainerStarted","Data":"176b4b43d51e7a5472472dd24728f3e31f29806da805f984411d9f44b60cacdf"} Jun 09 16:03:41.106267 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.105963 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64f63e0e-f8bc-4611-b5b7-72b8820aee33","Type":"ContainerStarted","Data":"a9ab5da65012c0c838a2dc8fd6c3a09befa1ab14b09ca2e5412cb2deec426417"} Jun 09 16:03:41.132055 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.131991 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.115224928 podStartE2EDuration="2.131972904s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.747976ms" isStatefulPod=false podCreationTimestamp="2026-06-09 16:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:03:41.129043128 +0000 UTC m=+354.891414648" watchObservedRunningTime="2026-06-09 16:03:41.131972904 +0000 UTC m=+354.894344424" Jun 09 16:03:41.605191 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.605154 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz"] Jun 09 16:03:41.608928 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.608909 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.611004 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.610980 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 16:03:41.611125 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.611036 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 16:03:41.611125 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.611047 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 16:03:41.611125 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.611049 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 16:03:41.611125 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.611076 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 16:03:41.611836 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.611809 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9npwb\"" Jun 09 16:03:41.615807 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.615785 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 16:03:41.619902 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.619879 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz"] Jun 09 16:03:41.789389 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.789345 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98df2e2-e479-47d5-a658-ecc091b592fd-metrics-client-ca\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.789389 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.789385 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98df2e2-e479-47d5-a658-ecc091b592fd-serving-certs-ca-bundle\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.789619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.789409 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c98df2e2-e479-47d5-a658-ecc091b592fd-telemeter-client-tls\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.789619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.789509 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c98df2e2-e479-47d5-a658-ecc091b592fd-federate-client-tls\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.789619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.789564 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98df2e2-e479-47d5-a658-ecc091b592fd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.789619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.789593 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c98df2e2-e479-47d5-a658-ecc091b592fd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.789619 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.789612 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c98df2e2-e479-47d5-a658-ecc091b592fd-secret-telemeter-client\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.789838 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.789631 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdn27\" (UniqueName: \"kubernetes.io/projected/c98df2e2-e479-47d5-a658-ecc091b592fd-kube-api-access-zdn27\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.884834 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.884744 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 16:03:41.885096 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.885067 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="prometheus" containerID="cri-o://a30d2c3f8287ffe212ea78d9fc0d4fb94131728ca4d21801e80c23ac6adcda13" gracePeriod=600 Jun 09 16:03:41.885164 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.885111 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="kube-rbac-proxy-web" containerID="cri-o://44ec46a17ba0a331602c6aa90d5350f3d740c5828e2b7fec7c647c473a3b6b4c" gracePeriod=600 Jun 09 16:03:41.885164 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.885116 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="thanos-sidecar" containerID="cri-o://9bda20fcc3c2aced1a2c55848ef2c03afe961ee3214401e8feef7276ef848ade" gracePeriod=600 Jun 09 16:03:41.885164 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.885069 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="kube-rbac-proxy" containerID="cri-o://b755f0f83dea7ea117e1c386aef6e6cdec505ac03933c94ad5317eb44963e20a" gracePeriod=600 Jun 09 16:03:41.885294 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.885154 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="config-reloader" containerID="cri-o://f12dc37cfd5b4cd8972071fe41c746d0f62c46779cbbfceb8b30845a82ae6b30" gracePeriod=600 Jun 09 16:03:41.885294 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.885116 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://51ed0374edd33c9c5cffd4a5e27d9494c63f4ec8e05a4887b2bb05d386be8e66" gracePeriod=600 Jun 09 16:03:41.894752 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.892189 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c98df2e2-e479-47d5-a658-ecc091b592fd-federate-client-tls\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.894752 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.893009 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98df2e2-e479-47d5-a658-ecc091b592fd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.894752 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.893054 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c98df2e2-e479-47d5-a658-ecc091b592fd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.894752 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.893316 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c98df2e2-e479-47d5-a658-ecc091b592fd-secret-telemeter-client\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.894752 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.893357 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdn27\" (UniqueName: \"kubernetes.io/projected/c98df2e2-e479-47d5-a658-ecc091b592fd-kube-api-access-zdn27\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.894752 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.893407 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98df2e2-e479-47d5-a658-ecc091b592fd-metrics-client-ca\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.894752 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.893440 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98df2e2-e479-47d5-a658-ecc091b592fd-serving-certs-ca-bundle\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.894752 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.893466 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c98df2e2-e479-47d5-a658-ecc091b592fd-telemeter-client-tls\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.894752 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.894445 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98df2e2-e479-47d5-a658-ecc091b592fd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.899769 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.899668 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c98df2e2-e479-47d5-a658-ecc091b592fd-federate-client-tls\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.899769 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.899668 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c98df2e2-e479-47d5-a658-ecc091b592fd-telemeter-client-tls\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.899769 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.899730 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c98df2e2-e479-47d5-a658-ecc091b592fd-secret-telemeter-client\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.900438 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.900402 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c98df2e2-e479-47d5-a658-ecc091b592fd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.900717 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.900693 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98df2e2-e479-47d5-a658-ecc091b592fd-metrics-client-ca\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.900809 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.900750 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98df2e2-e479-47d5-a658-ecc091b592fd-serving-certs-ca-bundle\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.903556 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.903532 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdn27\" (UniqueName: \"kubernetes.io/projected/c98df2e2-e479-47d5-a658-ecc091b592fd-kube-api-access-zdn27\") pod \"telemeter-client-75cfd7b7d6-mn4dz\" (UID: \"c98df2e2-e479-47d5-a658-ecc091b592fd\") " pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:41.920247 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:41.920223 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" Jun 09 16:03:42.063632 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.063607 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz"] Jun 09 16:03:42.065947 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:03:42.065919 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98df2e2_e479_47d5_a658_ecc091b592fd.slice/crio-4f8e005ab95bbd9cffd8c10874500f334b614d3658c6113ece0e62b4b03ff7ef WatchSource:0}: Error finding container 4f8e005ab95bbd9cffd8c10874500f334b614d3658c6113ece0e62b4b03ff7ef: Status 404 returned error can't find the container with id 4f8e005ab95bbd9cffd8c10874500f334b614d3658c6113ece0e62b4b03ff7ef Jun 09 16:03:42.067999 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.067978 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 16:03:42.112844 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.112810 2552 generic.go:356] "Generic (PLEG): container finished" podID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerID="51ed0374edd33c9c5cffd4a5e27d9494c63f4ec8e05a4887b2bb05d386be8e66" exitCode=0 Jun 09 16:03:42.112844 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.112834 2552 generic.go:356] "Generic (PLEG): container finished" podID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerID="b755f0f83dea7ea117e1c386aef6e6cdec505ac03933c94ad5317eb44963e20a" exitCode=0 Jun 09 16:03:42.112844 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.112840 2552 generic.go:356] "Generic (PLEG): container finished" podID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerID="9bda20fcc3c2aced1a2c55848ef2c03afe961ee3214401e8feef7276ef848ade" exitCode=0 Jun 09 16:03:42.112844 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.112845 2552 generic.go:356] "Generic (PLEG): container finished" podID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerID="f12dc37cfd5b4cd8972071fe41c746d0f62c46779cbbfceb8b30845a82ae6b30" exitCode=0 Jun 09 16:03:42.112844 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.112850 2552 generic.go:356] "Generic (PLEG): container finished" podID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerID="a30d2c3f8287ffe212ea78d9fc0d4fb94131728ca4d21801e80c23ac6adcda13" exitCode=0 Jun 09 16:03:42.113455 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.112907 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerDied","Data":"51ed0374edd33c9c5cffd4a5e27d9494c63f4ec8e05a4887b2bb05d386be8e66"} Jun 09 16:03:42.113455 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.112993 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerDied","Data":"b755f0f83dea7ea117e1c386aef6e6cdec505ac03933c94ad5317eb44963e20a"} Jun 09 16:03:42.113455 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.113041 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerDied","Data":"9bda20fcc3c2aced1a2c55848ef2c03afe961ee3214401e8feef7276ef848ade"} Jun 09 16:03:42.113455 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.113078 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerDied","Data":"f12dc37cfd5b4cd8972071fe41c746d0f62c46779cbbfceb8b30845a82ae6b30"} Jun 09 16:03:42.113455 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.113119 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerDied","Data":"a30d2c3f8287ffe212ea78d9fc0d4fb94131728ca4d21801e80c23ac6adcda13"} Jun 09 16:03:42.114104 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:42.114082 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" event={"ID":"c98df2e2-e479-47d5-a658-ecc091b592fd","Type":"ContainerStarted","Data":"4f8e005ab95bbd9cffd8c10874500f334b614d3658c6113ece0e62b4b03ff7ef"} Jun 09 16:03:43.122615 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.122581 2552 generic.go:356] "Generic (PLEG): container finished" podID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerID="44ec46a17ba0a331602c6aa90d5350f3d740c5828e2b7fec7c647c473a3b6b4c" exitCode=0 Jun 09 16:03:43.123078 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.122658 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerDied","Data":"44ec46a17ba0a331602c6aa90d5350f3d740c5828e2b7fec7c647c473a3b6b4c"} Jun 09 16:03:43.167283 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.167256 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:43.307189 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307083 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-0\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307189 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307129 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307189 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307152 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-trusted-ca-bundle\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307189 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307176 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-web-config\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307212 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g97gx\" (UniqueName: \"kubernetes.io/projected/b46878ee-d9e9-4162-ab12-2010a877b7b8-kube-api-access-g97gx\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307236 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-serving-certs-ca-bundle\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307264 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-2\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307304 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-1\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307331 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-kubelet-serving-ca-bundle\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307373 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307403 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-metrics-client-ca\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307443 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b46878ee-d9e9-4162-ab12-2010a877b7b8-tls-assets\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307466 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b46878ee-d9e9-4162-ab12-2010a877b7b8-config-out\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307491 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-config\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.307525 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307517 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-db\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.308076 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307577 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-grpc-tls\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.308076 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307614 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-kube-rbac-proxy\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.308076 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307674 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-thanos-prometheus-http-client-file\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.308076 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307702 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-metrics-client-certs\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.308076 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307740 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-tls\") pod \"b46878ee-d9e9-4162-ab12-2010a877b7b8\" (UID: \"b46878ee-d9e9-4162-ab12-2010a877b7b8\") " Jun 09 16:03:43.308076 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.307829 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 16:03:43.308387 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.308170 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.308748 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.308614 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 16:03:43.308884 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.308756 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 16:03:43.308956 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.308861 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 16:03:43.310498 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.309772 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 16:03:43.310498 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.309990 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 16:03:43.310498 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.310387 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 16:03:43.310859 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.310822 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 16:03:43.311964 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.311902 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:43.312067 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.311986 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46878ee-d9e9-4162-ab12-2010a877b7b8-kube-api-access-g97gx" (OuterVolumeSpecName: "kube-api-access-g97gx") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "kube-api-access-g97gx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 16:03:43.312727 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.312692 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:43.313348 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.313309 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-config" (OuterVolumeSpecName: "config") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:43.313772 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.313566 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b46878ee-d9e9-4162-ab12-2010a877b7b8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 16:03:43.313855 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.313824 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:43.313855 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.313845 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:43.314692 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.314614 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:43.315594 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.315567 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b46878ee-d9e9-4162-ab12-2010a877b7b8-config-out" (OuterVolumeSpecName: "config-out") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 16:03:43.316219 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.316181 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:43.316219 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.316203 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:43.326587 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.326546 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-web-config" (OuterVolumeSpecName: "web-config") pod "b46878ee-d9e9-4162-ab12-2010a877b7b8" (UID: "b46878ee-d9e9-4162-ab12-2010a877b7b8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 16:03:43.409083 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409032 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g97gx\" (UniqueName: \"kubernetes.io/projected/b46878ee-d9e9-4162-ab12-2010a877b7b8-kube-api-access-g97gx\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409083 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409075 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409083 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409086 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409083 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409095 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409083 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409107 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409117 2552 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-configmap-metrics-client-ca\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409127 2552 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b46878ee-d9e9-4162-ab12-2010a877b7b8-tls-assets\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409135 2552 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b46878ee-d9e9-4162-ab12-2010a877b7b8-config-out\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409142 2552 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-config\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409150 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-db\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409158 2552 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-grpc-tls\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409167 2552 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-kube-rbac-proxy\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409175 2552 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409184 2552 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-metrics-client-certs\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409192 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409200 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409208 2552 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409216 2552 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b46878ee-d9e9-4162-ab12-2010a877b7b8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:43.409398 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:43.409225 2552 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b46878ee-d9e9-4162-ab12-2010a877b7b8-web-config\") on node \"ip-10-0-129-90.ec2.internal\" DevicePath \"\"" Jun 09 16:03:44.132479 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.132227 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b46878ee-d9e9-4162-ab12-2010a877b7b8","Type":"ContainerDied","Data":"ddc9cc331eb66728f744123699088e57edc7ed4085a22dcc45898ff2f88c3b53"} Jun 09 16:03:44.132479 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.132328 2552 scope.go:117] "RemoveContainer" containerID="51ed0374edd33c9c5cffd4a5e27d9494c63f4ec8e05a4887b2bb05d386be8e66" Jun 09 16:03:44.132479 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.132355 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.160546 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.160446 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 16:03:44.164475 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.164441 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 16:03:44.189931 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.189895 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 16:03:44.190311 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190294 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="kube-rbac-proxy" Jun 09 16:03:44.190311 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190312 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="kube-rbac-proxy" Jun 09 16:03:44.190440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190321 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="init-config-reloader" Jun 09 16:03:44.190440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190327 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="init-config-reloader" Jun 09 16:03:44.190440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190335 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="thanos-sidecar" Jun 09 16:03:44.190440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190342 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="thanos-sidecar" Jun 09 16:03:44.190440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190356 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="config-reloader" Jun 09 16:03:44.190440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190364 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="config-reloader" Jun 09 16:03:44.190440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190378 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="kube-rbac-proxy-thanos" Jun 09 16:03:44.190440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190386 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="kube-rbac-proxy-thanos" Jun 09 16:03:44.190440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190399 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="prometheus" Jun 09 16:03:44.190440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190407 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="prometheus" Jun 09 16:03:44.190440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190435 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="kube-rbac-proxy-web" Jun 09 16:03:44.190440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190441 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="kube-rbac-proxy-web" Jun 09 16:03:44.191033 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190494 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="kube-rbac-proxy-thanos" Jun 09 16:03:44.191033 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190505 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="config-reloader" Jun 09 16:03:44.191033 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190516 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="kube-rbac-proxy-web" Jun 09 16:03:44.191033 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190526 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="prometheus" Jun 09 16:03:44.191033 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190535 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="kube-rbac-proxy" Jun 09 16:03:44.191033 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.190542 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" containerName="thanos-sidecar" Jun 09 16:03:44.195440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.195412 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.197776 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.197620 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 16:03:44.197776 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.197620 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 16:03:44.198062 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.197934 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 16:03:44.198062 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.197944 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pxmqf\"" Jun 09 16:03:44.198062 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.198007 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 16:03:44.198221 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.198212 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 16:03:44.198279 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.198219 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-42calllhvdm0t\"" Jun 09 16:03:44.198279 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.198245 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 16:03:44.198585 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.198404 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 16:03:44.198585 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.198467 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 16:03:44.198585 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.198478 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 16:03:44.198797 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.198731 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 16:03:44.198894 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.198839 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 16:03:44.199110 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.199088 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 16:03:44.202466 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.202439 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 16:03:44.207419 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.207001 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 16:03:44.226889 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.211285 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 16:03:44.324010 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.323970 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324227 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324018 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324227 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324053 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324227 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324133 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324227 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324212 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324240 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324257 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324272 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324327 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324361 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324403 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324440 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324440 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324731 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324488 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324731 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324510 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324731 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324577 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-config\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324731 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324609 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jk29\" (UniqueName: \"kubernetes.io/projected/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-kube-api-access-8jk29\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324731 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324635 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324731 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324659 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.324731 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324721 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.325038 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.324750 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.421361 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.421334 2552 scope.go:117] "RemoveContainer" containerID="b755f0f83dea7ea117e1c386aef6e6cdec505ac03933c94ad5317eb44963e20a" Jun 09 16:03:44.425959 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.425926 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426104 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.425979 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426176 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426158 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426232 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426195 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426232 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426220 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426335 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426246 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426335 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426263 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426335 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426310 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-config\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426503 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426340 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jk29\" (UniqueName: \"kubernetes.io/projected/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-kube-api-access-8jk29\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426503 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426368 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426503 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426401 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426503 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426440 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426503 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426475 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426741 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426505 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426741 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426533 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426741 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426569 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426741 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426616 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426741 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426700 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.426741 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426729 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.427058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426751 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.427058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426813 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.427058 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.426940 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.427217 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.427101 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.428077 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.428048 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.428077 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.428070 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.429251 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.429043 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.429251 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.429210 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.430352 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.430304 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-config-out\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.430460 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.430407 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-config\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.430813 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.430778 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.431584 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.431376 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.431584 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.431540 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-web-config\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.431584 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.431546 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.431584 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.431573 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.431846 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.431814 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.432104 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.432083 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.433332 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.433306 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.433588 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.433507 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.434179 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.434160 2552 scope.go:117] "RemoveContainer" containerID="44ec46a17ba0a331602c6aa90d5350f3d740c5828e2b7fec7c647c473a3b6b4c" Jun 09 16:03:44.434536 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.434513 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.435987 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.435969 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jk29\" (UniqueName: \"kubernetes.io/projected/e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a-kube-api-access-8jk29\") pod \"prometheus-k8s-0\" (UID: \"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.472170 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.472133 2552 scope.go:117] "RemoveContainer" containerID="9bda20fcc3c2aced1a2c55848ef2c03afe961ee3214401e8feef7276ef848ade" Jun 09 16:03:44.479896 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.479857 2552 scope.go:117] "RemoveContainer" containerID="f12dc37cfd5b4cd8972071fe41c746d0f62c46779cbbfceb8b30845a82ae6b30" Jun 09 16:03:44.487638 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.487614 2552 scope.go:117] "RemoveContainer" containerID="a30d2c3f8287ffe212ea78d9fc0d4fb94131728ca4d21801e80c23ac6adcda13" Jun 09 16:03:44.497532 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.497509 2552 scope.go:117] "RemoveContainer" containerID="fe7ebc76147ebd5243ec9f021e34c5228039da47d683fa46f609adccb946ea37" Jun 09 16:03:44.508900 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.508843 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:03:44.671531 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.671448 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 16:03:44.674236 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:03:44.674209 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fa9613_87ce_4d27_8e71_1ce2d7b12e5a.slice/crio-fb50318beb42dd868a76f5bb08bc6c85dbef4ec9c4f749a5f0f0575db6797c6e WatchSource:0}: Error finding container fb50318beb42dd868a76f5bb08bc6c85dbef4ec9c4f749a5f0f0575db6797c6e: Status 404 returned error can't find the container with id fb50318beb42dd868a76f5bb08bc6c85dbef4ec9c4f749a5f0f0575db6797c6e Jun 09 16:03:44.726071 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:44.726031 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b46878ee-d9e9-4162-ab12-2010a877b7b8" path="/var/lib/kubelet/pods/b46878ee-d9e9-4162-ab12-2010a877b7b8/volumes" Jun 09 16:03:45.138216 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:45.138124 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" event={"ID":"c98df2e2-e479-47d5-a658-ecc091b592fd","Type":"ContainerStarted","Data":"3e51263ecbe0e548475547ccfc91770c8c943e843947aec9f89e3425759847b9"} Jun 09 16:03:45.138216 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:45.138183 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" event={"ID":"c98df2e2-e479-47d5-a658-ecc091b592fd","Type":"ContainerStarted","Data":"843c5f331bdaa5afbcaeeffa3393c76017f761624c5ad688051835d305d06426"} Jun 09 16:03:45.138216 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:45.138203 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" event={"ID":"c98df2e2-e479-47d5-a658-ecc091b592fd","Type":"ContainerStarted","Data":"9afdaaef271d417e34c2ab13a52583843cfe1a2066ad61f6b0e4db7c5f45714c"} Jun 09 16:03:45.139676 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:45.139653 2552 generic.go:356] "Generic (PLEG): container finished" podID="e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a" containerID="778c1eb38413b6496cf037e8b311db3cb822e6ef056ead3199e612b8c6c4dea4" exitCode=0 Jun 09 16:03:45.139782 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:45.139734 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a","Type":"ContainerDied","Data":"778c1eb38413b6496cf037e8b311db3cb822e6ef056ead3199e612b8c6c4dea4"} Jun 09 16:03:45.139837 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:45.139800 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a","Type":"ContainerStarted","Data":"fb50318beb42dd868a76f5bb08bc6c85dbef4ec9c4f749a5f0f0575db6797c6e"} Jun 09 16:03:45.158503 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:45.158441 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75cfd7b7d6-mn4dz" podStartSLOduration=1.7453161640000001 podStartE2EDuration="4.158419425s" totalImagesPullingTime="2.413103261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:03:45.156614521 +0000 UTC m=+358.918986064" watchObservedRunningTime="2026-06-09 16:03:45.158419425 +0000 UTC m=+358.920790947" Jun 09 16:03:46.148705 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:46.148602 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a","Type":"ContainerStarted","Data":"b7dcf4dfa2d789d587bd069676d28094c2d52336727ddf1d90463347c3e15de1"} Jun 09 16:03:46.148705 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:46.148686 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a","Type":"ContainerStarted","Data":"ed614e7e6592d34f5648e24ff14f6249d263caad0f84687aceab97f119059c35"} Jun 09 16:03:46.149245 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:46.148732 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a","Type":"ContainerStarted","Data":"e0fb0910bcf408e3cd51aec51516d6b5c4e407822c460f0eec69ed4c7b80c979"} Jun 09 16:03:46.149245 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:46.148772 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a","Type":"ContainerStarted","Data":"0a60f417902a55f376b25ab9e175cd50f0b551a401d00db2cbfc8c68aa3e0ad9"} Jun 09 16:03:46.149245 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:46.148810 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a","Type":"ContainerStarted","Data":"a6b2a12d5a85d5de9c39bc0d94169b65719d49bd29debe9cacfe45d16a1ef1ee"} Jun 09 16:03:46.149245 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:46.148853 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a","Type":"ContainerStarted","Data":"4d11e7daf043e5d74513c40e41acc435b5711bc26cdb1a78a1026d3b27ae18de"} Jun 09 16:03:46.182642 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:46.182565 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.159243187 podStartE2EDuration="2.182519874s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.276687ms" isStatefulPod=false podCreationTimestamp="2026-06-09 16:03:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:03:46.180671926 +0000 UTC m=+359.943043447" watchObservedRunningTime="2026-06-09 16:03:46.182519874 +0000 UTC m=+359.944891394" Jun 09 16:03:49.508994 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:03:49.508955 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:04:44.509401 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:04:44.509360 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:04:44.525802 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:04:44.525775 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:04:45.406861 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:04:45.406833 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 16:05:31.552327 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:31.552298 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-78c48_60a22ce0-7c31-4359-80b4-f60d0c3b6867/global-pull-secret-syncer/0.log" Jun 09 16:05:31.701568 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:31.701532 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9ntcd_a28ca345-3d41-4027-a7ac-dddc8bc731bb/konnectivity-agent/0.log" Jun 09 16:05:31.748570 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:31.748537 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-90.ec2.internal_b9f0f8ac9348fb900d92b838474a523e/haproxy/0.log" Jun 09 16:05:35.260927 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.260900 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64f63e0e-f8bc-4611-b5b7-72b8820aee33/alertmanager/0.log" Jun 09 16:05:35.292298 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.292267 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64f63e0e-f8bc-4611-b5b7-72b8820aee33/config-reloader/0.log" Jun 09 16:05:35.317437 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.317412 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64f63e0e-f8bc-4611-b5b7-72b8820aee33/kube-rbac-proxy-web/0.log" Jun 09 16:05:35.353339 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.353310 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64f63e0e-f8bc-4611-b5b7-72b8820aee33/kube-rbac-proxy/0.log" Jun 09 16:05:35.380675 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.380602 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64f63e0e-f8bc-4611-b5b7-72b8820aee33/kube-rbac-proxy-metric/0.log" Jun 09 16:05:35.405812 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.405778 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64f63e0e-f8bc-4611-b5b7-72b8820aee33/prom-label-proxy/0.log" Jun 09 16:05:35.433368 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.433347 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64f63e0e-f8bc-4611-b5b7-72b8820aee33/init-config-reloader/0.log" Jun 09 16:05:35.473745 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.473715 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-twdnl_c110805c-1587-445b-b71b-2a2a4a7bb10a/cluster-monitoring-operator/0.log" Jun 09 16:05:35.598498 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.598469 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8595c6cd96-qdb6z_c4989818-fa78-4a78-9744-0201edaf73cc/metrics-server/0.log" Jun 09 16:05:35.623810 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.623781 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-pff5l_d8ec653b-8d5f-43db-8cde-875280645f93/monitoring-plugin/0.log" Jun 09 16:05:35.658814 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.658735 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nqjk_28e6a4e3-d590-4998-a0cb-d401a7653136/node-exporter/0.log" Jun 09 16:05:35.682618 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.682587 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nqjk_28e6a4e3-d590-4998-a0cb-d401a7653136/kube-rbac-proxy/0.log" Jun 09 16:05:35.706113 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.706090 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nqjk_28e6a4e3-d590-4998-a0cb-d401a7653136/init-textfile/0.log" Jun 09 16:05:35.998757 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:35.998695 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a/prometheus/0.log" Jun 09 16:05:36.018800 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.018773 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a/config-reloader/0.log" Jun 09 16:05:36.040513 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.040484 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a/thanos-sidecar/0.log" Jun 09 16:05:36.063644 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.063617 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a/kube-rbac-proxy-web/0.log" Jun 09 16:05:36.087211 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.087179 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a/kube-rbac-proxy/0.log" Jun 09 16:05:36.110485 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.110459 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a/kube-rbac-proxy-thanos/0.log" Jun 09 16:05:36.132532 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.132513 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e8fa9613-87ce-4d27-8e71-1ce2d7b12e5a/init-config-reloader/0.log" Jun 09 16:05:36.213183 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.213151 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-67nhp_55a3c874-01fb-4f71-8b8d-a4dc5335d446/prometheus-operator-admission-webhook/0.log" Jun 09 16:05:36.253796 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.253718 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75cfd7b7d6-mn4dz_c98df2e2-e479-47d5-a658-ecc091b592fd/telemeter-client/0.log" Jun 09 16:05:36.283910 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.283861 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75cfd7b7d6-mn4dz_c98df2e2-e479-47d5-a658-ecc091b592fd/reload/0.log" Jun 09 16:05:36.304551 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.304517 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75cfd7b7d6-mn4dz_c98df2e2-e479-47d5-a658-ecc091b592fd/kube-rbac-proxy/0.log" Jun 09 16:05:36.335659 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.335629 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4cf89459-pzrh7_04c1ca78-04a6-4240-86bf-7f7b089752bb/thanos-query/0.log" Jun 09 16:05:36.355679 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.355651 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4cf89459-pzrh7_04c1ca78-04a6-4240-86bf-7f7b089752bb/kube-rbac-proxy-web/0.log" Jun 09 16:05:36.376549 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.376523 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4cf89459-pzrh7_04c1ca78-04a6-4240-86bf-7f7b089752bb/kube-rbac-proxy/0.log" Jun 09 16:05:36.397466 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.397444 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4cf89459-pzrh7_04c1ca78-04a6-4240-86bf-7f7b089752bb/prom-label-proxy/0.log" Jun 09 16:05:36.422128 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.422099 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4cf89459-pzrh7_04c1ca78-04a6-4240-86bf-7f7b089752bb/kube-rbac-proxy-rules/0.log" Jun 09 16:05:36.450384 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:36.450356 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d4cf89459-pzrh7_04c1ca78-04a6-4240-86bf-7f7b089752bb/kube-rbac-proxy-metrics/0.log" Jun 09 16:05:39.187640 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.187601 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p"] Jun 09 16:05:39.191164 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.191145 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.193119 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.193098 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ktdb2\"/\"openshift-service-ca.crt\"" Jun 09 16:05:39.193539 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.193521 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ktdb2\"/\"default-dockercfg-n989p\"" Jun 09 16:05:39.193539 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.193532 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ktdb2\"/\"kube-root-ca.crt\"" Jun 09 16:05:39.199882 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.199843 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p"] Jun 09 16:05:39.268112 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.268071 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g768c\" (UniqueName: \"kubernetes.io/projected/b36f153f-d2ae-4537-9ede-7f9021e9db66-kube-api-access-g768c\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.268314 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.268151 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b36f153f-d2ae-4537-9ede-7f9021e9db66-sys\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.268314 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.268178 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b36f153f-d2ae-4537-9ede-7f9021e9db66-proc\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.268314 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.268198 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b36f153f-d2ae-4537-9ede-7f9021e9db66-lib-modules\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.268314 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.268280 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b36f153f-d2ae-4537-9ede-7f9021e9db66-podres\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.369054 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.369012 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g768c\" (UniqueName: \"kubernetes.io/projected/b36f153f-d2ae-4537-9ede-7f9021e9db66-kube-api-access-g768c\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.369222 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.369076 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b36f153f-d2ae-4537-9ede-7f9021e9db66-sys\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.369222 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.369095 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b36f153f-d2ae-4537-9ede-7f9021e9db66-proc\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.369222 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.369111 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b36f153f-d2ae-4537-9ede-7f9021e9db66-lib-modules\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.369222 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.369146 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b36f153f-d2ae-4537-9ede-7f9021e9db66-podres\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.369379 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.369230 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b36f153f-d2ae-4537-9ede-7f9021e9db66-proc\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.369379 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.369250 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b36f153f-d2ae-4537-9ede-7f9021e9db66-sys\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.369379 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.369288 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b36f153f-d2ae-4537-9ede-7f9021e9db66-lib-modules\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.369379 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.369297 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b36f153f-d2ae-4537-9ede-7f9021e9db66-podres\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.376656 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.376636 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g768c\" (UniqueName: \"kubernetes.io/projected/b36f153f-d2ae-4537-9ede-7f9021e9db66-kube-api-access-g768c\") pod \"perf-node-gather-daemonset-h8c5p\" (UID: \"b36f153f-d2ae-4537-9ede-7f9021e9db66\") " pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.503016 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.502928 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:39.636322 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.636259 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p"] Jun 09 16:05:39.638745 ip-10-0-129-90 kubenswrapper[2552]: W0609 16:05:39.638715 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb36f153f_d2ae_4537_9ede_7f9021e9db66.slice/crio-3bfc0409accb997c4c291be8190f3fa6d6796c0ddcf5f754131ab189839008af WatchSource:0}: Error finding container 3bfc0409accb997c4c291be8190f3fa6d6796c0ddcf5f754131ab189839008af: Status 404 returned error can't find the container with id 3bfc0409accb997c4c291be8190f3fa6d6796c0ddcf5f754131ab189839008af Jun 09 16:05:39.873828 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.873753 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sqd7v_b22de8f2-811c-441c-b602-891e7f8dc8a1/dns/0.log" Jun 09 16:05:39.893623 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.893597 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sqd7v_b22de8f2-811c-441c-b602-891e7f8dc8a1/kube-rbac-proxy/0.log" Jun 09 16:05:39.978412 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:39.978383 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hrjwl_72560997-9dd8-4a00-b6fa-46956d8a83ba/dns-node-resolver/0.log" Jun 09 16:05:40.379498 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:40.379472 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c9cc4c75b-kb6hx_4cb23b1c-451a-4cb1-a963-cbb8c3c24e33/registry/0.log" Jun 09 16:05:40.447774 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:40.447746 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pf7mr_24727568-0efb-4a24-9df1-0e2d64e92576/node-ca/0.log" Jun 09 16:05:40.614043 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:40.614003 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" event={"ID":"b36f153f-d2ae-4537-9ede-7f9021e9db66","Type":"ContainerStarted","Data":"f0575c231547a15f4f478af3be2c46b910b3d72a0fe3d736b33a3c00d1a9dc4f"} Jun 09 16:05:40.614200 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:40.614069 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" event={"ID":"b36f153f-d2ae-4537-9ede-7f9021e9db66","Type":"ContainerStarted","Data":"3bfc0409accb997c4c291be8190f3fa6d6796c0ddcf5f754131ab189839008af"} Jun 09 16:05:40.614200 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:40.614122 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:40.628724 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:40.628668 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" podStartSLOduration=1.628653904 podStartE2EDuration="1.628653904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 16:05:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:05:40.626925029 +0000 UTC m=+474.389296550" watchObservedRunningTime="2026-06-09 16:05:40.628653904 +0000 UTC m=+474.391025424" Jun 09 16:05:41.377763 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:41.377736 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9vvn8_6f4d0dca-7701-42d9-9965-0d279ad988c2/serve-healthcheck-canary/0.log" Jun 09 16:05:41.844767 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:41.844724 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fgw42_891e7674-69f4-46d3-92da-433ceac6762d/kube-rbac-proxy/0.log" Jun 09 16:05:41.864804 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:41.864766 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fgw42_891e7674-69f4-46d3-92da-433ceac6762d/exporter/0.log" Jun 09 16:05:41.884848 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:41.884819 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fgw42_891e7674-69f4-46d3-92da-433ceac6762d/extractor/0.log" Jun 09 16:05:45.941372 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:45.941340 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-tvg7c_46bcf61b-ac98-490e-af9a-93e6e936f7cb/kube-storage-version-migrator-operator/1.log" Jun 09 16:05:45.942457 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:45.942435 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-tvg7c_46bcf61b-ac98-490e-af9a-93e6e936f7cb/kube-storage-version-migrator-operator/0.log" Jun 09 16:05:46.627959 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:46.627934 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ktdb2/perf-node-gather-daemonset-h8c5p" Jun 09 16:05:46.686593 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:46.686565 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bd6f_34bcdd03-cb64-42f6-8ae1-02f6487f05e9/kube-multus-additional-cni-plugins/0.log" Jun 09 16:05:46.709514 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:46.709485 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bd6f_34bcdd03-cb64-42f6-8ae1-02f6487f05e9/egress-router-binary-copy/0.log" Jun 09 16:05:46.731922 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:46.731895 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bd6f_34bcdd03-cb64-42f6-8ae1-02f6487f05e9/cni-plugins/0.log" Jun 09 16:05:46.752515 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:46.752492 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bd6f_34bcdd03-cb64-42f6-8ae1-02f6487f05e9/bond-cni-plugin/0.log" Jun 09 16:05:46.772347 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:46.772321 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bd6f_34bcdd03-cb64-42f6-8ae1-02f6487f05e9/routeoverride-cni/0.log" Jun 09 16:05:46.791965 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:46.791929 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bd6f_34bcdd03-cb64-42f6-8ae1-02f6487f05e9/whereabouts-cni-bincopy/0.log" Jun 09 16:05:46.811339 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:46.811314 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bd6f_34bcdd03-cb64-42f6-8ae1-02f6487f05e9/whereabouts-cni/0.log" Jun 09 16:05:47.154338 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:47.154305 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jmm92_c3f4d7fc-b333-4c1b-8115-3eb2dc05caf7/kube-multus/0.log" Jun 09 16:05:47.316513 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:47.316482 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sls78_7cccabbb-102d-4dd3-b772-af5ece21429f/network-metrics-daemon/0.log" Jun 09 16:05:47.335188 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:47.335160 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sls78_7cccabbb-102d-4dd3-b772-af5ece21429f/kube-rbac-proxy/0.log" Jun 09 16:05:48.414550 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:48.414526 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/ovn-controller/0.log" Jun 09 16:05:48.435379 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:48.435347 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/ovn-acl-logging/1.log" Jun 09 16:05:48.435379 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:48.435389 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/ovn-acl-logging/0.log" Jun 09 16:05:48.457306 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:48.457281 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/kube-rbac-proxy-node/0.log" Jun 09 16:05:48.477364 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:48.477333 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 16:05:48.494650 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:48.494618 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/northd/0.log" Jun 09 16:05:48.517347 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:48.517320 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/nbdb/0.log" Jun 09 16:05:48.538435 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:48.538410 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/sbdb/0.log" Jun 09 16:05:48.575209 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:48.575174 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bgvmw_94b8e0a3-fb65-4130-b76b-916f8bb17946/ovnkube-controller/0.log" Jun 09 16:05:49.681687 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:49.681658 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-mv8nq_331bb2b6-a530-4028-9376-a752c169e830/check-endpoints/0.log" Jun 09 16:05:49.705080 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:49.705054 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6hlgk_3ce16e3d-4739-4cd1-8db0-7a049e3d1208/network-check-target-container/0.log" Jun 09 16:05:50.624494 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:50.624468 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hl6q2_792e9b7e-444f-4ee0-b7f8-6c42e8ebafc2/iptables-alerter/0.log" Jun 09 16:05:51.261419 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:51.261389 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-vvz9l_6b270631-0238-4c2b-91b3-1aa287ae5c27/tuned/0.log" Jun 09 16:05:52.912625 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:52.912590 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-xxqvq_4f7e237a-1986-4a26-958f-aeb04c91af88/cluster-samples-operator/0.log" Jun 09 16:05:52.929216 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:52.929186 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-xxqvq_4f7e237a-1986-4a26-958f-aeb04c91af88/cluster-samples-operator-watch/0.log" Jun 09 16:05:53.811405 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:53.811371 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-x5btt_ea817a23-a81e-421c-8d71-5ac82251577c/service-ca-operator/1.log" Jun 09 16:05:53.812207 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:53.812190 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-x5btt_ea817a23-a81e-421c-8d71-5ac82251577c/service-ca-operator/0.log" Jun 09 16:05:54.574145 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:54.574115 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-lscnp_3651e66a-a1f9-4d54-bf2d-734512c1b132/csi-driver/0.log" Jun 09 16:05:54.593427 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:54.593400 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-lscnp_3651e66a-a1f9-4d54-bf2d-734512c1b132/csi-node-driver-registrar/0.log" Jun 09 16:05:54.612044 ip-10-0-129-90 kubenswrapper[2552]: I0609 16:05:54.612019 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-lscnp_3651e66a-a1f9-4d54-bf2d-734512c1b132/csi-liveness-probe/0.log"