Jul 16 17:58:17.565769 ip-10-0-141-204 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 17:58:17.565779 ip-10-0-141-204 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 17:58:17.565786 ip-10-0-141-204 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 17:58:17.566224 ip-10-0-141-204 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 17:58:27.815313 ip-10-0-141-204 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 17:58:27.815332 ip-10-0-141-204 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 72ea90fa55664e3aafd6a2c6c6e388f2 -- Jul 16 18:00:04.572579 ip-10-0-141-204 systemd[1]: Starting Kubernetes Kubelet... Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.979906 2548 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986419 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986438 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986444 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986447 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986450 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986453 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986456 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 18:00:04.991049 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986459 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986462 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986464 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986467 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986470 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986473 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986476 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986480 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986482 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986485 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986487 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986490 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986493 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986495 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986498 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986501 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986503 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986506 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986508 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986511 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 18:00:05.004148 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986513 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986518 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986525 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986529 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986532 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986535 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986537 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986540 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986543 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986545 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986547 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986550 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986553 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986556 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986558 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986561 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986565 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986568 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986571 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 18:00:05.008418 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986574 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986576 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986579 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986581 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986584 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986587 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986590 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986595 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986598 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986602 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986605 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986608 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986610 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986613 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986616 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986619 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986622 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986624 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986627 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986630 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 18:00:05.179476 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986632 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 18:00:05.060484 ip-10-0-141-204 systemd[1]: Started Kubernetes Kubelet. Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986635 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986638 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986640 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986643 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986646 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986649 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986651 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986654 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986657 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986660 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986665 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986669 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986671 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986675 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986678 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986681 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986684 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986686 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986689 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 18:00:05.195343 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986691 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986694 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986696 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986699 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986702 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986704 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986707 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986709 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986713 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986715 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986718 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986720 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.986723 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987467 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987474 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987478 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987481 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987484 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987487 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 18:00:05.202835 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987491 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987493 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987496 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987500 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987503 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987505 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987508 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987510 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987513 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987516 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987519 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987521 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987524 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987526 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987529 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987532 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987534 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987537 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987539 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987541 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 18:00:05.204682 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987544 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987547 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987549 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987552 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987555 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987557 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987560 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987562 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987566 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987568 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987571 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987574 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987577 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987579 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987584 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987586 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987589 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987592 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987595 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987597 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 18:00:05.209313 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987600 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987603 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987605 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987608 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987610 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987613 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987615 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987618 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987621 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987623 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987627 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987629 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987632 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987634 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987639 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987643 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987647 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987651 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987654 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 18:00:05.210164 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987656 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987661 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987664 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987667 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987670 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987673 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987676 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987679 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987682 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987685 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987689 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987691 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987694 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987697 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987699 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987701 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987704 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987706 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987709 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987711 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 18:00:05.212173 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987714 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987716 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987719 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987721 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987723 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987727 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987731 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987734 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987737 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987739 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987742 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987745 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987749 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.987753 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988139 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988144 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988147 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988150 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988153 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 18:00:05.213007 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988156 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988159 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988162 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988165 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988168 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988172 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988176 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988178 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988182 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988184 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988187 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988190 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988193 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988196 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988199 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988201 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988204 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988207 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988210 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 18:00:05.214973 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988213 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988215 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988218 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988220 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988223 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988239 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988242 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988247 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988249 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988253 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988257 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988260 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988263 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988266 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988269 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988271 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988274 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988278 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988280 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988283 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988285 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 18:00:05.215650 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988288 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988291 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988293 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988296 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988298 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988301 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988304 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988306 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988309 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988311 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988314 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988316 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988319 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988321 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988324 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988327 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988329 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988332 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988336 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 18:00:05.216663 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988339 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988341 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988345 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988348 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988350 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988353 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988355 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988358 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988361 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988363 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988367 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988369 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988373 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988377 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988382 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988387 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988393 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988412 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988416 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 18:00:05.217281 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988419 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988422 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988424 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988429 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988432 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988435 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988438 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988441 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988444 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988446 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988449 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988452 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988456 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988458 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988461 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.988465 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988554 2548 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988566 2548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988575 2548 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988580 2548 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988584 2548 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 18:00:05.217862 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988587 2548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988592 2548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988596 2548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988599 2548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988602 2548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988606 2548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988609 2548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988613 2548 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988616 2548 flags.go:64] FLAG: --cgroup-root="" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988619 2548 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988623 2548 flags.go:64] FLAG: --client-ca-file="" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988626 2548 flags.go:64] FLAG: --cloud-provider="external" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988629 2548 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988636 2548 flags.go:64] FLAG: --cluster-domain="" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988640 2548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988645 2548 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988651 2548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988655 2548 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988659 2548 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988662 2548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988665 2548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988668 2548 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988672 2548 flags.go:64] FLAG: --contention-profiling="false" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988679 2548 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 18:00:05.218776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988682 2548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988685 2548 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988690 2548 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988694 2548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988697 2548 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988700 2548 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988703 2548 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988706 2548 flags.go:64] FLAG: --enable-server="true" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988709 2548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988717 2548 flags.go:64] FLAG: --event-burst="100" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988722 2548 flags.go:64] FLAG: --event-qps="50" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988727 2548 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988732 2548 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988735 2548 flags.go:64] FLAG: --eviction-hard="" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988740 2548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988743 2548 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988746 2548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988749 2548 flags.go:64] FLAG: --eviction-soft="" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988752 2548 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988756 2548 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988759 2548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988762 2548 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988765 2548 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988768 2548 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988771 2548 flags.go:64] FLAG: --feature-gates="" Jul 16 18:00:05.219443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988775 2548 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988778 2548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988781 2548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988784 2548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988787 2548 flags.go:64] FLAG: --healthz-port="10248" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988790 2548 flags.go:64] FLAG: --help="false" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988795 2548 flags.go:64] FLAG: --hostname-override="ip-10-0-141-204.ec2.internal" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988800 2548 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988805 2548 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988812 2548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988816 2548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988819 2548 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988822 2548 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988825 2548 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988828 2548 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988831 2548 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988834 2548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988837 2548 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988840 2548 flags.go:64] FLAG: --kube-reserved="" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988843 2548 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988846 2548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988849 2548 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988852 2548 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988855 2548 flags.go:64] FLAG: --lock-file="" Jul 16 18:00:05.220184 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988858 2548 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988862 2548 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988865 2548 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988871 2548 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988874 2548 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988879 2548 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988883 2548 flags.go:64] FLAG: --logging-format="text" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988889 2548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988893 2548 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988896 2548 flags.go:64] FLAG: --manifest-url="" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988899 2548 flags.go:64] FLAG: --manifest-url-header="" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988908 2548 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988911 2548 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988916 2548 flags.go:64] FLAG: --max-pods="110" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988928 2548 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988932 2548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988935 2548 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988939 2548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988942 2548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988945 2548 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988948 2548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988959 2548 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988964 2548 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988969 2548 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 18:00:05.221010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988974 2548 flags.go:64] FLAG: --pod-cidr="" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988976 2548 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988983 2548 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988986 2548 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988989 2548 flags.go:64] FLAG: --pods-per-core="0" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988992 2548 flags.go:64] FLAG: --port="10250" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988995 2548 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.988998 2548 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-045714269b61e29b0" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989001 2548 flags.go:64] FLAG: --qos-reserved="" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989004 2548 flags.go:64] FLAG: --read-only-port="10255" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989007 2548 flags.go:64] FLAG: --register-node="true" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989010 2548 flags.go:64] FLAG: --register-with-taints="" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989015 2548 flags.go:64] FLAG: --registry-burst="10" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989018 2548 flags.go:64] FLAG: --registry-qps="5" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989021 2548 flags.go:64] FLAG: --reserved-cpus="" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989024 2548 flags.go:64] FLAG: --reserved-memory="" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989028 2548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989031 2548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989035 2548 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989039 2548 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989044 2548 flags.go:64] FLAG: --runonce="false" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989049 2548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989055 2548 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989058 2548 flags.go:64] FLAG: --seccomp-default="false" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989062 2548 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 18:00:05.221698 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989065 2548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989070 2548 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989073 2548 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989076 2548 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989079 2548 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989082 2548 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989085 2548 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989088 2548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989091 2548 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989094 2548 flags.go:64] FLAG: --system-cgroups="" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989097 2548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989103 2548 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989106 2548 flags.go:64] FLAG: --tls-cert-file="" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989109 2548 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989113 2548 flags.go:64] FLAG: --tls-min-version="" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989116 2548 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989121 2548 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989126 2548 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989131 2548 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989136 2548 flags.go:64] FLAG: --v="2" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989141 2548 flags.go:64] FLAG: --version="false" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989145 2548 flags.go:64] FLAG: --vmodule="" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989149 2548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.989153 2548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 18:00:05.391857 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989317 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989323 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989326 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989329 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989333 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989337 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989341 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989344 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989347 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989352 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989355 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989358 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989362 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989366 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989370 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989375 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989378 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989380 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989383 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989386 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 18:00:05.392642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989388 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989391 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989394 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989397 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989399 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989402 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989405 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989407 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989410 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989414 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989417 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989419 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989422 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989424 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989427 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989429 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989432 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989435 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989438 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 18:00:05.394531 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989443 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989447 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989453 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989455 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989458 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989460 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989463 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989465 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989468 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989471 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989473 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989477 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989479 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989482 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989484 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989487 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989490 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989492 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989495 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989497 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989500 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 18:00:05.395208 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989502 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989507 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989512 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989514 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989518 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989522 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989526 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989530 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989533 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989537 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989540 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989543 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989545 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989549 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989552 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989554 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989557 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989559 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989562 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 18:00:05.450085 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989564 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989567 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989570 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989572 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989575 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989578 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989580 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989584 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989588 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989592 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989598 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989603 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989608 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989611 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989614 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989617 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989620 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989623 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989626 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 18:00:05.450874 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.989628 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.990202 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.998711 2548 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.998732 2548 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.998754 2548 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.998763 2548 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998886 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998894 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998899 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998904 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998908 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998912 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998917 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998921 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998926 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 18:00:05.451556 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998931 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998935 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998939 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998943 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998947 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998951 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998956 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998960 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998964 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998968 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998972 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998975 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998980 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998984 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998989 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998993 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.998997 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999000 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999004 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999009 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 18:00:05.452642 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999012 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999017 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999021 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999025 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999029 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999032 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999036 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999040 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999043 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999048 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999053 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999057 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999060 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999064 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999068 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999072 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999076 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999080 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999084 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 18:00:05.453475 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999088 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999092 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999097 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999101 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999105 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999110 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999113 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999117 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999124 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999130 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999134 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999138 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999142 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999146 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999150 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999154 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999158 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999162 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999166 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999170 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 18:00:05.454467 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999174 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999178 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999182 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999187 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999191 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999197 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999203 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999208 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999212 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999216 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999220 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999224 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999243 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999247 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999252 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999256 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999259 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999263 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999268 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 18:00:05.455045 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999271 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999277 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999283 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999287 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999292 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999296 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999300 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999303 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999307 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999311 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999315 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999319 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.999326 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999491 2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999498 2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 18:00:05.455884 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999502 2548 feature_gate.go:328] unrecognized feature gate: Example Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999507 2548 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999511 2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999516 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999520 2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999524 2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999528 2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999531 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999535 2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999540 2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999544 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999548 2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999552 2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999556 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999560 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999563 2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999567 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999571 2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999575 2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999579 2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 18:00:05.456965 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999583 2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999587 2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999590 2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999594 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999598 2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999602 2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999607 2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999610 2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999614 2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999617 2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999621 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999626 2548 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999629 2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999633 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999638 2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999642 2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999645 2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999648 2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999653 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999656 2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 18:00:05.457526 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999660 2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999664 2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999667 2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999672 2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999676 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999680 2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999684 2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999688 2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999693 2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999697 2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999701 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999704 2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999708 2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999714 2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999718 2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999722 2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999726 2548 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999730 2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999734 2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999737 2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 18:00:05.458016 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999741 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999745 2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999749 2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999752 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999756 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999759 2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999763 2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999767 2548 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999771 2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999774 2548 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999778 2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999782 2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999786 2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999789 2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999794 2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999799 2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999805 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999810 2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999814 2548 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999818 2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 18:00:05.458511 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999822 2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999826 2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999831 2548 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999835 2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999840 2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999845 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999851 2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999856 2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999861 2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999865 2548 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999869 2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999873 2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999877 2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999882 2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999886 2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999890 2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 18:00:05.458981 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:04.999895 2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 18:00:05.459384 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:04.999902 2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 18:00:05.459384 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.000061 2548 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 18:00:05.459384 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.004880 2548 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 18:00:05.459384 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.006382 2548 server.go:1019] "Starting client certificate rotation" Jul 16 18:00:05.459384 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.008504 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 18:00:05.459384 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.008540 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 18:00:05.459384 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.009025 2548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 18:00:05.459384 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.010686 2548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 18:00:05.459384 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.023938 2548 log.go:25] "Validated CRI v1 runtime API" Jul 16 18:00:05.459384 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.027593 2548 log.go:25] "Validated CRI v1 image API" Jul 16 18:00:05.459384 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.028945 2548 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 18:00:05.459384 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.031707 2548 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8e20707d-266b-4c09-8244-29f93cfcca32:/dev/nvme0n1p4 c3a6e510-5540-4b28-b210-d304bcb481bc:/dev/nvme0n1p3] Jul 16 18:00:05.459684 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.031724 2548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 18:00:05.459713 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.039129 2548 manager.go:216] Machine: {Timestamp:2026-07-16 18:00:05.03769497 +0000 UTC m=+0.348369836 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101573 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e24656043cf9509f47f4c4edf521d SystemUUID:ec2e2465-6043-cf95-09f4-7f4c4edf521d BootID:72ea90fa-5566-4e3a-afd6-a2c6c6e388f2 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:5e:9d:0d:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:5e:9d:0d:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:4b:f0:ea:64:fa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 18:00:05.459713 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.039257 2548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 18:00:05.459713 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.039346 2548 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 18:00:05.459713 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.042147 2548 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 18:00:05.459713 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.042173 2548 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-204.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 18:00:05.459713 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.043405 2548 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 18:00:05.459713 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.043420 2548 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 18:00:05.459713 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.043427 2548 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.044165 2548 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.045433 2548 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.045429 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.048983 2548 state_mem.go:36] "Initialized new in-memory state store" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.049117 2548 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.049148 2548 kubelet.go:486] "Attempting to sync node with API server" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.049160 2548 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.049175 2548 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.049185 2548 kubelet.go:398] "Adding apiserver pod source" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.049194 2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.049623 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.049643 2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.052041 2548 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.053799 2548 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.053844 2548 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.053994 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.054007 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.054013 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.054019 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.054027 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.054032 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.054751 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.054757 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.054768 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.054774 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.054787 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.054795 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.055680 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.055686 2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.059037 2548 server.go:1268] "Started kubelet" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.059242 2548 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.059315 2548 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.059350 2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.060071 2548 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-204.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.060572 2548 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.060958 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.060989 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.061291 2548 server.go:310] "Adding debug handlers to kubelet server" Jul 16 18:00:05.459980 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.065276 2548 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.067680 2548 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-204.ec2.internal.18c2d701c8fba430 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-204.ec2.internal,UID:ip-10-0-141-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-204.ec2.internal,},FirstTimestamp:2026-07-16 18:00:05.059011632 +0000 UTC m=+0.369686499,LastTimestamp:2026-07-16 18:00:05.059011632 +0000 UTC m=+0.369686499,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-204.ec2.internal,}" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.071705 2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.071719 2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.071853 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.072369 2548 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.072371 2548 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.072547 2548 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.072683 2548 reconstruct.go:97] "Volume reconstruction finished" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.072690 2548 reconciler.go:29] "Reconciler: start to sync state" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.072899 2548 factory.go:55] Registering systemd factory Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.072938 2548 factory.go:223] Registration of the systemd container factory successfully Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.074533 2548 factory.go:153] Registering CRI-O factory Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.074550 2548 factory.go:223] Registration of the crio container factory successfully Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.074609 2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.074638 2548 factory.go:103] Registering Raw factory Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.074652 2548 manager.go:1196] Started watching for new ooms in manager Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.075100 2548 manager.go:349] Starting recovery of all containers Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.075755 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xknjr" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.084751 2548 manager.go:354] Recovery completed Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.085855 2548 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.085954 2548 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.086366 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xknjr" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.089769 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.092377 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientMemory" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.092419 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.092430 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientPID" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.093061 2548 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.093071 2548 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.093088 2548 state_mem.go:36] "Initialized new in-memory state store" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.093099 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.094175 2548 policy_none.go:49] "None policy: Start" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.094192 2548 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.094204 2548 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 18:00:05.460959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.094346 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientMemory" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.094376 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.094386 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientPID" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.095186 2548 policy_none.go:47] "Start" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.133917 2548 manager.go:337] "Starting Device Plugin manager" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.134110 2548 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.134122 2548 server.go:87] "Starting device plugin registration server" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.134447 2548 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.134461 2548 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.134640 2548 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.134722 2548 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.134729 2548 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.135709 2548 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.135762 2548 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.222079 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.223297 2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.223342 2548 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.223368 2548 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.223412 2548 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.226049 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.234764 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.236827 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientMemory" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.236856 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.236866 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientPID" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.236888 2548 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-204.ec2.internal" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.246855 2548 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-204.ec2.internal" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.246879 2548 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-204.ec2.internal\": node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.266372 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.324349 2548 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-204.ec2.internal"] Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.324438 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.326029 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientMemory" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.326061 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.326070 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientPID" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.327335 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.327438 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.327467 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.328073 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientMemory" Jul 16 18:00:05.461831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.328098 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 18:00:05.462829 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.328108 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientPID" Jul 16 18:00:05.462829 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.328582 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientMemory" Jul 16 18:00:05.462829 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.328607 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 18:00:05.462829 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.328622 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientPID" Jul 16 18:00:05.462829 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.329644 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-204.ec2.internal" Jul 16 18:00:05.462829 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.329665 2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 18:00:05.462829 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.330494 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientMemory" Jul 16 18:00:05.462829 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.330518 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 18:00:05.462829 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.330533 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeHasSufficientPID" Jul 16 18:00:05.462829 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.352046 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-204.ec2.internal\" not found" node="ip-10-0-141-204.ec2.internal" Jul 16 18:00:05.462829 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.356567 2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-204.ec2.internal\" not found" node="ip-10-0-141-204.ec2.internal" Jul 16 18:00:05.462829 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.366629 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:05.467399 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:05.467377 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:05.473688 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.473669 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ec22d40b685bc9e793c3583bd16291f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal\" (UID: \"1ec22d40b685bc9e793c3583bd16291f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" Jul 16 18:00:05.473728 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.473695 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ec22d40b685bc9e793c3583bd16291f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal\" (UID: \"1ec22d40b685bc9e793c3583bd16291f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" Jul 16 18:00:05.473728 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:05.473712 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/644b13fd518434df8a933cb0806e9ec0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-204.ec2.internal\" (UID: \"644b13fd518434df8a933cb0806e9ec0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-204.ec2.internal" Jul 16 18:00:06.861320 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:06.861296 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:06.867631 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:06.867611 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/644b13fd518434df8a933cb0806e9ec0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-204.ec2.internal\" (UID: \"644b13fd518434df8a933cb0806e9ec0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-204.ec2.internal" Jul 16 18:00:06.867700 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:06.867650 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ec22d40b685bc9e793c3583bd16291f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal\" (UID: \"1ec22d40b685bc9e793c3583bd16291f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" Jul 16 18:00:06.867700 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:06.867670 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ec22d40b685bc9e793c3583bd16291f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal\" (UID: \"1ec22d40b685bc9e793c3583bd16291f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" Jul 16 18:00:06.867768 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:06.867721 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ec22d40b685bc9e793c3583bd16291f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal\" (UID: \"1ec22d40b685bc9e793c3583bd16291f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" Jul 16 18:00:06.867768 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:06.867733 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/644b13fd518434df8a933cb0806e9ec0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-204.ec2.internal\" (UID: \"644b13fd518434df8a933cb0806e9ec0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-204.ec2.internal" Jul 16 18:00:06.867826 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:06.867733 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ec22d40b685bc9e793c3583bd16291f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal\" (UID: \"1ec22d40b685bc9e793c3583bd16291f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" Jul 16 18:00:06.946834 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:06.946790 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" Jul 16 18:00:06.952781 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:06.952761 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-204.ec2.internal" Jul 16 18:00:06.962406 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:06.962382 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:07.062976 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:07.062894 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:07.163458 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:07.163421 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:07.264038 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:07.264013 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:07.301496 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:07.301463 2548 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 18:00:07.301973 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:07.301626 2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 18:00:07.364833 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:07.364737 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:07.382861 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:07.382825 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 17:55:06 +0000 UTC" deadline="2028-03-20 05:42:06.663539187 +0000 UTC" Jul 16 18:00:07.382861 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:07.382852 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14699h41m59.2806907s" Jul 16 18:00:07.465621 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:07.465594 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:07.492770 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:07.492741 2548 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 18:00:07.566716 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:07.566685 2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-204.ec2.internal\" not found" Jul 16 18:00:07.598455 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:07.598420 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644b13fd518434df8a933cb0806e9ec0.slice/crio-69976bfb4a99a6730981f09831f84fcb3129383866d4103613d3ed485f877b96 WatchSource:0}: Error finding container 69976bfb4a99a6730981f09831f84fcb3129383866d4103613d3ed485f877b96: Status 404 returned error can't find the container with id 69976bfb4a99a6730981f09831f84fcb3129383866d4103613d3ed485f877b96 Jul 16 18:00:07.598772 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:07.598758 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec22d40b685bc9e793c3583bd16291f.slice/crio-21a610b7d91aa53d0707f48f4285379b6999762086f44642ef470b45bce839c2 WatchSource:0}: Error finding container 21a610b7d91aa53d0707f48f4285379b6999762086f44642ef470b45bce839c2: Status 404 returned error can't find the container with id 21a610b7d91aa53d0707f48f4285379b6999762086f44642ef470b45bce839c2 Jul 16 18:00:07.602459 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:07.602444 2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 18:00:07.624994 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:07.624914 2548 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 18:00:07.664893 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:07.664858 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" Jul 16 18:00:07.677738 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:07.677715 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 18:00:07.678662 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:07.678650 2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-204.ec2.internal" Jul 16 18:00:07.686358 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:07.686340 2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 18:00:07.707010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:07.706987 2548 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 18:00:08.343913 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.343628 2548 apiserver.go:52] "Watching apiserver" Jul 16 18:00:08.355259 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.355219 2548 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 18:00:08.355744 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.355708 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fslwp","kube-system/kube-apiserver-proxy-ip-10-0-141-204.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq","openshift-dns/node-resolver-fxkpf","openshift-image-registry/node-ca-bzjkl","openshift-multus/multus-additional-cni-plugins-59wmx","openshift-multus/network-metrics-daemon-8r665","openshift-network-diagnostics/network-check-target-8zgv8","kube-system/konnectivity-agent-dbrvx","openshift-cluster-node-tuning-operator/tuned-r2jww","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal","openshift-multus/multus-zcv4g","openshift-network-operator/iptables-alerter-sjmsp","openshift-ovn-kubernetes/ovnkube-node-t69v6"] Jul 16 18:00:08.357450 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.357364 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:08.357578 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.357527 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:08.358730 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.358713 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sjmsp" Jul 16 18:00:08.360370 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.360348 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.362351 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.361804 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 18:00:08.362351 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.361823 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rftz9\"" Jul 16 18:00:08.362351 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.361906 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 18:00:08.362351 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.362021 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 18:00:08.362351 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.362064 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fxkpf" Jul 16 18:00:08.363691 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.363666 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bzjkl" Jul 16 18:00:08.364374 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.364356 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.365445 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.365422 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 18:00:08.365652 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.365635 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 18:00:08.366017 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.365999 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rdk7x\"" Jul 16 18:00:08.366226 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.366208 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bx5cx\"" Jul 16 18:00:08.366409 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.366391 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 18:00:08.366507 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.366208 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 18:00:08.366584 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.366570 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 18:00:08.366760 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.366745 2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 18:00:08.366850 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.366834 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 18:00:08.367937 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.367460 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dbrvx" Jul 16 18:00:08.368216 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.367575 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 18:00:08.368589 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.367654 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xzqjk\"" Jul 16 18:00:08.368703 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.367740 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:08.368797 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.368772 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:08.369866 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.369424 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 18:00:08.369957 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.369938 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 18:00:08.370212 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.370195 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 18:00:08.371019 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.370694 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 18:00:08.371416 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.370726 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5wdbl\"" Jul 16 18:00:08.371708 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.370740 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 18:00:08.371989 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.370775 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 18:00:08.373135 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.373093 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 18:00:08.373364 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.373344 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x9cvm\"" Jul 16 18:00:08.373563 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.373545 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 18:00:08.374345 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374323 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42fadce5-4688-43ff-b549-24da2f6def18-serviceca\") pod \"node-ca-bzjkl\" (UID: \"42fadce5-4688-43ff-b549-24da2f6def18\") " pod="openshift-image-registry/node-ca-bzjkl" Jul 16 18:00:08.374425 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374362 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-sys-fs\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.374425 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374390 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e00fd32-cd94-4741-a005-fbe723cfc5d5-os-release\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.374425 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374415 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e00fd32-cd94-4741-a005-fbe723cfc5d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.374587 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374442 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a-agent-certs\") pod \"konnectivity-agent-dbrvx\" (UID: \"3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a\") " pod="kube-system/konnectivity-agent-dbrvx" Jul 16 18:00:08.374587 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374471 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-socket-dir\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.374587 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374495 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7-tmp-dir\") pod \"node-resolver-fxkpf\" (UID: \"1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7\") " pod="openshift-dns/node-resolver-fxkpf" Jul 16 18:00:08.374587 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374519 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e00fd32-cd94-4741-a005-fbe723cfc5d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.374587 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374546 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd2xz\" (UniqueName: \"kubernetes.io/projected/a1e527a1-0819-4c70-95a0-93857af48d83-kube-api-access-bd2xz\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.374587 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374569 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e00fd32-cd94-4741-a005-fbe723cfc5d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.374870 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374595 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e00fd32-cd94-4741-a005-fbe723cfc5d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.374870 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374653 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e00fd32-cd94-4741-a005-fbe723cfc5d5-cnibin\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.374870 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374692 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20e24960-2a4d-461a-9b92-374682a4d176-iptables-alerter-script\") pod \"iptables-alerter-sjmsp\" (UID: \"20e24960-2a4d-461a-9b92-374682a4d176\") " pod="openshift-network-operator/iptables-alerter-sjmsp" Jul 16 18:00:08.374870 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374716 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsr9z\" (UniqueName: \"kubernetes.io/projected/4e00fd32-cd94-4741-a005-fbe723cfc5d5-kube-api-access-jsr9z\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.374870 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374748 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-device-dir\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.374870 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374772 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66d0fe0e-abd1-43c4-b06a-6803c1626df8-kubelet-config\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:08.374870 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374797 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66d0fe0e-abd1-43c4-b06a-6803c1626df8-dbus\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:08.374870 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374823 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42fadce5-4688-43ff-b549-24da2f6def18-host\") pod \"node-ca-bzjkl\" (UID: \"42fadce5-4688-43ff-b549-24da2f6def18\") " pod="openshift-image-registry/node-ca-bzjkl" Jul 16 18:00:08.374870 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374846 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-registration-dir\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.375305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374869 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55j9t\" (UniqueName: \"kubernetes.io/projected/89d21151-3342-4fc2-ab77-68629dc8896e-kube-api-access-55j9t\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:08.375305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374898 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20e24960-2a4d-461a-9b92-374682a4d176-host-slash\") pod \"iptables-alerter-sjmsp\" (UID: \"20e24960-2a4d-461a-9b92-374682a4d176\") " pod="openshift-network-operator/iptables-alerter-sjmsp" Jul 16 18:00:08.375305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374921 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw5rb\" (UniqueName: \"kubernetes.io/projected/42fadce5-4688-43ff-b549-24da2f6def18-kube-api-access-hw5rb\") pod \"node-ca-bzjkl\" (UID: \"42fadce5-4688-43ff-b549-24da2f6def18\") " pod="openshift-image-registry/node-ca-bzjkl" Jul 16 18:00:08.375305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374945 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a-konnectivity-ca\") pod \"konnectivity-agent-dbrvx\" (UID: \"3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a\") " pod="kube-system/konnectivity-agent-dbrvx" Jul 16 18:00:08.375305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374967 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.375305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.374990 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:08.375305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.375024 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5djt\" (UniqueName: \"kubernetes.io/projected/20e24960-2a4d-461a-9b92-374682a4d176-kube-api-access-g5djt\") pod \"iptables-alerter-sjmsp\" (UID: \"20e24960-2a4d-461a-9b92-374682a4d176\") " pod="openshift-network-operator/iptables-alerter-sjmsp" Jul 16 18:00:08.375305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.375049 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e00fd32-cd94-4741-a005-fbe723cfc5d5-system-cni-dir\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.375305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.375077 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-etc-selinux\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.375305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.375122 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7-hosts-file\") pod \"node-resolver-fxkpf\" (UID: \"1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7\") " pod="openshift-dns/node-resolver-fxkpf" Jul 16 18:00:08.375305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.375158 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55qwc\" (UniqueName: \"kubernetes.io/projected/1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7-kube-api-access-55qwc\") pod \"node-resolver-fxkpf\" (UID: \"1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7\") " pod="openshift-dns/node-resolver-fxkpf" Jul 16 18:00:08.375305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.375185 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:08.377201 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.376165 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.377201 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.376556 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.377437 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.377420 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:08.377543 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.377517 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:08.379068 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.379047 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.382376 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.382355 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 18:00:08.382469 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.382428 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b9qf8\"" Jul 16 18:00:08.382469 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.382441 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 18:00:08.382600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.382586 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 18:00:08.382788 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.382619 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 18:00:08.382841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.382807 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 18:00:08.382841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.382820 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hn6kw\"" Jul 16 18:00:08.382841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.382823 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 18:00:08.383017 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.382978 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 18:00:08.386147 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.385985 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 18:00:08.388944 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.388923 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 18:00:08.388944 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.388938 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jldtp\"" Jul 16 18:00:08.390531 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.390478 2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 18:00:08.414762 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.414738 2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5cfg7" Jul 16 18:00:08.434303 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.434280 2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5cfg7" Jul 16 18:00:08.467236 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.467206 2548 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 18:00:08.476420 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476387 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66d0fe0e-abd1-43c4-b06a-6803c1626df8-dbus\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:08.476597 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476433 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42fadce5-4688-43ff-b549-24da2f6def18-host\") pod \"node-ca-bzjkl\" (UID: \"42fadce5-4688-43ff-b549-24da2f6def18\") " pod="openshift-image-registry/node-ca-bzjkl" Jul 16 18:00:08.476597 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476474 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-run-ovn-kubernetes\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.476597 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476501 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-run-k8s-cni-cncf-io\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.476597 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476528 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-var-lib-cni-multus\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.476597 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476566 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55j9t\" (UniqueName: \"kubernetes.io/projected/89d21151-3342-4fc2-ab77-68629dc8896e-kube-api-access-55j9t\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:08.476597 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476580 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42fadce5-4688-43ff-b549-24da2f6def18-host\") pod \"node-ca-bzjkl\" (UID: \"42fadce5-4688-43ff-b549-24da2f6def18\") " pod="openshift-image-registry/node-ca-bzjkl" Jul 16 18:00:08.476597 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476591 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-ovnkube-script-lib\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.476920 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476618 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33959b9d-18c5-4082-9c71-68efea2e06bc-multus-daemon-config\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.476920 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476644 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-var-lib-kubelet\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.476920 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476673 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drbrq\" (UniqueName: \"kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq\") pod \"network-check-target-8zgv8\" (UID: \"022d8ead-bbfa-4500-96c9-ec2216a12abf\") " pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:08.476920 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476688 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66d0fe0e-abd1-43c4-b06a-6803c1626df8-dbus\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:08.476920 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476697 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.476920 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476760 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.476920 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476817 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:08.476920 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.476865 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5djt\" (UniqueName: \"kubernetes.io/projected/20e24960-2a4d-461a-9b92-374682a4d176-kube-api-access-g5djt\") pod \"iptables-alerter-sjmsp\" (UID: \"20e24960-2a4d-461a-9b92-374682a4d176\") " pod="openshift-network-operator/iptables-alerter-sjmsp" Jul 16 18:00:08.477320 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.476982 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:08.477320 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477014 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.477320 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477078 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-etc-selinux\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.477320 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.477115 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs podName:89d21151-3342-4fc2-ab77-68629dc8896e nodeName:}" failed. No retries permitted until 2026-07-16 18:00:08.977075023 +0000 UTC m=+2.994878939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs") pod "network-metrics-daemon-8r665" (UID: "89d21151-3342-4fc2-ab77-68629dc8896e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:08.477320 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477155 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-slash\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.477320 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477195 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-cni-bin\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.477320 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477200 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-etc-selinux\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.477320 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477225 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-run-netns\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.477320 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477255 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e00fd32-cd94-4741-a005-fbe723cfc5d5-os-release\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.477320 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477279 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-run-openvswitch\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.477320 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477313 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-env-overrides\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477337 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-socket-dir\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477350 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e00fd32-cd94-4741-a005-fbe723cfc5d5-os-release\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477364 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7-tmp-dir\") pod \"node-resolver-fxkpf\" (UID: \"1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7\") " pod="openshift-dns/node-resolver-fxkpf" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477388 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-host\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477409 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-tuned\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477432 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl5hk\" (UniqueName: \"kubernetes.io/projected/ec9cc724-8586-4f80-af6d-8e10ee17433f-kube-api-access-sl5hk\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477483 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e00fd32-cd94-4741-a005-fbe723cfc5d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477500 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-socket-dir\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477506 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-run-netns\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477531 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-hostroot\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477553 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-sysctl-d\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477580 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e00fd32-cd94-4741-a005-fbe723cfc5d5-cnibin\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477608 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsr9z\" (UniqueName: \"kubernetes.io/projected/4e00fd32-cd94-4741-a005-fbe723cfc5d5-kube-api-access-jsr9z\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.477841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477628 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-ovnkube-config\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477643 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-var-lib-cni-bin\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477654 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e00fd32-cd94-4741-a005-fbe723cfc5d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477676 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e00fd32-cd94-4741-a005-fbe723cfc5d5-cnibin\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477662 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-run-multus-certs\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477726 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-sysconfig\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477753 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-sysctl-conf\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477775 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7-tmp-dir\") pod \"node-resolver-fxkpf\" (UID: \"1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7\") " pod="openshift-dns/node-resolver-fxkpf" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477781 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66d0fe0e-abd1-43c4-b06a-6803c1626df8-kubelet-config\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477826 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-multus-socket-dir-parent\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477868 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66d0fe0e-abd1-43c4-b06a-6803c1626df8-kubelet-config\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477870 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l9lf\" (UniqueName: \"kubernetes.io/projected/33959b9d-18c5-4082-9c71-68efea2e06bc-kube-api-access-2l9lf\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477909 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec9cc724-8586-4f80-af6d-8e10ee17433f-tmp\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477936 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-registration-dir\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.478594 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477989 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-registration-dir\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.477989 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20e24960-2a4d-461a-9b92-374682a4d176-host-slash\") pod \"iptables-alerter-sjmsp\" (UID: \"20e24960-2a4d-461a-9b92-374682a4d176\") " pod="openshift-network-operator/iptables-alerter-sjmsp" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478028 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20e24960-2a4d-461a-9b92-374682a4d176-host-slash\") pod \"iptables-alerter-sjmsp\" (UID: \"20e24960-2a4d-461a-9b92-374682a4d176\") " pod="openshift-network-operator/iptables-alerter-sjmsp" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478045 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw5rb\" (UniqueName: \"kubernetes.io/projected/42fadce5-4688-43ff-b549-24da2f6def18-kube-api-access-hw5rb\") pod \"node-ca-bzjkl\" (UID: \"42fadce5-4688-43ff-b549-24da2f6def18\") " pod="openshift-image-registry/node-ca-bzjkl" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478075 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a-konnectivity-ca\") pod \"konnectivity-agent-dbrvx\" (UID: \"3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a\") " pod="kube-system/konnectivity-agent-dbrvx" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478265 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-ovn-node-metrics-cert\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478296 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-multus-conf-dir\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478319 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-run\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478349 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-log-socket\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478383 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-cni-netd\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478411 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq2bx\" (UniqueName: \"kubernetes.io/projected/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-kube-api-access-bq2bx\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478439 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-system-cni-dir\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478462 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-etc-kubernetes\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478488 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e00fd32-cd94-4741-a005-fbe723cfc5d5-system-cni-dir\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.479261 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478515 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7-hosts-file\") pod \"node-resolver-fxkpf\" (UID: \"1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7\") " pod="openshift-dns/node-resolver-fxkpf" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478540 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55qwc\" (UniqueName: \"kubernetes.io/projected/1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7-kube-api-access-55qwc\") pod \"node-resolver-fxkpf\" (UID: \"1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7\") " pod="openshift-dns/node-resolver-fxkpf" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478555 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e00fd32-cd94-4741-a005-fbe723cfc5d5-system-cni-dir\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478564 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478597 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42fadce5-4688-43ff-b549-24da2f6def18-serviceca\") pod \"node-ca-bzjkl\" (UID: \"42fadce5-4688-43ff-b549-24da2f6def18\") " pod="openshift-image-registry/node-ca-bzjkl" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478625 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-kubelet\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478648 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a-konnectivity-ca\") pod \"konnectivity-agent-dbrvx\" (UID: \"3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a\") " pod="kube-system/konnectivity-agent-dbrvx" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478650 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33959b9d-18c5-4082-9c71-68efea2e06bc-cni-binary-copy\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478703 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7-hosts-file\") pod \"node-resolver-fxkpf\" (UID: \"1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7\") " pod="openshift-dns/node-resolver-fxkpf" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478713 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-sys-fs\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.478652 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478758 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e00fd32-cd94-4741-a005-fbe723cfc5d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478782 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a-agent-certs\") pod \"konnectivity-agent-dbrvx\" (UID: \"3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a\") " pod="kube-system/konnectivity-agent-dbrvx" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.478808 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-systemd-units\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.479909 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.478883 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret podName:66d0fe0e-abd1-43c4-b06a-6803c1626df8 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:08.978866295 +0000 UTC m=+2.996670204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret") pod "global-pull-secret-syncer-fslwp" (UID: "66d0fe0e-abd1-43c4-b06a-6803c1626df8") : object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479075 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42fadce5-4688-43ff-b549-24da2f6def18-serviceca\") pod \"node-ca-bzjkl\" (UID: \"42fadce5-4688-43ff-b549-24da2f6def18\") " pod="openshift-image-registry/node-ca-bzjkl" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479146 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-multus-cni-dir\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479140 2548 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479248 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-sys-fs\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479279 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-kubernetes\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479307 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-sys\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479354 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-lib-modules\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479360 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e00fd32-cd94-4741-a005-fbe723cfc5d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479386 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e00fd32-cd94-4741-a005-fbe723cfc5d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479411 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-os-release\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479493 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2xz\" (UniqueName: \"kubernetes.io/projected/a1e527a1-0819-4c70-95a0-93857af48d83-kube-api-access-bd2xz\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479526 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e00fd32-cd94-4741-a005-fbe723cfc5d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479622 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-var-lib-openvswitch\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.480585 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479651 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-etc-openvswitch\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479696 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-node-log\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479720 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-systemd\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479818 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e00fd32-cd94-4741-a005-fbe723cfc5d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479845 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20e24960-2a4d-461a-9b92-374682a4d176-iptables-alerter-script\") pod \"iptables-alerter-sjmsp\" (UID: \"20e24960-2a4d-461a-9b92-374682a4d176\") " pod="openshift-network-operator/iptables-alerter-sjmsp" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479878 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-run-systemd\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479916 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-run-ovn\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479946 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-cnibin\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.479979 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-var-lib-kubelet\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.480004 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-modprobe-d\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.480036 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-device-dir\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.480159 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1e527a1-0819-4c70-95a0-93857af48d83-device-dir\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.480196 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e00fd32-cd94-4741-a005-fbe723cfc5d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.481228 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.480358 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20e24960-2a4d-461a-9b92-374682a4d176-iptables-alerter-script\") pod \"iptables-alerter-sjmsp\" (UID: \"20e24960-2a4d-461a-9b92-374682a4d176\") " pod="openshift-network-operator/iptables-alerter-sjmsp" Jul 16 18:00:08.485001 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.484974 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a-agent-certs\") pod \"konnectivity-agent-dbrvx\" (UID: \"3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a\") " pod="kube-system/konnectivity-agent-dbrvx" Jul 16 18:00:08.492027 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.491994 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw5rb\" (UniqueName: \"kubernetes.io/projected/42fadce5-4688-43ff-b549-24da2f6def18-kube-api-access-hw5rb\") pod \"node-ca-bzjkl\" (UID: \"42fadce5-4688-43ff-b549-24da2f6def18\") " pod="openshift-image-registry/node-ca-bzjkl" Jul 16 18:00:08.494444 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.492777 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55j9t\" (UniqueName: \"kubernetes.io/projected/89d21151-3342-4fc2-ab77-68629dc8896e-kube-api-access-55j9t\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:08.494444 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.494215 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55qwc\" (UniqueName: \"kubernetes.io/projected/1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7-kube-api-access-55qwc\") pod \"node-resolver-fxkpf\" (UID: \"1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7\") " pod="openshift-dns/node-resolver-fxkpf" Jul 16 18:00:08.495642 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.494647 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsr9z\" (UniqueName: \"kubernetes.io/projected/4e00fd32-cd94-4741-a005-fbe723cfc5d5-kube-api-access-jsr9z\") pod \"multus-additional-cni-plugins-59wmx\" (UID: \"4e00fd32-cd94-4741-a005-fbe723cfc5d5\") " pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.495746 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.495727 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5djt\" (UniqueName: \"kubernetes.io/projected/20e24960-2a4d-461a-9b92-374682a4d176-kube-api-access-g5djt\") pod \"iptables-alerter-sjmsp\" (UID: \"20e24960-2a4d-461a-9b92-374682a4d176\") " pod="openshift-network-operator/iptables-alerter-sjmsp" Jul 16 18:00:08.496253 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.496215 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd2xz\" (UniqueName: \"kubernetes.io/projected/a1e527a1-0819-4c70-95a0-93857af48d83-kube-api-access-bd2xz\") pod \"aws-ebs-csi-driver-node-fzfqq\" (UID: \"a1e527a1-0819-4c70-95a0-93857af48d83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.521795 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.521745 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-204.ec2.internal" event={"ID":"644b13fd518434df8a933cb0806e9ec0","Type":"ContainerStarted","Data":"69976bfb4a99a6730981f09831f84fcb3129383866d4103613d3ed485f877b96"} Jul 16 18:00:08.523133 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.523063 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" event={"ID":"1ec22d40b685bc9e793c3583bd16291f","Type":"ContainerStarted","Data":"21a610b7d91aa53d0707f48f4285379b6999762086f44642ef470b45bce839c2"} Jul 16 18:00:08.571303 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.571271 2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580437 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-run-ovn-kubernetes\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580493 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-run-k8s-cni-cncf-io\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580525 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-var-lib-cni-multus\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580549 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-ovnkube-script-lib\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580576 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33959b9d-18c5-4082-9c71-68efea2e06bc-multus-daemon-config\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580605 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-var-lib-kubelet\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580650 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drbrq\" (UniqueName: \"kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq\") pod \"network-check-target-8zgv8\" (UID: \"022d8ead-bbfa-4500-96c9-ec2216a12abf\") " pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580697 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580727 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-slash\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580755 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-cni-bin\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580777 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-run-netns\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580806 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-run-openvswitch\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580836 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-env-overrides\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.582393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580867 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-host\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580898 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-tuned\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580921 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl5hk\" (UniqueName: \"kubernetes.io/projected/ec9cc724-8586-4f80-af6d-8e10ee17433f-kube-api-access-sl5hk\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580951 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-run-netns\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.580978 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-hostroot\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581005 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-sysctl-d\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581033 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-ovnkube-config\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581061 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-var-lib-cni-bin\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581093 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-run-multus-certs\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581139 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-sysconfig\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581167 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-sysctl-conf\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581191 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-multus-socket-dir-parent\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581220 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l9lf\" (UniqueName: \"kubernetes.io/projected/33959b9d-18c5-4082-9c71-68efea2e06bc-kube-api-access-2l9lf\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581247 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec9cc724-8586-4f80-af6d-8e10ee17433f-tmp\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581300 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-ovn-node-metrics-cert\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.583237 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581360 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-multus-conf-dir\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581385 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-run\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581417 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-log-socket\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581449 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-cni-netd\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581483 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2bx\" (UniqueName: \"kubernetes.io/projected/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-kube-api-access-bq2bx\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581515 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-system-cni-dir\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581544 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-etc-kubernetes\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581594 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-kubelet\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581622 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33959b9d-18c5-4082-9c71-68efea2e06bc-cni-binary-copy\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581656 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-systemd-units\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581681 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-multus-cni-dir\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581709 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-kubernetes\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581739 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-sys\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581769 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-lib-modules\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581807 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-os-release\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.583904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581835 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-var-lib-openvswitch\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581874 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-etc-openvswitch\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581902 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-node-log\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581930 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-systemd\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581956 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-run-systemd\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.581989 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-run-ovn\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.582020 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-cnibin\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.582050 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-var-lib-kubelet\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.582079 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-modprobe-d\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.582299 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-modprobe-d\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.582363 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-run-ovn-kubernetes\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.582556 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-host\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.582599 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-node-log\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.582936 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-systemd\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.582983 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-multus-conf-dir\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.584600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583003 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-run-k8s-cni-cncf-io\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583055 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-var-lib-kubelet\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583078 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-run-ovn\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583088 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583215 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-run-netns\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583240 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-sysconfig\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583287 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-os-release\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583297 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-var-lib-cni-bin\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583369 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-run-systemd\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583446 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-sysctl-d\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583518 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-etc-kubernetes\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583524 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-sysctl-conf\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583584 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-system-cni-dir\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583573 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-run\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583664 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-cni-netd\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.585309 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583672 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-multus-socket-dir-parent\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583715 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-cni-bin\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583721 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-run-openvswitch\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583831 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-var-lib-cni-multus\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.583905 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-cnibin\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584004 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-lib-modules\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584117 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33959b9d-18c5-4082-9c71-68efea2e06bc-multus-daemon-config\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584241 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-env-overrides\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584274 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33959b9d-18c5-4082-9c71-68efea2e06bc-cni-binary-copy\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584341 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-sys\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584429 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-kubernetes\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584507 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-etc-openvswitch\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584550 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-ovnkube-script-lib\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584578 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-log-socket\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584655 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-run-netns\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.585956 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584665 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-systemd-units\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.586667 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584722 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-var-lib-openvswitch\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.586667 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584766 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-slash\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.586667 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584812 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-host-run-multus-certs\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.586667 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584851 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-hostroot\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.586667 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584912 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33959b9d-18c5-4082-9c71-68efea2e06bc-multus-cni-dir\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.586667 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584955 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-ovnkube-config\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.586667 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584956 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-host-kubelet\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.586667 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.584994 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec9cc724-8586-4f80-af6d-8e10ee17433f-var-lib-kubelet\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.586667 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.585615 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec9cc724-8586-4f80-af6d-8e10ee17433f-tmp\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.587076 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.586957 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-ovn-node-metrics-cert\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.587914 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.587894 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec9cc724-8586-4f80-af6d-8e10ee17433f-etc-tuned\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.589255 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.589232 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 18:00:08.589353 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.589260 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 18:00:08.589353 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.589274 2548 projected.go:196] Error preparing data for projected volume kube-api-access-drbrq for pod openshift-network-diagnostics/network-check-target-8zgv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:08.589353 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.589341 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq podName:022d8ead-bbfa-4500-96c9-ec2216a12abf nodeName:}" failed. No retries permitted until 2026-07-16 18:00:09.089323017 +0000 UTC m=+3.107126935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-drbrq" (UniqueName: "kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq") pod "network-check-target-8zgv8" (UID: "022d8ead-bbfa-4500-96c9-ec2216a12abf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:08.591576 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.591555 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l9lf\" (UniqueName: \"kubernetes.io/projected/33959b9d-18c5-4082-9c71-68efea2e06bc-kube-api-access-2l9lf\") pod \"multus-zcv4g\" (UID: \"33959b9d-18c5-4082-9c71-68efea2e06bc\") " pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.593904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.593882 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq2bx\" (UniqueName: \"kubernetes.io/projected/4d5ed8e5-e63c-4506-a370-cfe068cd8ff6-kube-api-access-bq2bx\") pod \"ovnkube-node-t69v6\" (UID: \"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.598328 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.598272 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl5hk\" (UniqueName: \"kubernetes.io/projected/ec9cc724-8586-4f80-af6d-8e10ee17433f-kube-api-access-sl5hk\") pod \"tuned-r2jww\" (UID: \"ec9cc724-8586-4f80-af6d-8e10ee17433f\") " pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.677798 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.677753 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sjmsp" Jul 16 18:00:08.693437 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.693407 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" Jul 16 18:00:08.700333 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.700308 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fxkpf" Jul 16 18:00:08.707205 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.707182 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bzjkl" Jul 16 18:00:08.713919 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.713893 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-59wmx" Jul 16 18:00:08.721776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.721753 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dbrvx" Jul 16 18:00:08.729692 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.729669 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r2jww" Jul 16 18:00:08.737503 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.737477 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:08.744289 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.744270 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zcv4g" Jul 16 18:00:08.985671 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.985573 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:08.985671 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:08.985640 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:08.985891 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.985732 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:08.985891 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.985795 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret podName:66d0fe0e-abd1-43c4-b06a-6803c1626df8 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:09.98577535 +0000 UTC m=+4.003579247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret") pod "global-pull-secret-syncer-fslwp" (UID: "66d0fe0e-abd1-43c4-b06a-6803c1626df8") : object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:08.985891 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.985732 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:08.985891 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:08.985860 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs podName:89d21151-3342-4fc2-ab77-68629dc8896e nodeName:}" failed. No retries permitted until 2026-07-16 18:00:09.98584619 +0000 UTC m=+4.003650098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs") pod "network-metrics-daemon-8r665" (UID: "89d21151-3342-4fc2-ab77-68629dc8896e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:09.188186 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:09.188152 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drbrq\" (UniqueName: \"kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq\") pod \"network-check-target-8zgv8\" (UID: \"022d8ead-bbfa-4500-96c9-ec2216a12abf\") " pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:09.188391 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:09.188371 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 18:00:09.188446 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:09.188402 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 18:00:09.188446 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:09.188415 2548 projected.go:196] Error preparing data for projected volume kube-api-access-drbrq for pod openshift-network-diagnostics/network-check-target-8zgv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:09.188543 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:09.188480 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq podName:022d8ead-bbfa-4500-96c9-ec2216a12abf nodeName:}" failed. No retries permitted until 2026-07-16 18:00:10.188461459 +0000 UTC m=+4.206265360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-drbrq" (UniqueName: "kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq") pod "network-check-target-8zgv8" (UID: "022d8ead-bbfa-4500-96c9-ec2216a12abf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:09.436353 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:09.436264 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:55:08 +0000 UTC" deadline="2028-04-17 06:22:48.965091034 +0000 UTC" Jul 16 18:00:09.436353 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:09.436301 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15372h22m39.528794096s" Jul 16 18:00:09.516879 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:09.516842 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:09.516879 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:09.516865 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:09.517078 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:09.516947 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:09.517078 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:09.516991 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:09.517078 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:09.517064 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:09.517246 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:09.517164 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:09.620295 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:09.620265 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33959b9d_18c5_4082_9c71_68efea2e06bc.slice/crio-9bdc2c29e8202f23eda8113a44e0ee4465ed0581a47564be55bbd1225c81a7c5 WatchSource:0}: Error finding container 9bdc2c29e8202f23eda8113a44e0ee4465ed0581a47564be55bbd1225c81a7c5: Status 404 returned error can't find the container with id 9bdc2c29e8202f23eda8113a44e0ee4465ed0581a47564be55bbd1225c81a7c5 Jul 16 18:00:09.636289 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:09.636262 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42fadce5_4688_43ff_b549_24da2f6def18.slice/crio-54a3f7dedf2e8fbb373ce12958ed50012e670868508ea2e870c09a0c4dcb4029 WatchSource:0}: Error finding container 54a3f7dedf2e8fbb373ce12958ed50012e670868508ea2e870c09a0c4dcb4029: Status 404 returned error can't find the container with id 54a3f7dedf2e8fbb373ce12958ed50012e670868508ea2e870c09a0c4dcb4029 Jul 16 18:00:09.637245 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:09.637181 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e527a1_0819_4c70_95a0_93857af48d83.slice/crio-e47206efc53f445d2858e91e941d72ca6ebd5cee79990c3e687e64ef90f40c8d WatchSource:0}: Error finding container e47206efc53f445d2858e91e941d72ca6ebd5cee79990c3e687e64ef90f40c8d: Status 404 returned error can't find the container with id e47206efc53f445d2858e91e941d72ca6ebd5cee79990c3e687e64ef90f40c8d Jul 16 18:00:09.638552 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:09.638517 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9cc724_8586_4f80_af6d_8e10ee17433f.slice/crio-992b624c6dfaeb4aef94b9c4e6f996cf175014fc23d9574646d1ce3b50d65259 WatchSource:0}: Error finding container 992b624c6dfaeb4aef94b9c4e6f996cf175014fc23d9574646d1ce3b50d65259: Status 404 returned error can't find the container with id 992b624c6dfaeb4aef94b9c4e6f996cf175014fc23d9574646d1ce3b50d65259 Jul 16 18:00:09.639626 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:09.639600 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5ed8e5_e63c_4506_a370_cfe068cd8ff6.slice/crio-aba4f781bd71dad0846155978e9f0e5881afec690f7cab9d6cdd0e8f6b01bb22 WatchSource:0}: Error finding container aba4f781bd71dad0846155978e9f0e5881afec690f7cab9d6cdd0e8f6b01bb22: Status 404 returned error can't find the container with id aba4f781bd71dad0846155978e9f0e5881afec690f7cab9d6cdd0e8f6b01bb22 Jul 16 18:00:09.640477 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:09.640453 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8dfead_29d2_4ac6_8f2c_2bda20b5d14a.slice/crio-1a14327f7595b07d54390bcd18e3fd3826a45573a43a7fc2eb05df3bcc9ef1b3 WatchSource:0}: Error finding container 1a14327f7595b07d54390bcd18e3fd3826a45573a43a7fc2eb05df3bcc9ef1b3: Status 404 returned error can't find the container with id 1a14327f7595b07d54390bcd18e3fd3826a45573a43a7fc2eb05df3bcc9ef1b3 Jul 16 18:00:09.642322 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:09.642300 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e24960_2a4d_461a_9b92_374682a4d176.slice/crio-3a11749dd57df620ebcdb45b3274b432091b27abd7d0fd985a3e9052fc311029 WatchSource:0}: Error finding container 3a11749dd57df620ebcdb45b3274b432091b27abd7d0fd985a3e9052fc311029: Status 404 returned error can't find the container with id 3a11749dd57df620ebcdb45b3274b432091b27abd7d0fd985a3e9052fc311029 Jul 16 18:00:09.643292 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:09.643269 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0c6f04_267f_436c_bf71_fb8cbf6ca7d7.slice/crio-80831e8b3ea035c59eb18eff1396129163e8b58ebbe7516dad7bbe81bba87d8e WatchSource:0}: Error finding container 80831e8b3ea035c59eb18eff1396129163e8b58ebbe7516dad7bbe81bba87d8e: Status 404 returned error can't find the container with id 80831e8b3ea035c59eb18eff1396129163e8b58ebbe7516dad7bbe81bba87d8e Jul 16 18:00:09.645575 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:09.645552 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e00fd32_cd94_4741_a005_fbe723cfc5d5.slice/crio-70b0355d5004c82531a0a7a121e066eb912cafbe9fbd212339a16c73e9f0aa3f WatchSource:0}: Error finding container 70b0355d5004c82531a0a7a121e066eb912cafbe9fbd212339a16c73e9f0aa3f: Status 404 returned error can't find the container with id 70b0355d5004c82531a0a7a121e066eb912cafbe9fbd212339a16c73e9f0aa3f Jul 16 18:00:09.995234 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:09.995095 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:09.995234 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:09.995201 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:09.995462 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:09.995270 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:09.995462 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:09.995305 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:09.995462 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:09.995359 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret podName:66d0fe0e-abd1-43c4-b06a-6803c1626df8 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:11.995338003 +0000 UTC m=+6.013141921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret") pod "global-pull-secret-syncer-fslwp" (UID: "66d0fe0e-abd1-43c4-b06a-6803c1626df8") : object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:09.995462 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:09.995381 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs podName:89d21151-3342-4fc2-ab77-68629dc8896e nodeName:}" failed. No retries permitted until 2026-07-16 18:00:11.995370722 +0000 UTC m=+6.013174624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs") pod "network-metrics-daemon-8r665" (UID: "89d21151-3342-4fc2-ab77-68629dc8896e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:10.196691 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.196650 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drbrq\" (UniqueName: \"kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq\") pod \"network-check-target-8zgv8\" (UID: \"022d8ead-bbfa-4500-96c9-ec2216a12abf\") " pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:10.196868 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:10.196850 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 18:00:10.196937 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:10.196882 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 18:00:10.196937 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:10.196895 2548 projected.go:196] Error preparing data for projected volume kube-api-access-drbrq for pod openshift-network-diagnostics/network-check-target-8zgv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:10.197040 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:10.196956 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq podName:022d8ead-bbfa-4500-96c9-ec2216a12abf nodeName:}" failed. No retries permitted until 2026-07-16 18:00:12.196938343 +0000 UTC m=+6.214742264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-drbrq" (UniqueName: "kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq") pod "network-check-target-8zgv8" (UID: "022d8ead-bbfa-4500-96c9-ec2216a12abf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:10.436884 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.436754 2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:55:08 +0000 UTC" deadline="2028-02-29 20:00:03.007281833 +0000 UTC" Jul 16 18:00:10.436884 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.436798 2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14233h59m52.570489886s" Jul 16 18:00:10.537757 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.537707 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-204.ec2.internal" event={"ID":"644b13fd518434df8a933cb0806e9ec0","Type":"ContainerStarted","Data":"c3b36b65a50fa2ffb54085d79925d41cbd2efc5dcc6a125399385a5695f5fc97"} Jul 16 18:00:10.543953 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.543917 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fxkpf" event={"ID":"1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7","Type":"ContainerStarted","Data":"80831e8b3ea035c59eb18eff1396129163e8b58ebbe7516dad7bbe81bba87d8e"} Jul 16 18:00:10.554286 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.554249 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bzjkl" event={"ID":"42fadce5-4688-43ff-b549-24da2f6def18","Type":"ContainerStarted","Data":"54a3f7dedf2e8fbb373ce12958ed50012e670868508ea2e870c09a0c4dcb4029"} Jul 16 18:00:10.562962 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.562925 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zcv4g" event={"ID":"33959b9d-18c5-4082-9c71-68efea2e06bc","Type":"ContainerStarted","Data":"9bdc2c29e8202f23eda8113a44e0ee4465ed0581a47564be55bbd1225c81a7c5"} Jul 16 18:00:10.569926 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.569049 2548 generic.go:356] "Generic (PLEG): container finished" podID="1ec22d40b685bc9e793c3583bd16291f" containerID="46d07ab76e65d542d99ce177a27a3c358b685f571181b46b4b9fddca0d4c19df" exitCode=0 Jul 16 18:00:10.569926 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.569152 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" event={"ID":"1ec22d40b685bc9e793c3583bd16291f","Type":"ContainerDied","Data":"46d07ab76e65d542d99ce177a27a3c358b685f571181b46b4b9fddca0d4c19df"} Jul 16 18:00:10.575327 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.575296 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59wmx" event={"ID":"4e00fd32-cd94-4741-a005-fbe723cfc5d5","Type":"ContainerStarted","Data":"70b0355d5004c82531a0a7a121e066eb912cafbe9fbd212339a16c73e9f0aa3f"} Jul 16 18:00:10.586543 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.584932 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-204.ec2.internal" podStartSLOduration=3.584912134 podStartE2EDuration="3.584912134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:10.554260395 +0000 UTC m=+4.572064314" watchObservedRunningTime="2026-07-16 18:00:10.584912134 +0000 UTC m=+4.602716054" Jul 16 18:00:10.595599 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.595495 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sjmsp" event={"ID":"20e24960-2a4d-461a-9b92-374682a4d176","Type":"ContainerStarted","Data":"3a11749dd57df620ebcdb45b3274b432091b27abd7d0fd985a3e9052fc311029"} Jul 16 18:00:10.613398 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.613360 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dbrvx" event={"ID":"3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a","Type":"ContainerStarted","Data":"1a14327f7595b07d54390bcd18e3fd3826a45573a43a7fc2eb05df3bcc9ef1b3"} Jul 16 18:00:10.616966 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.616935 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" event={"ID":"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6","Type":"ContainerStarted","Data":"aba4f781bd71dad0846155978e9f0e5881afec690f7cab9d6cdd0e8f6b01bb22"} Jul 16 18:00:10.636333 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.636297 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r2jww" event={"ID":"ec9cc724-8586-4f80-af6d-8e10ee17433f","Type":"ContainerStarted","Data":"992b624c6dfaeb4aef94b9c4e6f996cf175014fc23d9574646d1ce3b50d65259"} Jul 16 18:00:10.648559 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:10.648433 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" event={"ID":"a1e527a1-0819-4c70-95a0-93857af48d83","Type":"ContainerStarted","Data":"e47206efc53f445d2858e91e941d72ca6ebd5cee79990c3e687e64ef90f40c8d"} Jul 16 18:00:11.517771 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:11.516915 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:11.517771 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:11.517049 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:11.517771 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:11.517451 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:11.517771 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:11.517542 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:11.517771 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:11.517600 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:11.517771 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:11.517680 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:11.675302 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:11.675246 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" event={"ID":"1ec22d40b685bc9e793c3583bd16291f","Type":"ContainerStarted","Data":"ef125c31d2f8c0ad1a1c23431a2f78268f880111b1d07a4e9663a7a2c46ef1f8"} Jul 16 18:00:11.691811 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:11.691501 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-204.ec2.internal" podStartSLOduration=4.691478261 podStartE2EDuration="4.691478261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:11.691270237 +0000 UTC m=+5.709074156" watchObservedRunningTime="2026-07-16 18:00:11.691478261 +0000 UTC m=+5.709282181" Jul 16 18:00:12.010740 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:12.009822 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:12.010740 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:12.009909 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:12.010740 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:12.010050 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:12.010740 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:12.010131 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs podName:89d21151-3342-4fc2-ab77-68629dc8896e nodeName:}" failed. No retries permitted until 2026-07-16 18:00:16.010095811 +0000 UTC m=+10.027899714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs") pod "network-metrics-daemon-8r665" (UID: "89d21151-3342-4fc2-ab77-68629dc8896e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:12.010740 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:12.010504 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:12.010740 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:12.010549 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret podName:66d0fe0e-abd1-43c4-b06a-6803c1626df8 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:16.01053477 +0000 UTC m=+10.028338681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret") pod "global-pull-secret-syncer-fslwp" (UID: "66d0fe0e-abd1-43c4-b06a-6803c1626df8") : object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:12.211924 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:12.211888 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drbrq\" (UniqueName: \"kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq\") pod \"network-check-target-8zgv8\" (UID: \"022d8ead-bbfa-4500-96c9-ec2216a12abf\") " pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:12.212181 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:12.212137 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 18:00:12.212181 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:12.212162 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 18:00:12.212181 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:12.212184 2548 projected.go:196] Error preparing data for projected volume kube-api-access-drbrq for pod openshift-network-diagnostics/network-check-target-8zgv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:12.212376 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:12.212245 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq podName:022d8ead-bbfa-4500-96c9-ec2216a12abf nodeName:}" failed. No retries permitted until 2026-07-16 18:00:16.212225675 +0000 UTC m=+10.230029575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-drbrq" (UniqueName: "kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq") pod "network-check-target-8zgv8" (UID: "022d8ead-bbfa-4500-96c9-ec2216a12abf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:13.517138 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:13.517087 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:13.517138 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:13.517144 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:13.517639 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:13.517087 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:13.517639 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:13.517241 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:13.517639 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:13.517314 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:13.517639 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:13.517392 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:15.517255 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:15.517165 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:15.517721 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:15.517303 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:15.517804 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:15.517729 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:15.517877 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:15.517853 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:15.517938 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:15.517888 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:15.517986 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:15.517955 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:16.045435 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:16.044679 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:16.045435 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:16.044758 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:16.045435 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:16.044886 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:16.045435 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:16.044955 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret podName:66d0fe0e-abd1-43c4-b06a-6803c1626df8 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:24.044937332 +0000 UTC m=+18.062741245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret") pod "global-pull-secret-syncer-fslwp" (UID: "66d0fe0e-abd1-43c4-b06a-6803c1626df8") : object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:16.045435 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:16.045359 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:16.045435 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:16.045404 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs podName:89d21151-3342-4fc2-ab77-68629dc8896e nodeName:}" failed. No retries permitted until 2026-07-16 18:00:24.045389379 +0000 UTC m=+18.063193292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs") pod "network-metrics-daemon-8r665" (UID: "89d21151-3342-4fc2-ab77-68629dc8896e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:16.246011 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:16.245970 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drbrq\" (UniqueName: \"kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq\") pod \"network-check-target-8zgv8\" (UID: \"022d8ead-bbfa-4500-96c9-ec2216a12abf\") " pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:16.246534 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:16.246230 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 18:00:16.246534 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:16.246262 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 18:00:16.246534 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:16.246277 2548 projected.go:196] Error preparing data for projected volume kube-api-access-drbrq for pod openshift-network-diagnostics/network-check-target-8zgv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:16.246534 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:16.246353 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq podName:022d8ead-bbfa-4500-96c9-ec2216a12abf nodeName:}" failed. No retries permitted until 2026-07-16 18:00:24.246334371 +0000 UTC m=+18.264138281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-drbrq" (UniqueName: "kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq") pod "network-check-target-8zgv8" (UID: "022d8ead-bbfa-4500-96c9-ec2216a12abf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:17.516578 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:17.516544 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:17.517075 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:17.516679 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:17.517075 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:17.517051 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:17.517204 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:17.517174 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:17.517204 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:17.516478 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:17.517315 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:17.517264 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:19.516985 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:19.516944 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:19.517445 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:19.516960 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:19.517445 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:19.516960 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:19.517445 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:19.517116 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:19.517445 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:19.517189 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:19.517445 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:19.517280 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:21.517007 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:21.516965 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:21.517503 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:21.517021 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:21.517503 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:21.516979 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:21.517503 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:21.517094 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:21.517503 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:21.517153 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:21.517503 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:21.517227 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:23.517310 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:23.517270 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:23.517855 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:23.517316 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:23.517855 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:23.517325 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:23.517855 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:23.517404 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:23.517855 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:23.517500 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:23.517855 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:23.517592 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:24.106747 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:24.106712 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:24.106922 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:24.106789 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:24.106922 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:24.106893 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:24.106922 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:24.106899 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:24.107060 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:24.106955 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret podName:66d0fe0e-abd1-43c4-b06a-6803c1626df8 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:40.106935627 +0000 UTC m=+34.124739527 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret") pod "global-pull-secret-syncer-fslwp" (UID: "66d0fe0e-abd1-43c4-b06a-6803c1626df8") : object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:24.107060 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:24.106973 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs podName:89d21151-3342-4fc2-ab77-68629dc8896e nodeName:}" failed. No retries permitted until 2026-07-16 18:00:40.106964033 +0000 UTC m=+34.124767931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs") pod "network-metrics-daemon-8r665" (UID: "89d21151-3342-4fc2-ab77-68629dc8896e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:24.308735 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:24.308694 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drbrq\" (UniqueName: \"kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq\") pod \"network-check-target-8zgv8\" (UID: \"022d8ead-bbfa-4500-96c9-ec2216a12abf\") " pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:24.308916 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:24.308889 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 18:00:24.308962 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:24.308919 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 18:00:24.308962 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:24.308933 2548 projected.go:196] Error preparing data for projected volume kube-api-access-drbrq for pod openshift-network-diagnostics/network-check-target-8zgv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:24.309038 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:24.309000 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq podName:022d8ead-bbfa-4500-96c9-ec2216a12abf nodeName:}" failed. No retries permitted until 2026-07-16 18:00:40.308983114 +0000 UTC m=+34.326787035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-drbrq" (UniqueName: "kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq") pod "network-check-target-8zgv8" (UID: "022d8ead-bbfa-4500-96c9-ec2216a12abf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:25.517168 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:25.517124 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:25.517168 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:25.517169 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:25.517606 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:25.517183 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:25.517606 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:25.517279 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:25.517606 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:25.517392 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:25.517606 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:25.517456 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:27.517489 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:27.517397 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:27.517489 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:27.517423 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:27.517489 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:27.517423 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:27.518048 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:27.517534 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:27.518048 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:27.517608 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:27.518048 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:27.517671 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:29.517526 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.517143 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:29.518406 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.517182 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:29.518406 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:29.517642 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:29.518406 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.517183 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:29.518406 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:29.517714 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:29.518406 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:29.517774 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:29.719680 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.719600 2548 generic.go:356] "Generic (PLEG): container finished" podID="4e00fd32-cd94-4741-a005-fbe723cfc5d5" containerID="a1957bef801564026d79f3dbfbe256ac734e4a2da479cd111f21188db9f08e72" exitCode=0 Jul 16 18:00:29.719945 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.719685 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59wmx" event={"ID":"4e00fd32-cd94-4741-a005-fbe723cfc5d5","Type":"ContainerDied","Data":"a1957bef801564026d79f3dbfbe256ac734e4a2da479cd111f21188db9f08e72"} Jul 16 18:00:29.721157 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.721132 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dbrvx" event={"ID":"3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a","Type":"ContainerStarted","Data":"0c94295ccf2bbabc0f03d8e06cf4408b39d6fe3286eba1dd8cbe77bb70ab1ac8"} Jul 16 18:00:29.725064 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.725045 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/ovn-acl-logging/0.log" Jul 16 18:00:29.725446 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.725427 2548 generic.go:356] "Generic (PLEG): container finished" podID="4d5ed8e5-e63c-4506-a370-cfe068cd8ff6" containerID="8fb74df4445d58ffd8964bfd2f88a4b97afafb0ab52002cb2c67c02a583f2440" exitCode=1 Jul 16 18:00:29.725512 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.725495 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" event={"ID":"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6","Type":"ContainerStarted","Data":"94b869e97e23fb51b54e234996f92ff5b7cf260f9243cfd2dbbbf1889bed8aa2"} Jul 16 18:00:29.725561 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.725550 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" event={"ID":"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6","Type":"ContainerStarted","Data":"047c050e17e64829d4d2228712f2d226ec47197103faab3664bae05fcd78f4ea"} Jul 16 18:00:29.725611 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.725593 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" event={"ID":"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6","Type":"ContainerStarted","Data":"ab5fd499dad72850fe5db7a0cede1838f37b3a6cdb49f7a1dc5bce988602a5f9"} Jul 16 18:00:29.725655 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.725625 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" event={"ID":"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6","Type":"ContainerStarted","Data":"cdf6eee9218e3089cb320c42a10760863e96d2f5c17a54cc03097d026c5cbaf4"} Jul 16 18:00:29.725655 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.725653 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" event={"ID":"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6","Type":"ContainerDied","Data":"8fb74df4445d58ffd8964bfd2f88a4b97afafb0ab52002cb2c67c02a583f2440"} Jul 16 18:00:29.725725 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.725689 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" event={"ID":"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6","Type":"ContainerStarted","Data":"c8601cbdf76e51dbc1f641847398782dbe9bee15b5f997c89fb7c1115911dde3"} Jul 16 18:00:29.726810 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.726791 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r2jww" event={"ID":"ec9cc724-8586-4f80-af6d-8e10ee17433f","Type":"ContainerStarted","Data":"f077ae6247fc0ba2ae5752e5aca5e30816d9bbb6777634742e3181e13ab2070f"} Jul 16 18:00:29.728583 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.728562 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" event={"ID":"a1e527a1-0819-4c70-95a0-93857af48d83","Type":"ContainerStarted","Data":"bd0b02de62b341d03955e765bf438040447dbe07fdffe6b9f78f5dfbf557c20c"} Jul 16 18:00:29.729831 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.729796 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fxkpf" event={"ID":"1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7","Type":"ContainerStarted","Data":"4989b74b75929dbf8b928508f1d83b30db663c44483979ec8fc95aaaed397451"} Jul 16 18:00:29.731010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.730991 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bzjkl" event={"ID":"42fadce5-4688-43ff-b549-24da2f6def18","Type":"ContainerStarted","Data":"bba12931ecf2ed0f5f37e5bed39ab72a317b6c4266ea98031cedcf4ad4a32fef"} Jul 16 18:00:29.732291 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.732273 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zcv4g" event={"ID":"33959b9d-18c5-4082-9c71-68efea2e06bc","Type":"ContainerStarted","Data":"233ac9dcc6684f6bf5b84ebba2510f20fddebdbf7713406f24d8534abc239506"} Jul 16 18:00:29.757341 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.757300 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fxkpf" podStartSLOduration=4.79966547 podStartE2EDuration="23.757284913s" totalImagesPullingTime="18.957619443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:29.756913939 +0000 UTC m=+23.774717857" watchObservedRunningTime="2026-07-16 18:00:29.757284913 +0000 UTC m=+23.775088831" Jul 16 18:00:29.786538 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.786494 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bzjkl" podStartSLOduration=4.8246396449999995 podStartE2EDuration="23.786478417s" totalImagesPullingTime="18.961838772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:29.771416048 +0000 UTC m=+23.789219967" watchObservedRunningTime="2026-07-16 18:00:29.786478417 +0000 UTC m=+23.804282335" Jul 16 18:00:29.786691 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.786673 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dbrvx" podStartSLOduration=4.825557085 podStartE2EDuration="23.786668097s" totalImagesPullingTime="18.961111012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:29.785852407 +0000 UTC m=+23.803656325" watchObservedRunningTime="2026-07-16 18:00:29.786668097 +0000 UTC m=+23.804472016" Jul 16 18:00:29.803230 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.803183 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r2jww" podStartSLOduration=4.826579221 podStartE2EDuration="23.803168316s" totalImagesPullingTime="18.976589095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:29.802889782 +0000 UTC m=+23.820693701" watchObservedRunningTime="2026-07-16 18:00:29.803168316 +0000 UTC m=+23.820972235" Jul 16 18:00:29.820833 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:29.820794 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zcv4g" podStartSLOduration=4.787981758 podStartE2EDuration="23.820779232s" totalImagesPullingTime="19.032797474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:29.820228987 +0000 UTC m=+23.838032905" watchObservedRunningTime="2026-07-16 18:00:29.820779232 +0000 UTC m=+23.838583151" Jul 16 18:00:30.034832 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:30.034806 2548 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 18:00:30.439473 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:30.439391 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dbrvx" Jul 16 18:00:30.439842 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:30.439747 2548 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T18:00:30.034826386Z","UUID":"2b62d82d-675c-474f-8ffe-926bd8689f1a","Handler":null,"Name":"","Endpoint":""} Jul 16 18:00:30.440174 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:30.440154 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dbrvx" Jul 16 18:00:30.441476 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:30.441450 2548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 18:00:30.441604 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:30.441493 2548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 18:00:30.737042 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:30.736920 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sjmsp" event={"ID":"20e24960-2a4d-461a-9b92-374682a4d176","Type":"ContainerStarted","Data":"c8a9fb89790c407abbf222ca9e2c8881f2168ec0f986e97de9b8d16cca0ce18a"} Jul 16 18:00:30.739241 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:30.739208 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" event={"ID":"a1e527a1-0819-4c70-95a0-93857af48d83","Type":"ContainerStarted","Data":"574a75eb9edfa1769111e8c4852243af2106cb9de62ca8b04af3a7803e8693ac"} Jul 16 18:00:30.769448 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:30.769391 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sjmsp" podStartSLOduration=5.806050524 podStartE2EDuration="24.76937169s" totalImagesPullingTime="18.963321166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:30.768355384 +0000 UTC m=+24.786159304" watchObservedRunningTime="2026-07-16 18:00:30.76937169 +0000 UTC m=+24.787175607" Jul 16 18:00:31.516846 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:31.516815 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:31.516988 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:31.516944 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:31.516988 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:31.516953 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:31.516988 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:31.516972 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:31.517180 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:31.517048 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:31.517180 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:31.517147 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:31.744921 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:31.744850 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/ovn-acl-logging/0.log" Jul 16 18:00:31.745349 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:31.745324 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" event={"ID":"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6","Type":"ContainerStarted","Data":"e4848c43171ddde845fd958f17efe5b19586fc3d3475d75b8237ff92ee17189b"} Jul 16 18:00:31.747737 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:31.747699 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" event={"ID":"a1e527a1-0819-4c70-95a0-93857af48d83","Type":"ContainerStarted","Data":"0b7885f2eb0d07390f99436403f3b3b88b1a65269b551d64e4defe702212ece9"} Jul 16 18:00:31.747925 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:31.747903 2548 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 16 18:00:31.767670 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:31.767621 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzfqq" podStartSLOduration=4.636738483 podStartE2EDuration="25.76760647s" totalImagesPullingTime="21.130867987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:00:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:31.766830849 +0000 UTC m=+25.784634767" watchObservedRunningTime="2026-07-16 18:00:31.76760647 +0000 UTC m=+25.785410389" Jul 16 18:00:33.517244 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:33.517010 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:33.517674 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:33.517068 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:33.517674 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:33.517328 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:33.517674 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:33.517430 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:33.517674 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:33.517068 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:33.517674 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:33.517511 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:34.100740 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:34.100576 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dbrvx" Jul 16 18:00:34.100896 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:34.100855 2548 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 16 18:00:34.101329 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:34.101305 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dbrvx" Jul 16 18:00:34.756939 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:34.756903 2548 generic.go:356] "Generic (PLEG): container finished" podID="4e00fd32-cd94-4741-a005-fbe723cfc5d5" containerID="8f874c6193176bb9d27742d8ab1fce613623c823495df935db28b5c43ff222c9" exitCode=0 Jul 16 18:00:34.757722 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:34.756984 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59wmx" event={"ID":"4e00fd32-cd94-4741-a005-fbe723cfc5d5","Type":"ContainerDied","Data":"8f874c6193176bb9d27742d8ab1fce613623c823495df935db28b5c43ff222c9"} Jul 16 18:00:34.760463 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:34.760447 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/ovn-acl-logging/0.log" Jul 16 18:00:34.760822 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:34.760802 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" event={"ID":"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6","Type":"ContainerStarted","Data":"f5f20c30afe05b41b392b2149bcce95eb5d8fa02b7db18700e92e65f913d677f"} Jul 16 18:00:34.761245 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:34.761230 2548 scope.go:117] "RemoveContainer" containerID="8fb74df4445d58ffd8964bfd2f88a4b97afafb0ab52002cb2c67c02a583f2440" Jul 16 18:00:35.516848 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:35.516781 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:35.516848 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:35.516827 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:35.517212 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:35.516827 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:35.517212 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:35.516950 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:35.517212 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:35.517091 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:35.517363 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:35.517189 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:35.766939 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:35.766850 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/ovn-acl-logging/0.log" Jul 16 18:00:35.767527 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:35.767206 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" event={"ID":"4d5ed8e5-e63c-4506-a370-cfe068cd8ff6","Type":"ContainerStarted","Data":"abe431b16e1bd49292dd864c074c9527f8ed95231b6d81c407dec27fa153feb9"} Jul 16 18:00:35.767527 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:35.767464 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:35.767639 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:35.767547 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:35.767639 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:35.767597 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:35.783056 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:35.783027 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:35.784319 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:35.784300 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:00:35.804245 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:35.804193 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" podStartSLOduration=10.771331778 podStartE2EDuration="29.80417027s" totalImagesPullingTime="19.032838492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:35.802353026 +0000 UTC m=+29.820156944" watchObservedRunningTime="2026-07-16 18:00:35.80417027 +0000 UTC m=+29.821974188" Jul 16 18:00:36.060491 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:36.060261 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8zgv8"] Jul 16 18:00:36.060625 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:36.060525 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:36.060679 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:36.060631 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:36.061008 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:36.060985 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fslwp"] Jul 16 18:00:36.061092 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:36.061064 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:36.061178 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:36.061162 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:36.062854 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:36.062831 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8r665"] Jul 16 18:00:36.062940 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:36.062918 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:36.063026 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:36.062998 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:36.771142 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:36.771082 2548 generic.go:356] "Generic (PLEG): container finished" podID="4e00fd32-cd94-4741-a005-fbe723cfc5d5" containerID="9c3b374ab4a10d48941d49b8959d6868a3e3865149a2f411d49a71e002c49e35" exitCode=0 Jul 16 18:00:36.771737 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:36.771176 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59wmx" event={"ID":"4e00fd32-cd94-4741-a005-fbe723cfc5d5","Type":"ContainerDied","Data":"9c3b374ab4a10d48941d49b8959d6868a3e3865149a2f411d49a71e002c49e35"} Jul 16 18:00:37.517375 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:37.517337 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:37.517561 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:37.517337 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:37.517561 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:37.517490 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:37.517561 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:37.517524 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:37.517719 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:37.517624 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:37.517764 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:37.517726 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:38.777921 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:38.777880 2548 generic.go:356] "Generic (PLEG): container finished" podID="4e00fd32-cd94-4741-a005-fbe723cfc5d5" containerID="9ee6ae0231453f98c3212739c1b223370efd90bd14d32d15f5741fb9edb9288b" exitCode=0 Jul 16 18:00:38.778574 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:38.777948 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59wmx" event={"ID":"4e00fd32-cd94-4741-a005-fbe723cfc5d5","Type":"ContainerDied","Data":"9ee6ae0231453f98c3212739c1b223370efd90bd14d32d15f5741fb9edb9288b"} Jul 16 18:00:39.517300 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:39.517267 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:39.517524 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:39.517307 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:39.517524 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:39.517308 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:39.517524 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:39.517400 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zgv8" podUID="022d8ead-bbfa-4500-96c9-ec2216a12abf" Jul 16 18:00:39.517677 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:39.517520 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8r665" podUID="89d21151-3342-4fc2-ab77-68629dc8896e" Jul 16 18:00:39.517677 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:39.517585 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fslwp" podUID="66d0fe0e-abd1-43c4-b06a-6803c1626df8" Jul 16 18:00:40.124961 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:40.124925 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:40.125487 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:40.125000 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:40.125487 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:40.125096 2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:40.125487 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:40.125117 2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:40.125487 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:40.125173 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs podName:89d21151-3342-4fc2-ab77-68629dc8896e nodeName:}" failed. No retries permitted until 2026-07-16 18:01:12.125156206 +0000 UTC m=+66.142960122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs") pod "network-metrics-daemon-8r665" (UID: "89d21151-3342-4fc2-ab77-68629dc8896e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 18:00:40.125487 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:40.125192 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret podName:66d0fe0e-abd1-43c4-b06a-6803c1626df8 nodeName:}" failed. No retries permitted until 2026-07-16 18:01:12.125182481 +0000 UTC m=+66.142986380 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret") pod "global-pull-secret-syncer-fslwp" (UID: "66d0fe0e-abd1-43c4-b06a-6803c1626df8") : object "kube-system"/"original-pull-secret" not registered Jul 16 18:00:40.326931 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:40.326895 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drbrq\" (UniqueName: \"kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq\") pod \"network-check-target-8zgv8\" (UID: \"022d8ead-bbfa-4500-96c9-ec2216a12abf\") " pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:40.327142 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:40.327087 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 18:00:40.327142 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:40.327126 2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 18:00:40.327142 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:40.327139 2548 projected.go:196] Error preparing data for projected volume kube-api-access-drbrq for pod openshift-network-diagnostics/network-check-target-8zgv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:40.327299 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:40.327203 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq podName:022d8ead-bbfa-4500-96c9-ec2216a12abf nodeName:}" failed. No retries permitted until 2026-07-16 18:01:12.327185139 +0000 UTC m=+66.344989050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-drbrq" (UniqueName: "kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq") pod "network-check-target-8zgv8" (UID: "022d8ead-bbfa-4500-96c9-ec2216a12abf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 18:00:41.226957 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.226926 2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-204.ec2.internal" event="NodeReady" Jul 16 18:00:41.227448 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.227120 2548 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 18:00:41.277152 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.277118 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cd4f49bb7-228rw"] Jul 16 18:00:41.285241 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.285207 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-48zz7"] Jul 16 18:00:41.285392 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.285329 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.287983 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.287958 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w7fgm\"" Jul 16 18:00:41.287983 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.287978 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 18:00:41.291120 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.291084 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4xfqn"] Jul 16 18:00:41.291255 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.291183 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:41.302467 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.302303 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 18:00:41.305568 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.305550 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4xfqn" Jul 16 18:00:41.311838 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.311821 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 18:00:41.312070 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.312056 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 18:00:41.312611 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.312597 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w7fs9\"" Jul 16 18:00:41.320338 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.320297 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pxh9s\"" Jul 16 18:00:41.320338 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.320333 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 18:00:41.320491 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.320311 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 18:00:41.320491 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.320311 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 18:00:41.337841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.337810 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 18:00:41.340532 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.340513 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 18:00:41.346172 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.346150 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cd4f49bb7-228rw"] Jul 16 18:00:41.347050 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.347023 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-48zz7"] Jul 16 18:00:41.357975 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.357908 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4xfqn"] Jul 16 18:00:41.435337 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435291 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80a46446-99bc-4b46-acb0-770dfa8f5321-trusted-ca\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.435525 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435343 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80a46446-99bc-4b46-acb0-770dfa8f5321-image-registry-private-configuration\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.435525 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435394 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80a46446-99bc-4b46-acb0-770dfa8f5321-installation-pull-secrets\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.435525 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435423 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-bound-sa-token\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.435525 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435451 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-config-volume\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:41.435525 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435494 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feb74991-99e7-4e5b-9107-7843035254b2-cert\") pod \"ingress-canary-4xfqn\" (UID: \"feb74991-99e7-4e5b-9107-7843035254b2\") " pod="openshift-ingress-canary/ingress-canary-4xfqn" Jul 16 18:00:41.435525 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435521 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-certificates\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.435835 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435547 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnkh6\" (UniqueName: \"kubernetes.io/projected/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-kube-api-access-rnkh6\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:41.435835 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435572 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp9jj\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-kube-api-access-vp9jj\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.435835 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435592 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:41.435835 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435638 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qph9\" (UniqueName: \"kubernetes.io/projected/feb74991-99e7-4e5b-9107-7843035254b2-kube-api-access-9qph9\") pod \"ingress-canary-4xfqn\" (UID: \"feb74991-99e7-4e5b-9107-7843035254b2\") " pod="openshift-ingress-canary/ingress-canary-4xfqn" Jul 16 18:00:41.435835 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435667 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.435835 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435686 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80a46446-99bc-4b46-acb0-770dfa8f5321-ca-trust-extracted\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.435835 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.435703 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-tmp-dir\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:41.517321 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.517289 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:00:41.517520 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.517334 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:00:41.517520 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.517289 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:00:41.520745 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.520719 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 18:00:41.521008 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.520990 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 18:00:41.521008 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.521000 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wd4hj\"" Jul 16 18:00:41.521256 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.521241 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 18:00:41.521319 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.521292 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5mncv\"" Jul 16 18:00:41.521505 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.521488 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 18:00:41.536966 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.536939 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80a46446-99bc-4b46-acb0-770dfa8f5321-installation-pull-secrets\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.537095 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.536981 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-bound-sa-token\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.537249 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.537228 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-config-volume\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:41.537340 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.537323 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feb74991-99e7-4e5b-9107-7843035254b2-cert\") pod \"ingress-canary-4xfqn\" (UID: \"feb74991-99e7-4e5b-9107-7843035254b2\") " pod="openshift-ingress-canary/ingress-canary-4xfqn" Jul 16 18:00:41.537386 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.537374 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-certificates\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.537748 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.537558 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnkh6\" (UniqueName: \"kubernetes.io/projected/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-kube-api-access-rnkh6\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:41.537748 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.537613 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9jj\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-kube-api-access-vp9jj\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.537748 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.537642 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:41.537748 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.537680 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qph9\" (UniqueName: \"kubernetes.io/projected/feb74991-99e7-4e5b-9107-7843035254b2-kube-api-access-9qph9\") pod \"ingress-canary-4xfqn\" (UID: \"feb74991-99e7-4e5b-9107-7843035254b2\") " pod="openshift-ingress-canary/ingress-canary-4xfqn" Jul 16 18:00:41.537748 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.537708 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.537748 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.537733 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80a46446-99bc-4b46-acb0-770dfa8f5321-ca-trust-extracted\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.538081 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.537755 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-tmp-dir\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:41.538081 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.537792 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80a46446-99bc-4b46-acb0-770dfa8f5321-trusted-ca\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.538081 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.537830 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80a46446-99bc-4b46-acb0-770dfa8f5321-image-registry-private-configuration\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.538081 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:41.537899 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 18:00:41.538081 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:41.537924 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd4f49bb7-228rw: secret "image-registry-tls" not found Jul 16 18:00:41.538081 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:41.537982 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls podName:80a46446-99bc-4b46-acb0-770dfa8f5321 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:42.037956909 +0000 UTC m=+36.055760820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls") pod "image-registry-6cd4f49bb7-228rw" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321") : secret "image-registry-tls" not found Jul 16 18:00:41.538081 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.538026 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-certificates\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.538081 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.538037 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-config-volume\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:41.538081 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:41.538061 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 18:00:41.538483 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:41.538116 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls podName:ddc52a4b-0bce-4ead-bebd-5c441386bdf8 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:42.038085536 +0000 UTC m=+36.055889433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls") pod "dns-default-48zz7" (UID: "ddc52a4b-0bce-4ead-bebd-5c441386bdf8") : secret "dns-default-metrics-tls" not found Jul 16 18:00:41.538483 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.538306 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-tmp-dir\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:41.538483 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.538409 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80a46446-99bc-4b46-acb0-770dfa8f5321-ca-trust-extracted\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.539722 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.539598 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80a46446-99bc-4b46-acb0-770dfa8f5321-trusted-ca\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.542865 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.542841 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80a46446-99bc-4b46-acb0-770dfa8f5321-image-registry-private-configuration\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.542865 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.542858 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80a46446-99bc-4b46-acb0-770dfa8f5321-installation-pull-secrets\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.543029 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.542897 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feb74991-99e7-4e5b-9107-7843035254b2-cert\") pod \"ingress-canary-4xfqn\" (UID: \"feb74991-99e7-4e5b-9107-7843035254b2\") " pod="openshift-ingress-canary/ingress-canary-4xfqn" Jul 16 18:00:41.551907 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.551885 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp9jj\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-kube-api-access-vp9jj\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.552144 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.552090 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qph9\" (UniqueName: \"kubernetes.io/projected/feb74991-99e7-4e5b-9107-7843035254b2-kube-api-access-9qph9\") pod \"ingress-canary-4xfqn\" (UID: \"feb74991-99e7-4e5b-9107-7843035254b2\") " pod="openshift-ingress-canary/ingress-canary-4xfqn" Jul 16 18:00:41.552479 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.552462 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnkh6\" (UniqueName: \"kubernetes.io/projected/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-kube-api-access-rnkh6\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:41.553165 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.553141 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-bound-sa-token\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:41.614042 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.613918 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4xfqn" Jul 16 18:00:41.767797 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.767760 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4xfqn"] Jul 16 18:00:41.772250 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:00:41.772212 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb74991_99e7_4e5b_9107_7843035254b2.slice/crio-c0bbd3272d7cd462179fe95c33a01f37b8c821983184a109920eeaac4df64f50 WatchSource:0}: Error finding container c0bbd3272d7cd462179fe95c33a01f37b8c821983184a109920eeaac4df64f50: Status 404 returned error can't find the container with id c0bbd3272d7cd462179fe95c33a01f37b8c821983184a109920eeaac4df64f50 Jul 16 18:00:41.787150 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:41.787111 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4xfqn" event={"ID":"feb74991-99e7-4e5b-9107-7843035254b2","Type":"ContainerStarted","Data":"c0bbd3272d7cd462179fe95c33a01f37b8c821983184a109920eeaac4df64f50"} Jul 16 18:00:42.043692 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:42.043595 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:42.043692 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:42.043646 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:42.043879 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:42.043754 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 18:00:42.043879 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:42.043831 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls podName:ddc52a4b-0bce-4ead-bebd-5c441386bdf8 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:43.043808324 +0000 UTC m=+37.061612239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls") pod "dns-default-48zz7" (UID: "ddc52a4b-0bce-4ead-bebd-5c441386bdf8") : secret "dns-default-metrics-tls" not found Jul 16 18:00:42.043879 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:42.043765 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 18:00:42.043879 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:42.043865 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd4f49bb7-228rw: secret "image-registry-tls" not found Jul 16 18:00:42.044034 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:42.043937 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls podName:80a46446-99bc-4b46-acb0-770dfa8f5321 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:43.043918455 +0000 UTC m=+37.061722364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls") pod "image-registry-6cd4f49bb7-228rw" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321") : secret "image-registry-tls" not found Jul 16 18:00:43.053425 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:43.053357 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:43.053858 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:43.053433 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:43.053858 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:43.053508 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 18:00:43.053858 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:43.053557 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 18:00:43.053858 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:43.053571 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd4f49bb7-228rw: secret "image-registry-tls" not found Jul 16 18:00:43.053858 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:43.053573 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls podName:ddc52a4b-0bce-4ead-bebd-5c441386bdf8 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:45.053558178 +0000 UTC m=+39.071362078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls") pod "dns-default-48zz7" (UID: "ddc52a4b-0bce-4ead-bebd-5c441386bdf8") : secret "dns-default-metrics-tls" not found Jul 16 18:00:43.053858 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:43.053632 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls podName:80a46446-99bc-4b46-acb0-770dfa8f5321 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:45.053616566 +0000 UTC m=+39.071420468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls") pod "image-registry-6cd4f49bb7-228rw" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321") : secret "image-registry-tls" not found Jul 16 18:00:43.795262 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:43.795228 2548 generic.go:356] "Generic (PLEG): container finished" podID="4e00fd32-cd94-4741-a005-fbe723cfc5d5" containerID="0c93d11c21aa2d9e5f2620ecdeb9e9e65285b164274e3e26c25934d4ac9129fd" exitCode=0 Jul 16 18:00:43.795439 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:43.795299 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59wmx" event={"ID":"4e00fd32-cd94-4741-a005-fbe723cfc5d5","Type":"ContainerDied","Data":"0c93d11c21aa2d9e5f2620ecdeb9e9e65285b164274e3e26c25934d4ac9129fd"} Jul 16 18:00:44.801352 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:44.801136 2548 generic.go:356] "Generic (PLEG): container finished" podID="4e00fd32-cd94-4741-a005-fbe723cfc5d5" containerID="10906fb1d37b62cc759861771a04ac46a4d1961b26de5ef0508c21539f9de89b" exitCode=0 Jul 16 18:00:44.801352 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:44.801218 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59wmx" event={"ID":"4e00fd32-cd94-4741-a005-fbe723cfc5d5","Type":"ContainerDied","Data":"10906fb1d37b62cc759861771a04ac46a4d1961b26de5ef0508c21539f9de89b"} Jul 16 18:00:45.071397 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:45.071302 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:45.071397 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:45.071373 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:45.071618 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:45.071491 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 18:00:45.071618 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:45.071596 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls podName:ddc52a4b-0bce-4ead-bebd-5c441386bdf8 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:49.071575879 +0000 UTC m=+43.089379776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls") pod "dns-default-48zz7" (UID: "ddc52a4b-0bce-4ead-bebd-5c441386bdf8") : secret "dns-default-metrics-tls" not found Jul 16 18:00:45.071618 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:45.071498 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 18:00:45.071618 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:45.071618 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd4f49bb7-228rw: secret "image-registry-tls" not found Jul 16 18:00:45.071825 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:45.071673 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls podName:80a46446-99bc-4b46-acb0-770dfa8f5321 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:49.071655777 +0000 UTC m=+43.089459677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls") pod "image-registry-6cd4f49bb7-228rw" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321") : secret "image-registry-tls" not found Jul 16 18:00:45.805074 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:45.805042 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4xfqn" event={"ID":"feb74991-99e7-4e5b-9107-7843035254b2","Type":"ContainerStarted","Data":"ea399629157fe0aeae25ef035b71cb1f779d814fecdeec0c7463727a1195d44e"} Jul 16 18:00:45.808256 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:45.808230 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59wmx" event={"ID":"4e00fd32-cd94-4741-a005-fbe723cfc5d5","Type":"ContainerStarted","Data":"dae5edc97f79bf2560033a1ec2ae125b39995d87561aa622914fb301efe9a358"} Jul 16 18:00:45.821984 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:45.821915 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4xfqn" podStartSLOduration=1.1427949370000001 podStartE2EDuration="4.821897278s" totalImagesPullingTime="3.679102341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:45.821222943 +0000 UTC m=+39.839026863" watchObservedRunningTime="2026-07-16 18:00:45.821897278 +0000 UTC m=+39.839701198" Jul 16 18:00:45.845479 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:45.845429 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-59wmx" podStartSLOduration=9.568681259 podStartE2EDuration="39.845411627s" totalImagesPullingTime="30.276730368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:00:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:45.844511456 +0000 UTC m=+39.862315388" watchObservedRunningTime="2026-07-16 18:00:45.845411627 +0000 UTC m=+39.863215543" Jul 16 18:00:49.103915 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:49.103880 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:49.104393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:49.103959 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:49.104393 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:49.104049 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 18:00:49.104393 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:49.104072 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd4f49bb7-228rw: secret "image-registry-tls" not found Jul 16 18:00:49.104393 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:49.104081 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 18:00:49.104393 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:49.104143 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls podName:ddc52a4b-0bce-4ead-bebd-5c441386bdf8 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:57.104128733 +0000 UTC m=+51.121932630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls") pod "dns-default-48zz7" (UID: "ddc52a4b-0bce-4ead-bebd-5c441386bdf8") : secret "dns-default-metrics-tls" not found Jul 16 18:00:49.104393 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:49.104175 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls podName:80a46446-99bc-4b46-acb0-770dfa8f5321 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:57.10416891 +0000 UTC m=+51.121972806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls") pod "image-registry-6cd4f49bb7-228rw" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321") : secret "image-registry-tls" not found Jul 16 18:00:50.623513 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.623478 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9t8bs"] Jul 16 18:00:50.659528 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.659496 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9t8bs"] Jul 16 18:00:50.659705 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.659611 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.663002 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.662964 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 18:00:50.663132 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.663093 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7cl77\"" Jul 16 18:00:50.664076 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.664061 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 18:00:50.664180 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.664065 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 18:00:50.664180 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.664090 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 18:00:50.815124 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.815067 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.815124 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.815132 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsvjj\" (UniqueName: \"kubernetes.io/projected/0203802b-4e91-443d-bfd5-231ffde10de5-kube-api-access-jsvjj\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.815402 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.815267 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0203802b-4e91-443d-bfd5-231ffde10de5-crio-socket\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.815402 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.815301 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0203802b-4e91-443d-bfd5-231ffde10de5-data-volume\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.815402 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.815330 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.916699 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.916603 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.916699 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.916650 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsvjj\" (UniqueName: \"kubernetes.io/projected/0203802b-4e91-443d-bfd5-231ffde10de5-kube-api-access-jsvjj\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.916918 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.916725 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0203802b-4e91-443d-bfd5-231ffde10de5-crio-socket\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.916918 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.916745 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0203802b-4e91-443d-bfd5-231ffde10de5-data-volume\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.916918 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:50.916763 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 18:00:50.916918 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:50.916839 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls podName:0203802b-4e91-443d-bfd5-231ffde10de5 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:51.416819481 +0000 UTC m=+45.434623410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9t8bs" (UID: "0203802b-4e91-443d-bfd5-231ffde10de5") : secret "insights-runtime-extractor-tls" not found Jul 16 18:00:50.916918 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.916881 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.917214 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.916942 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0203802b-4e91-443d-bfd5-231ffde10de5-crio-socket\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.917214 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:50.916996 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 18:00:50.917214 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:50.917053 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm podName:0203802b-4e91-443d-bfd5-231ffde10de5 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:51.417038011 +0000 UTC m=+45.434841920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9t8bs" (UID: "0203802b-4e91-443d-bfd5-231ffde10de5") : configmap "kube-rbac-proxy" not found Jul 16 18:00:50.917214 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.917069 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0203802b-4e91-443d-bfd5-231ffde10de5-data-volume\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:50.926932 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:50.926912 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsvjj\" (UniqueName: \"kubernetes.io/projected/0203802b-4e91-443d-bfd5-231ffde10de5-kube-api-access-jsvjj\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:51.420871 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:51.420834 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:51.421043 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:51.420904 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:51.421043 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:51.420961 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 18:00:51.421043 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:51.421031 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 18:00:51.421154 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:51.421034 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm podName:0203802b-4e91-443d-bfd5-231ffde10de5 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:52.421015632 +0000 UTC m=+46.438819538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9t8bs" (UID: "0203802b-4e91-443d-bfd5-231ffde10de5") : configmap "kube-rbac-proxy" not found Jul 16 18:00:51.421154 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:51.421077 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls podName:0203802b-4e91-443d-bfd5-231ffde10de5 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:52.421066147 +0000 UTC m=+46.438870049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9t8bs" (UID: "0203802b-4e91-443d-bfd5-231ffde10de5") : secret "insights-runtime-extractor-tls" not found Jul 16 18:00:52.429331 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:52.429292 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:52.429788 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:52.429369 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:52.429788 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:52.429436 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 18:00:52.429788 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:52.429453 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 18:00:52.429788 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:52.429502 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm podName:0203802b-4e91-443d-bfd5-231ffde10de5 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:54.429485704 +0000 UTC m=+48.447289600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9t8bs" (UID: "0203802b-4e91-443d-bfd5-231ffde10de5") : configmap "kube-rbac-proxy" not found Jul 16 18:00:52.429788 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:52.429517 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls podName:0203802b-4e91-443d-bfd5-231ffde10de5 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:54.429509677 +0000 UTC m=+48.447313574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9t8bs" (UID: "0203802b-4e91-443d-bfd5-231ffde10de5") : secret "insights-runtime-extractor-tls" not found Jul 16 18:00:52.658467 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:52.658437 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fxkpf_1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7/dns-node-resolver/0.log" Jul 16 18:00:53.465281 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:53.465254 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bzjkl_42fadce5-4688-43ff-b549-24da2f6def18/node-ca/0.log" Jul 16 18:00:54.260321 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:54.260294 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4xfqn_feb74991-99e7-4e5b-9107-7843035254b2/serve-healthcheck-canary/0.log" Jul 16 18:00:54.443452 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:54.443407 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:54.443619 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:54.443484 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:54.443619 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:54.443557 2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 18:00:54.443619 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:54.443605 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm podName:0203802b-4e91-443d-bfd5-231ffde10de5 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:58.443592454 +0000 UTC m=+52.461396350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9t8bs" (UID: "0203802b-4e91-443d-bfd5-231ffde10de5") : configmap "kube-rbac-proxy" not found Jul 16 18:00:54.443758 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:54.443558 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 18:00:54.443758 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:54.443694 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls podName:0203802b-4e91-443d-bfd5-231ffde10de5 nodeName:}" failed. No retries permitted until 2026-07-16 18:00:58.443678628 +0000 UTC m=+52.461482530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9t8bs" (UID: "0203802b-4e91-443d-bfd5-231ffde10de5") : secret "insights-runtime-extractor-tls" not found Jul 16 18:00:57.165168 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:57.165129 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:00:57.165554 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:57.165182 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:00:57.165554 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:57.165289 2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 18:00:57.165554 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:57.165350 2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 18:00:57.165554 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:57.165368 2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd4f49bb7-228rw: secret "image-registry-tls" not found Jul 16 18:00:57.165554 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:57.165356 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls podName:ddc52a4b-0bce-4ead-bebd-5c441386bdf8 nodeName:}" failed. No retries permitted until 2026-07-16 18:01:13.16534207 +0000 UTC m=+67.183145967 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls") pod "dns-default-48zz7" (UID: "ddc52a4b-0bce-4ead-bebd-5c441386bdf8") : secret "dns-default-metrics-tls" not found Jul 16 18:00:57.165554 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:57.165422 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls podName:80a46446-99bc-4b46-acb0-770dfa8f5321 nodeName:}" failed. No retries permitted until 2026-07-16 18:01:13.165409015 +0000 UTC m=+67.183212913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls") pod "image-registry-6cd4f49bb7-228rw" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321") : secret "image-registry-tls" not found Jul 16 18:00:58.476374 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:58.476334 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:58.476753 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:58.476414 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:00:58.476753 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:58.476512 2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 18:00:58.476753 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:00:58.476577 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls podName:0203802b-4e91-443d-bfd5-231ffde10de5 nodeName:}" failed. No retries permitted until 2026-07-16 18:01:06.476560086 +0000 UTC m=+60.494363998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9t8bs" (UID: "0203802b-4e91-443d-bfd5-231ffde10de5") : secret "insights-runtime-extractor-tls" not found Jul 16 18:00:58.477002 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:00:58.476983 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0203802b-4e91-443d-bfd5-231ffde10de5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:01:06.532776 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:06.532741 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:01:06.534801 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:06.534777 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0203802b-4e91-443d-bfd5-231ffde10de5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t8bs\" (UID: \"0203802b-4e91-443d-bfd5-231ffde10de5\") " pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:01:06.572351 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:06.572316 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7cl77\"" Jul 16 18:01:06.580319 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:06.580296 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9t8bs" Jul 16 18:01:06.722324 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:06.722254 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9t8bs"] Jul 16 18:01:06.726086 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:06.726058 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0203802b_4e91_443d_bfd5_231ffde10de5.slice/crio-448d49b6a000efb8b42741a20bc548121474e0c61c38c8079a2fd24ff67d82d0 WatchSource:0}: Error finding container 448d49b6a000efb8b42741a20bc548121474e0c61c38c8079a2fd24ff67d82d0: Status 404 returned error can't find the container with id 448d49b6a000efb8b42741a20bc548121474e0c61c38c8079a2fd24ff67d82d0 Jul 16 18:01:06.858600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:06.858519 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9t8bs" event={"ID":"0203802b-4e91-443d-bfd5-231ffde10de5","Type":"ContainerStarted","Data":"448d49b6a000efb8b42741a20bc548121474e0c61c38c8079a2fd24ff67d82d0"} Jul 16 18:01:07.790965 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:07.790922 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t69v6" Jul 16 18:01:12.187752 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.187646 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:01:12.187752 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.187730 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:01:12.191136 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.191091 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 18:01:12.191267 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.191155 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 18:01:12.201052 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.201028 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66d0fe0e-abd1-43c4-b06a-6803c1626df8-original-pull-secret\") pod \"global-pull-secret-syncer-fslwp\" (UID: \"66d0fe0e-abd1-43c4-b06a-6803c1626df8\") " pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:01:12.201169 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.201032 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89d21151-3342-4fc2-ab77-68629dc8896e-metrics-certs\") pod \"network-metrics-daemon-8r665\" (UID: \"89d21151-3342-4fc2-ab77-68629dc8896e\") " pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:01:12.389570 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.389523 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drbrq\" (UniqueName: \"kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq\") pod \"network-check-target-8zgv8\" (UID: \"022d8ead-bbfa-4500-96c9-ec2216a12abf\") " pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:01:12.392469 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.392449 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 18:01:12.403008 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.402981 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 18:01:12.413274 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.413248 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drbrq\" (UniqueName: \"kubernetes.io/projected/022d8ead-bbfa-4500-96c9-ec2216a12abf-kube-api-access-drbrq\") pod \"network-check-target-8zgv8\" (UID: \"022d8ead-bbfa-4500-96c9-ec2216a12abf\") " pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:01:12.431672 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.431654 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5mncv\"" Jul 16 18:01:12.435833 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.435816 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fslwp" Jul 16 18:01:12.439671 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.439630 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8r665" Jul 16 18:01:12.444909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.444891 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wd4hj\"" Jul 16 18:01:12.453149 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.453123 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:01:12.605954 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.605881 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fslwp"] Jul 16 18:01:12.609545 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:12.609504 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d0fe0e_abd1_43c4_b06a_6803c1626df8.slice/crio-ce18a654b1d5ca31c39933b293ce0eb1be22805f7ff6afc4055d816d3d2070c3 WatchSource:0}: Error finding container ce18a654b1d5ca31c39933b293ce0eb1be22805f7ff6afc4055d816d3d2070c3: Status 404 returned error can't find the container with id ce18a654b1d5ca31c39933b293ce0eb1be22805f7ff6afc4055d816d3d2070c3 Jul 16 18:01:12.622032 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.621951 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8r665"] Jul 16 18:01:12.630520 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:12.629916 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d21151_3342_4fc2_ab77_68629dc8896e.slice/crio-647348c0bd8f9af8a19d2c45217da691a102597e80be815c0902db6cbd17e81f WatchSource:0}: Error finding container 647348c0bd8f9af8a19d2c45217da691a102597e80be815c0902db6cbd17e81f: Status 404 returned error can't find the container with id 647348c0bd8f9af8a19d2c45217da691a102597e80be815c0902db6cbd17e81f Jul 16 18:01:12.640659 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.640578 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8zgv8"] Jul 16 18:01:12.644028 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:12.643997 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022d8ead_bbfa_4500_96c9_ec2216a12abf.slice/crio-603d0612ffbf54bf01732ad8645cf358a100482e8cbad6d7760484160e331129 WatchSource:0}: Error finding container 603d0612ffbf54bf01732ad8645cf358a100482e8cbad6d7760484160e331129: Status 404 returned error can't find the container with id 603d0612ffbf54bf01732ad8645cf358a100482e8cbad6d7760484160e331129 Jul 16 18:01:12.878357 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.878317 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fslwp" event={"ID":"66d0fe0e-abd1-43c4-b06a-6803c1626df8","Type":"ContainerStarted","Data":"ce18a654b1d5ca31c39933b293ce0eb1be22805f7ff6afc4055d816d3d2070c3"} Jul 16 18:01:12.880836 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.880765 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9t8bs" event={"ID":"0203802b-4e91-443d-bfd5-231ffde10de5","Type":"ContainerStarted","Data":"95a0cee3e8b017c43aa60909907428e67a02a627ce1a052f7513f50f05e3f02a"} Jul 16 18:01:12.882168 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.882133 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8zgv8" event={"ID":"022d8ead-bbfa-4500-96c9-ec2216a12abf","Type":"ContainerStarted","Data":"603d0612ffbf54bf01732ad8645cf358a100482e8cbad6d7760484160e331129"} Jul 16 18:01:12.883501 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:12.883477 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8r665" event={"ID":"89d21151-3342-4fc2-ab77-68629dc8896e","Type":"ContainerStarted","Data":"647348c0bd8f9af8a19d2c45217da691a102597e80be815c0902db6cbd17e81f"} Jul 16 18:01:13.111433 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.111401 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cd4f49bb7-228rw"] Jul 16 18:01:13.111661 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:01:13.111632 2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" podUID="80a46446-99bc-4b46-acb0-770dfa8f5321" Jul 16 18:01:13.125051 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.125018 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d"] Jul 16 18:01:13.127272 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.127246 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:13.130252 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.130187 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 18:01:13.130558 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.130502 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 18:01:13.130684 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.130638 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 16 18:01:13.130807 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.130783 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 18:01:13.140832 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.140785 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d"] Jul 16 18:01:13.196525 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.196485 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:01:13.196959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.196540 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:01:13.196959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.196587 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09f3bf26-3f2f-438a-958a-47e1e829a74a-klusterlet-config\") pod \"klusterlet-addon-workmgr-85c7c976bb-m5h7d\" (UID: \"09f3bf26-3f2f-438a-958a-47e1e829a74a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:13.196959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.196616 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09f3bf26-3f2f-438a-958a-47e1e829a74a-tmp\") pod \"klusterlet-addon-workmgr-85c7c976bb-m5h7d\" (UID: \"09f3bf26-3f2f-438a-958a-47e1e829a74a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:13.196959 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.196662 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phdvb\" (UniqueName: \"kubernetes.io/projected/09f3bf26-3f2f-438a-958a-47e1e829a74a-kube-api-access-phdvb\") pod \"klusterlet-addon-workmgr-85c7c976bb-m5h7d\" (UID: \"09f3bf26-3f2f-438a-958a-47e1e829a74a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:13.199314 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.199290 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc52a4b-0bce-4ead-bebd-5c441386bdf8-metrics-tls\") pod \"dns-default-48zz7\" (UID: \"ddc52a4b-0bce-4ead-bebd-5c441386bdf8\") " pod="openshift-dns/dns-default-48zz7" Jul 16 18:01:13.199447 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.199371 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls\") pod \"image-registry-6cd4f49bb7-228rw\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:01:13.224365 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.223890 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86977454cd-zrxxx"] Jul 16 18:01:13.226316 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.226292 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.244982 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.244958 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86977454cd-zrxxx"] Jul 16 18:01:13.297493 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.297454 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phdvb\" (UniqueName: \"kubernetes.io/projected/09f3bf26-3f2f-438a-958a-47e1e829a74a-kube-api-access-phdvb\") pod \"klusterlet-addon-workmgr-85c7c976bb-m5h7d\" (UID: \"09f3bf26-3f2f-438a-958a-47e1e829a74a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:13.297701 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.297509 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eade24af-17f3-4e72-8f79-4a512640681c-image-registry-private-configuration\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.297701 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.297659 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eade24af-17f3-4e72-8f79-4a512640681c-registry-certificates\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.297821 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.297702 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eade24af-17f3-4e72-8f79-4a512640681c-trusted-ca\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.297821 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.297724 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eade24af-17f3-4e72-8f79-4a512640681c-bound-sa-token\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.297821 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.297743 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eade24af-17f3-4e72-8f79-4a512640681c-installation-pull-secrets\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.297821 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.297799 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psvrk\" (UniqueName: \"kubernetes.io/projected/eade24af-17f3-4e72-8f79-4a512640681c-kube-api-access-psvrk\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.297995 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.297886 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eade24af-17f3-4e72-8f79-4a512640681c-ca-trust-extracted\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.297995 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.297933 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09f3bf26-3f2f-438a-958a-47e1e829a74a-klusterlet-config\") pod \"klusterlet-addon-workmgr-85c7c976bb-m5h7d\" (UID: \"09f3bf26-3f2f-438a-958a-47e1e829a74a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:13.297995 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.297961 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eade24af-17f3-4e72-8f79-4a512640681c-registry-tls\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.297995 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.297986 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09f3bf26-3f2f-438a-958a-47e1e829a74a-tmp\") pod \"klusterlet-addon-workmgr-85c7c976bb-m5h7d\" (UID: \"09f3bf26-3f2f-438a-958a-47e1e829a74a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:13.298461 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.298406 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09f3bf26-3f2f-438a-958a-47e1e829a74a-tmp\") pod \"klusterlet-addon-workmgr-85c7c976bb-m5h7d\" (UID: \"09f3bf26-3f2f-438a-958a-47e1e829a74a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:13.301643 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.301606 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09f3bf26-3f2f-438a-958a-47e1e829a74a-klusterlet-config\") pod \"klusterlet-addon-workmgr-85c7c976bb-m5h7d\" (UID: \"09f3bf26-3f2f-438a-958a-47e1e829a74a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:13.309506 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.309445 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phdvb\" (UniqueName: \"kubernetes.io/projected/09f3bf26-3f2f-438a-958a-47e1e829a74a-kube-api-access-phdvb\") pod \"klusterlet-addon-workmgr-85c7c976bb-m5h7d\" (UID: \"09f3bf26-3f2f-438a-958a-47e1e829a74a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:13.398460 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.398360 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eade24af-17f3-4e72-8f79-4a512640681c-trusted-ca\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.398460 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.398420 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eade24af-17f3-4e72-8f79-4a512640681c-bound-sa-token\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.398460 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.398453 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eade24af-17f3-4e72-8f79-4a512640681c-installation-pull-secrets\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.398722 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.398478 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psvrk\" (UniqueName: \"kubernetes.io/projected/eade24af-17f3-4e72-8f79-4a512640681c-kube-api-access-psvrk\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.398722 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.398503 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eade24af-17f3-4e72-8f79-4a512640681c-ca-trust-extracted\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.398722 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.398528 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eade24af-17f3-4e72-8f79-4a512640681c-registry-tls\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.398722 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.398572 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eade24af-17f3-4e72-8f79-4a512640681c-image-registry-private-configuration\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.398722 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.398635 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eade24af-17f3-4e72-8f79-4a512640681c-registry-certificates\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.399519 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.399489 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eade24af-17f3-4e72-8f79-4a512640681c-registry-certificates\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.401090 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.400512 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eade24af-17f3-4e72-8f79-4a512640681c-trusted-ca\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.401090 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.400774 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eade24af-17f3-4e72-8f79-4a512640681c-ca-trust-extracted\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.404355 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.404291 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eade24af-17f3-4e72-8f79-4a512640681c-image-registry-private-configuration\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.404591 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.404572 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w7fs9\"" Jul 16 18:01:13.405799 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.405759 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eade24af-17f3-4e72-8f79-4a512640681c-installation-pull-secrets\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.407791 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.407769 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eade24af-17f3-4e72-8f79-4a512640681c-registry-tls\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.411506 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.411314 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-48zz7" Jul 16 18:01:13.412904 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.412885 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psvrk\" (UniqueName: \"kubernetes.io/projected/eade24af-17f3-4e72-8f79-4a512640681c-kube-api-access-psvrk\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.413414 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.413373 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eade24af-17f3-4e72-8f79-4a512640681c-bound-sa-token\") pod \"image-registry-86977454cd-zrxxx\" (UID: \"eade24af-17f3-4e72-8f79-4a512640681c\") " pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.438841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.438803 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:13.543328 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.543049 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w7fgm\"" Jul 16 18:01:13.550571 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.550369 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:13.594058 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.594018 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-48zz7"] Jul 16 18:01:13.602670 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:13.602630 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc52a4b_0bce_4ead_bebd_5c441386bdf8.slice/crio-0e99afb9d28d31eecd477a1b4619227edae09a15dba5bd1d160afe376f87ea75 WatchSource:0}: Error finding container 0e99afb9d28d31eecd477a1b4619227edae09a15dba5bd1d160afe376f87ea75: Status 404 returned error can't find the container with id 0e99afb9d28d31eecd477a1b4619227edae09a15dba5bd1d160afe376f87ea75 Jul 16 18:01:13.614367 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.614334 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d"] Jul 16 18:01:13.618908 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:13.618878 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f3bf26_3f2f_438a_958a_47e1e829a74a.slice/crio-fa42528028c230e6c4f1adccce337b527020f35e0552ee85df8f8b45e7ed569e WatchSource:0}: Error finding container fa42528028c230e6c4f1adccce337b527020f35e0552ee85df8f8b45e7ed569e: Status 404 returned error can't find the container with id fa42528028c230e6c4f1adccce337b527020f35e0552ee85df8f8b45e7ed569e Jul 16 18:01:13.780026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.779985 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86977454cd-zrxxx"] Jul 16 18:01:13.890469 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.890410 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" event={"ID":"09f3bf26-3f2f-438a-958a-47e1e829a74a","Type":"ContainerStarted","Data":"fa42528028c230e6c4f1adccce337b527020f35e0552ee85df8f8b45e7ed569e"} Jul 16 18:01:13.892001 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.891974 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:01:13.892297 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.892271 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-48zz7" event={"ID":"ddc52a4b-0bce-4ead-bebd-5c441386bdf8","Type":"ContainerStarted","Data":"0e99afb9d28d31eecd477a1b4619227edae09a15dba5bd1d160afe376f87ea75"} Jul 16 18:01:13.910424 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:13.910339 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:01:14.004685 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.004646 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80a46446-99bc-4b46-acb0-770dfa8f5321-image-registry-private-configuration\") pod \"80a46446-99bc-4b46-acb0-770dfa8f5321\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " Jul 16 18:01:14.004869 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.004708 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80a46446-99bc-4b46-acb0-770dfa8f5321-installation-pull-secrets\") pod \"80a46446-99bc-4b46-acb0-770dfa8f5321\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " Jul 16 18:01:14.004869 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.004747 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-bound-sa-token\") pod \"80a46446-99bc-4b46-acb0-770dfa8f5321\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " Jul 16 18:01:14.004869 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.004816 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls\") pod \"80a46446-99bc-4b46-acb0-770dfa8f5321\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " Jul 16 18:01:14.004869 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.004846 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-certificates\") pod \"80a46446-99bc-4b46-acb0-770dfa8f5321\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " Jul 16 18:01:14.005092 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.004875 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80a46446-99bc-4b46-acb0-770dfa8f5321-ca-trust-extracted\") pod \"80a46446-99bc-4b46-acb0-770dfa8f5321\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " Jul 16 18:01:14.005092 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.004905 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80a46446-99bc-4b46-acb0-770dfa8f5321-trusted-ca\") pod \"80a46446-99bc-4b46-acb0-770dfa8f5321\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " Jul 16 18:01:14.005092 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.004929 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp9jj\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-kube-api-access-vp9jj\") pod \"80a46446-99bc-4b46-acb0-770dfa8f5321\" (UID: \"80a46446-99bc-4b46-acb0-770dfa8f5321\") " Jul 16 18:01:14.005467 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.005398 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "80a46446-99bc-4b46-acb0-770dfa8f5321" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:01:14.005651 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.005574 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80a46446-99bc-4b46-acb0-770dfa8f5321-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "80a46446-99bc-4b46-acb0-770dfa8f5321" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:01:14.007089 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.006003 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80a46446-99bc-4b46-acb0-770dfa8f5321-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "80a46446-99bc-4b46-acb0-770dfa8f5321" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:01:14.008596 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.008255 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "80a46446-99bc-4b46-acb0-770dfa8f5321" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:01:14.008823 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.008783 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80a46446-99bc-4b46-acb0-770dfa8f5321-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "80a46446-99bc-4b46-acb0-770dfa8f5321" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:01:14.014311 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.014243 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "80a46446-99bc-4b46-acb0-770dfa8f5321" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:01:14.014498 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.014391 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80a46446-99bc-4b46-acb0-770dfa8f5321-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "80a46446-99bc-4b46-acb0-770dfa8f5321" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:01:14.014498 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.014466 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-kube-api-access-vp9jj" (OuterVolumeSpecName: "kube-api-access-vp9jj") pod "80a46446-99bc-4b46-acb0-770dfa8f5321" (UID: "80a46446-99bc-4b46-acb0-770dfa8f5321"). InnerVolumeSpecName "kube-api-access-vp9jj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:01:14.105825 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.105775 2548 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80a46446-99bc-4b46-acb0-770dfa8f5321-image-registry-private-configuration\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:01:14.105825 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.105823 2548 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80a46446-99bc-4b46-acb0-770dfa8f5321-installation-pull-secrets\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:01:14.106067 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.105839 2548 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-bound-sa-token\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:01:14.106067 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.105869 2548 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-tls\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:01:14.106067 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.105884 2548 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80a46446-99bc-4b46-acb0-770dfa8f5321-registry-certificates\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:01:14.106067 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.105898 2548 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80a46446-99bc-4b46-acb0-770dfa8f5321-ca-trust-extracted\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:01:14.106067 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.105913 2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80a46446-99bc-4b46-acb0-770dfa8f5321-trusted-ca\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:01:14.106067 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.105927 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp9jj\" (UniqueName: \"kubernetes.io/projected/80a46446-99bc-4b46-acb0-770dfa8f5321-kube-api-access-vp9jj\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:01:14.138041 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:14.138001 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeade24af_17f3_4e72_8f79_4a512640681c.slice/crio-ce037792d10886d7726237b303cfed9160a348bc3f4e77a3c459b6ff5e7bffab WatchSource:0}: Error finding container ce037792d10886d7726237b303cfed9160a348bc3f4e77a3c459b6ff5e7bffab: Status 404 returned error can't find the container with id ce037792d10886d7726237b303cfed9160a348bc3f4e77a3c459b6ff5e7bffab Jul 16 18:01:14.896954 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.896873 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd4f49bb7-228rw" Jul 16 18:01:14.897456 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.897261 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86977454cd-zrxxx" event={"ID":"eade24af-17f3-4e72-8f79-4a512640681c","Type":"ContainerStarted","Data":"ce037792d10886d7726237b303cfed9160a348bc3f4e77a3c459b6ff5e7bffab"} Jul 16 18:01:14.933056 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.932998 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cd4f49bb7-228rw"] Jul 16 18:01:14.938806 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:14.938707 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cd4f49bb7-228rw"] Jul 16 18:01:16.521824 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:16.521779 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80a46446-99bc-4b46-acb0-770dfa8f5321" path="/var/lib/kubelet/pods/80a46446-99bc-4b46-acb0-770dfa8f5321/volumes" Jul 16 18:01:21.118629 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.118591 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms"] Jul 16 18:01:21.120517 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.120498 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms" Jul 16 18:01:21.125479 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.125452 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 18:01:21.125620 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.125551 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5bpnc\"" Jul 16 18:01:21.133340 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.133315 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms"] Jul 16 18:01:21.266363 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.266334 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bde2c5a8-30ab-4c71-91ac-36183e4fd12b-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-shzms\" (UID: \"bde2c5a8-30ab-4c71-91ac-36183e4fd12b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms" Jul 16 18:01:21.367592 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.367552 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bde2c5a8-30ab-4c71-91ac-36183e4fd12b-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-shzms\" (UID: \"bde2c5a8-30ab-4c71-91ac-36183e4fd12b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms" Jul 16 18:01:21.370289 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.370222 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bde2c5a8-30ab-4c71-91ac-36183e4fd12b-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-shzms\" (UID: \"bde2c5a8-30ab-4c71-91ac-36183e4fd12b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms" Jul 16 18:01:21.430219 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.430183 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms" Jul 16 18:01:21.501168 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.501136 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-t8rtf"] Jul 16 18:01:21.503322 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.503301 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-t8rtf" Jul 16 18:01:21.506005 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.505986 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 18:01:21.506149 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.506131 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fbt9d\"" Jul 16 18:01:21.506884 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.506860 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 18:01:21.514949 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.514926 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-t8rtf"] Jul 16 18:01:21.569484 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.569438 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8cdt\" (UniqueName: \"kubernetes.io/projected/afac0037-70a2-46dd-8f85-2f67596daf48-kube-api-access-t8cdt\") pod \"downloads-68c9cbb497-t8rtf\" (UID: \"afac0037-70a2-46dd-8f85-2f67596daf48\") " pod="openshift-console/downloads-68c9cbb497-t8rtf" Jul 16 18:01:21.670010 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.669915 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8cdt\" (UniqueName: \"kubernetes.io/projected/afac0037-70a2-46dd-8f85-2f67596daf48-kube-api-access-t8cdt\") pod \"downloads-68c9cbb497-t8rtf\" (UID: \"afac0037-70a2-46dd-8f85-2f67596daf48\") " pod="openshift-console/downloads-68c9cbb497-t8rtf" Jul 16 18:01:21.686661 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.686627 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8cdt\" (UniqueName: \"kubernetes.io/projected/afac0037-70a2-46dd-8f85-2f67596daf48-kube-api-access-t8cdt\") pod \"downloads-68c9cbb497-t8rtf\" (UID: \"afac0037-70a2-46dd-8f85-2f67596daf48\") " pod="openshift-console/downloads-68c9cbb497-t8rtf" Jul 16 18:01:21.815267 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.814965 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-t8rtf" Jul 16 18:01:21.924298 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.924081 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86977454cd-zrxxx" event={"ID":"eade24af-17f3-4e72-8f79-4a512640681c","Type":"ContainerStarted","Data":"4ddcfa6b39210e49b9adab25e8f1f4ac1445b595370c4ec130241ff09e56527f"} Jul 16 18:01:21.924298 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.924210 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms"] Jul 16 18:01:21.924298 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.924251 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:21.927672 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.927523 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9t8bs" event={"ID":"0203802b-4e91-443d-bfd5-231ffde10de5","Type":"ContainerStarted","Data":"1ddd361bafe72de031ace57b3a649b52f0547dfe2b96cb146ee48bfa4b5d9d35"} Jul 16 18:01:21.930580 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:21.930019 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde2c5a8_30ab_4c71_91ac_36183e4fd12b.slice/crio-194cbbb8328c011963a650addabc1bfaab16bd80b80dfe04a9813406a938fcf3 WatchSource:0}: Error finding container 194cbbb8328c011963a650addabc1bfaab16bd80b80dfe04a9813406a938fcf3: Status 404 returned error can't find the container with id 194cbbb8328c011963a650addabc1bfaab16bd80b80dfe04a9813406a938fcf3 Jul 16 18:01:21.930580 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.930350 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8zgv8" event={"ID":"022d8ead-bbfa-4500-96c9-ec2216a12abf","Type":"ContainerStarted","Data":"aee356402dc6e2a42e223db961fa1a38cb93261871cfbbfa8eec64ce3f2a5dbd"} Jul 16 18:01:21.930580 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.930400 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:01:21.985005 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:21.981336 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86977454cd-zrxxx" podStartSLOduration=8.98131162 podStartE2EDuration="8.98131162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:21.948189993 +0000 UTC m=+75.965993913" watchObservedRunningTime="2026-07-16 18:01:21.98131162 +0000 UTC m=+75.999115537" Jul 16 18:01:22.038736 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.038622 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8zgv8" podStartSLOduration=66.982185668 podStartE2EDuration="1m16.038604649s" totalImagesPullingTime="9.056418981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:21.984459382 +0000 UTC m=+76.002263304" watchObservedRunningTime="2026-07-16 18:01:22.038604649 +0000 UTC m=+76.056408565" Jul 16 18:01:22.039420 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.039396 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-t8rtf"] Jul 16 18:01:22.937207 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.937168 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fslwp" event={"ID":"66d0fe0e-abd1-43c4-b06a-6803c1626df8","Type":"ContainerStarted","Data":"6d2b735cc280c39226d1849833087f68262f3169f28c5cefe5fdeefc75f95ee1"} Jul 16 18:01:22.939661 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.939630 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" event={"ID":"09f3bf26-3f2f-438a-958a-47e1e829a74a","Type":"ContainerStarted","Data":"2359e65b9a725686537020898cb6eaee987986636ed30f792c13b72939850b86"} Jul 16 18:01:22.939802 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.939780 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:22.942157 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.942091 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" Jul 16 18:01:22.942399 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.942305 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8r665" event={"ID":"89d21151-3342-4fc2-ab77-68629dc8896e","Type":"ContainerStarted","Data":"7cbc52885bf9348c719eddcc746c54ee21ddc3b07eecb75f5b56beb42f6808d3"} Jul 16 18:01:22.942399 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.942364 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8r665" event={"ID":"89d21151-3342-4fc2-ab77-68629dc8896e","Type":"ContainerStarted","Data":"830dcc99c2e764b3401e9835e1b8685714e9b4aa34b3a4db71ac0296741c6c11"} Jul 16 18:01:22.944516 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.944458 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-48zz7" event={"ID":"ddc52a4b-0bce-4ead-bebd-5c441386bdf8","Type":"ContainerStarted","Data":"023d13c5635efef7c1e17c372019f0960b544262cc5568134158a0429a5dd7a3"} Jul 16 18:01:22.944516 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.944507 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-48zz7" event={"ID":"ddc52a4b-0bce-4ead-bebd-5c441386bdf8","Type":"ContainerStarted","Data":"9090fb8e19d8bd7ac9b050ff2c69b64123d3ee8838281092720c156dfe4a2af1"} Jul 16 18:01:22.944785 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.944732 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-48zz7" Jul 16 18:01:22.946152 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.946128 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-t8rtf" event={"ID":"afac0037-70a2-46dd-8f85-2f67596daf48","Type":"ContainerStarted","Data":"53c716ac49e1c51de0981da8b159446dd80771de3bb6ab8ee504821f110655c9"} Jul 16 18:01:22.947548 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.947517 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms" event={"ID":"bde2c5a8-30ab-4c71-91ac-36183e4fd12b","Type":"ContainerStarted","Data":"194cbbb8328c011963a650addabc1bfaab16bd80b80dfe04a9813406a938fcf3"} Jul 16 18:01:22.962678 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.962605 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fslwp" podStartSLOduration=68.316754011 podStartE2EDuration="1m16.962583334s" totalImagesPullingTime="8.645829323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:22.961839458 +0000 UTC m=+76.979643376" watchObservedRunningTime="2026-07-16 18:01:22.962583334 +0000 UTC m=+76.980387251" Jul 16 18:01:22.981416 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.981364 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8r665" podStartSLOduration=69.473383651 podStartE2EDuration="1m16.981346353s" totalImagesPullingTime="7.507962702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:22.980727033 +0000 UTC m=+76.998530954" watchObservedRunningTime="2026-07-16 18:01:22.981346353 +0000 UTC m=+76.999150272" Jul 16 18:01:22.999885 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:22.999831 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c7c976bb-m5h7d" podStartSLOduration=1.848699141 podStartE2EDuration="9.999813266s" totalImagesPullingTime="8.151114125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:22.998839615 +0000 UTC m=+77.016643535" watchObservedRunningTime="2026-07-16 18:01:22.999813266 +0000 UTC m=+77.017617162" Jul 16 18:01:23.027175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:23.025723 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-48zz7" podStartSLOduration=33.872286591 podStartE2EDuration="42.025701171s" totalImagesPullingTime="8.15341458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:23.024164345 +0000 UTC m=+77.041968265" watchObservedRunningTime="2026-07-16 18:01:23.025701171 +0000 UTC m=+77.043505090" Jul 16 18:01:23.955043 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:23.954699 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms" event={"ID":"bde2c5a8-30ab-4c71-91ac-36183e4fd12b","Type":"ContainerStarted","Data":"ae849981a12de19f5881de0e526bdb299da21cbdd23fd2d26515c0a456ca1e8b"} Jul 16 18:01:23.955545 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:23.955126 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms" Jul 16 18:01:23.960609 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:23.960505 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms" Jul 16 18:01:23.973119 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:23.973062 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-shzms" podStartSLOduration=1.097059481 podStartE2EDuration="2.973043528s" totalImagesPullingTime="1.875984047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:23.971415522 +0000 UTC m=+77.989219443" watchObservedRunningTime="2026-07-16 18:01:23.973043528 +0000 UTC m=+77.990847446" Jul 16 18:01:24.205909 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.205826 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-dbd8c"] Jul 16 18:01:24.209050 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.209020 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.211586 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.211552 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 16 18:01:24.211713 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.211584 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 16 18:01:24.212502 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.212480 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fm6b4\"" Jul 16 18:01:24.212615 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.212525 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 18:01:24.212615 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.212606 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 18:01:24.212754 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.212727 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 18:01:24.220091 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.220033 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-dbd8c"] Jul 16 18:01:24.292891 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.292849 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/09541b00-0bbb-4653-9e9e-34197feb2ce8-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.293080 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.292927 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09541b00-0bbb-4653-9e9e-34197feb2ce8-metrics-client-ca\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.293080 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.292973 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09541b00-0bbb-4653-9e9e-34197feb2ce8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.293208 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.293074 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzc87\" (UniqueName: \"kubernetes.io/projected/09541b00-0bbb-4653-9e9e-34197feb2ce8-kube-api-access-tzc87\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.394481 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.394446 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09541b00-0bbb-4653-9e9e-34197feb2ce8-metrics-client-ca\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.394646 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.394513 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09541b00-0bbb-4653-9e9e-34197feb2ce8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.394646 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.394552 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzc87\" (UniqueName: \"kubernetes.io/projected/09541b00-0bbb-4653-9e9e-34197feb2ce8-kube-api-access-tzc87\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.394802 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.394777 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/09541b00-0bbb-4653-9e9e-34197feb2ce8-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.394940 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:01:24.394918 2548 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 16 18:01:24.395010 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:01:24.394997 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09541b00-0bbb-4653-9e9e-34197feb2ce8-prometheus-operator-tls podName:09541b00-0bbb-4653-9e9e-34197feb2ce8 nodeName:}" failed. No retries permitted until 2026-07-16 18:01:24.894978648 +0000 UTC m=+78.912782561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/09541b00-0bbb-4653-9e9e-34197feb2ce8-prometheus-operator-tls") pod "prometheus-operator-64785b6675-dbd8c" (UID: "09541b00-0bbb-4653-9e9e-34197feb2ce8") : secret "prometheus-operator-tls" not found Jul 16 18:01:24.395338 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.395290 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09541b00-0bbb-4653-9e9e-34197feb2ce8-metrics-client-ca\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.398318 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.398273 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09541b00-0bbb-4653-9e9e-34197feb2ce8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.405824 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.405626 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzc87\" (UniqueName: \"kubernetes.io/projected/09541b00-0bbb-4653-9e9e-34197feb2ce8-kube-api-access-tzc87\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.900050 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.900012 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/09541b00-0bbb-4653-9e9e-34197feb2ce8-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:24.903221 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:24.903190 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/09541b00-0bbb-4653-9e9e-34197feb2ce8-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dbd8c\" (UID: \"09541b00-0bbb-4653-9e9e-34197feb2ce8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:25.119036 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:25.118993 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" Jul 16 18:01:25.814991 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:25.814961 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-dbd8c"] Jul 16 18:01:25.817618 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:25.817582 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09541b00_0bbb_4653_9e9e_34197feb2ce8.slice/crio-492cf511a767a037e9a461e3185ec22f0953fc95484ed96d746345c2eda03a98 WatchSource:0}: Error finding container 492cf511a767a037e9a461e3185ec22f0953fc95484ed96d746345c2eda03a98: Status 404 returned error can't find the container with id 492cf511a767a037e9a461e3185ec22f0953fc95484ed96d746345c2eda03a98 Jul 16 18:01:25.964318 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:25.964214 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9t8bs" event={"ID":"0203802b-4e91-443d-bfd5-231ffde10de5","Type":"ContainerStarted","Data":"8bb6145db13807b1056b1d1ad35267e16ef58a75d31700322e3cbbd02aa174e2"} Jul 16 18:01:25.965346 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:25.965324 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" event={"ID":"09541b00-0bbb-4653-9e9e-34197feb2ce8","Type":"ContainerStarted","Data":"492cf511a767a037e9a461e3185ec22f0953fc95484ed96d746345c2eda03a98"} Jul 16 18:01:25.982978 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:25.982900 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9t8bs" podStartSLOduration=17.181034823 podStartE2EDuration="35.982848094s" totalImagesPullingTime="18.801813271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:00:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:25.981257444 +0000 UTC m=+79.999061364" watchObservedRunningTime="2026-07-16 18:01:25.982848094 +0000 UTC m=+80.000652006" Jul 16 18:01:26.656660 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.656624 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7648c55f86-cdpfx"] Jul 16 18:01:26.660305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.660267 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.662988 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.662963 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 18:01:26.663137 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.663021 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 18:01:26.663137 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.663024 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 18:01:26.663961 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.663943 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7qm5k\"" Jul 16 18:01:26.664161 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.664013 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 18:01:26.664161 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.663944 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 18:01:26.669344 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.669282 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7648c55f86-cdpfx"] Jul 16 18:01:26.815307 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.815254 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ed1b99-089b-4113-b7d4-72495451807a-console-oauth-config\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.815501 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.815311 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-console-config\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.815501 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.815344 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz4k9\" (UniqueName: \"kubernetes.io/projected/b0ed1b99-089b-4113-b7d4-72495451807a-kube-api-access-bz4k9\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.815501 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.815389 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ed1b99-089b-4113-b7d4-72495451807a-console-serving-cert\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.815501 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.815415 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-service-ca\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.815501 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.815469 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-oauth-serving-cert\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.916810 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.916724 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-oauth-serving-cert\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.916810 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.916782 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ed1b99-089b-4113-b7d4-72495451807a-console-oauth-config\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.917039 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.916823 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-console-config\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.917039 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.916847 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz4k9\" (UniqueName: \"kubernetes.io/projected/b0ed1b99-089b-4113-b7d4-72495451807a-kube-api-access-bz4k9\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.917039 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.916892 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ed1b99-089b-4113-b7d4-72495451807a-console-serving-cert\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.917039 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.916919 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-service-ca\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.917617 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.917563 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-oauth-serving-cert\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.917735 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.917666 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-service-ca\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.917906 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.917887 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-console-config\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.920739 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.920689 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ed1b99-089b-4113-b7d4-72495451807a-console-serving-cert\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.920886 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.920844 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ed1b99-089b-4113-b7d4-72495451807a-console-oauth-config\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.926845 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.926821 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz4k9\" (UniqueName: \"kubernetes.io/projected/b0ed1b99-089b-4113-b7d4-72495451807a-kube-api-access-bz4k9\") pod \"console-7648c55f86-cdpfx\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:26.974509 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:26.974473 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:27.116993 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:27.116968 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7648c55f86-cdpfx"] Jul 16 18:01:27.422237 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:27.422190 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ed1b99_089b_4113_b7d4_72495451807a.slice/crio-81142eef6b6e243b6e792c55bada4ee00eff3efaed513ac8bdad9b6be2d29ed5 WatchSource:0}: Error finding container 81142eef6b6e243b6e792c55bada4ee00eff3efaed513ac8bdad9b6be2d29ed5: Status 404 returned error can't find the container with id 81142eef6b6e243b6e792c55bada4ee00eff3efaed513ac8bdad9b6be2d29ed5 Jul 16 18:01:27.975866 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:27.975829 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" event={"ID":"09541b00-0bbb-4653-9e9e-34197feb2ce8","Type":"ContainerStarted","Data":"14a8b93478a90a164f38296981d40f65f40e086b75e0534d41af074c7a0c18b3"} Jul 16 18:01:27.976336 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:27.975897 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" event={"ID":"09541b00-0bbb-4653-9e9e-34197feb2ce8","Type":"ContainerStarted","Data":"f14a273abbc7d14562664ed6ce6db6efa19ef61af56cb54412c6beabda65924a"} Jul 16 18:01:27.977241 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:27.977209 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7648c55f86-cdpfx" event={"ID":"b0ed1b99-089b-4113-b7d4-72495451807a","Type":"ContainerStarted","Data":"81142eef6b6e243b6e792c55bada4ee00eff3efaed513ac8bdad9b6be2d29ed5"} Jul 16 18:01:27.999298 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:27.999244 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-dbd8c" podStartSLOduration=2.369922691 podStartE2EDuration="3.999225912s" totalImagesPullingTime="1.629303221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:27.997300764 +0000 UTC m=+82.015104686" watchObservedRunningTime="2026-07-16 18:01:27.999225912 +0000 UTC m=+82.017029859" Jul 16 18:01:29.552029 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.551888 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b"] Jul 16 18:01:29.554819 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.554790 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:29.557577 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.557549 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 16 18:01:29.557577 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.557573 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ctt75\"" Jul 16 18:01:29.557769 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.557573 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 16 18:01:29.570764 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.570736 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b"] Jul 16 18:01:29.580396 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.580365 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-dxf4r"] Jul 16 18:01:29.582980 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.582961 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.586843 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.586816 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 16 18:01:29.587064 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.587042 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 16 18:01:29.587528 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.587510 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 16 18:01:29.587827 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.587812 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wlq5x\"" Jul 16 18:01:29.597468 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.597441 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lltsv"] Jul 16 18:01:29.603138 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.600682 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.603138 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.600866 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-dxf4r"] Jul 16 18:01:29.606014 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.605440 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 18:01:29.606014 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.605681 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 18:01:29.606014 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.605870 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6t67q\"" Jul 16 18:01:29.607496 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.607264 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 18:01:29.639729 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.639693 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f98baa66-7bb6-4a97-a77d-c23c0b905228-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:29.639923 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.639741 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f98baa66-7bb6-4a97-a77d-c23c0b905228-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:29.639923 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.639785 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vgdp\" (UniqueName: \"kubernetes.io/projected/f98baa66-7bb6-4a97-a77d-c23c0b905228-kube-api-access-6vgdp\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:29.639923 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.639828 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f98baa66-7bb6-4a97-a77d-c23c0b905228-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:29.740716 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.740681 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vgdp\" (UniqueName: \"kubernetes.io/projected/f98baa66-7bb6-4a97-a77d-c23c0b905228-kube-api-access-6vgdp\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:29.740889 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.740723 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb7cdbb2-819d-464b-8de2-2cb7417a990c-sys\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.740889 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.740749 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-accelerators-collector-config\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.740889 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.740830 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-tls\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.741059 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.740897 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f98baa66-7bb6-4a97-a77d-c23c0b905228-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:29.741059 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.740927 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.741059 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.740949 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.741059 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.740993 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb7cdbb2-819d-464b-8de2-2cb7417a990c-root\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.741269 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.741124 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-textfile\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.741269 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.741173 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.741269 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.741199 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.741269 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.741228 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.741456 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.741269 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f98baa66-7bb6-4a97-a77d-c23c0b905228-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:29.741456 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.741298 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f98baa66-7bb6-4a97-a77d-c23c0b905228-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:29.741456 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.741321 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpj86\" (UniqueName: \"kubernetes.io/projected/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-kube-api-access-hpj86\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.741456 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.741344 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.741456 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.741374 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24ljd\" (UniqueName: \"kubernetes.io/projected/cb7cdbb2-819d-464b-8de2-2cb7417a990c-kube-api-access-24ljd\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.741456 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.741449 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-wtmp\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.741729 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:01:29.741510 2548 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 16 18:01:29.741729 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:01:29.741574 2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f98baa66-7bb6-4a97-a77d-c23c0b905228-openshift-state-metrics-tls podName:f98baa66-7bb6-4a97-a77d-c23c0b905228 nodeName:}" failed. No retries permitted until 2026-07-16 18:01:30.241553954 +0000 UTC m=+84.259357858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f98baa66-7bb6-4a97-a77d-c23c0b905228-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-7pv6b" (UID: "f98baa66-7bb6-4a97-a77d-c23c0b905228") : secret "openshift-state-metrics-tls" not found Jul 16 18:01:29.741729 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.741625 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb7cdbb2-819d-464b-8de2-2cb7417a990c-metrics-client-ca\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.742147 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.742127 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f98baa66-7bb6-4a97-a77d-c23c0b905228-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:29.743694 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.743670 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f98baa66-7bb6-4a97-a77d-c23c0b905228-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:29.753977 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.753953 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vgdp\" (UniqueName: \"kubernetes.io/projected/f98baa66-7bb6-4a97-a77d-c23c0b905228-kube-api-access-6vgdp\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842297 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpj86\" (UniqueName: \"kubernetes.io/projected/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-kube-api-access-hpj86\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842352 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842380 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24ljd\" (UniqueName: \"kubernetes.io/projected/cb7cdbb2-819d-464b-8de2-2cb7417a990c-kube-api-access-24ljd\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842411 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-wtmp\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842437 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb7cdbb2-819d-464b-8de2-2cb7417a990c-metrics-client-ca\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842464 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb7cdbb2-819d-464b-8de2-2cb7417a990c-sys\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842496 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-accelerators-collector-config\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842527 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-tls\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842556 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842588 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842631 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb7cdbb2-819d-464b-8de2-2cb7417a990c-root\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842658 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-textfile\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.844175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842694 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.844905 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842726 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.844905 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.842753 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.844905 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.843466 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb7cdbb2-819d-464b-8de2-2cb7417a990c-root\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.844905 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.843589 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.844905 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.843726 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-accelerators-collector-config\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.844905 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.843815 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-textfile\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.844905 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.844511 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.844905 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.844662 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-wtmp\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.845348 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.845308 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb7cdbb2-819d-464b-8de2-2cb7417a990c-sys\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.845653 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.845583 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb7cdbb2-819d-464b-8de2-2cb7417a990c-metrics-client-ca\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.845653 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.845618 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.847124 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.847085 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.848254 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.848044 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-tls\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.848254 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.848214 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb7cdbb2-819d-464b-8de2-2cb7417a990c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.849049 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.849006 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.861722 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.861669 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24ljd\" (UniqueName: \"kubernetes.io/projected/cb7cdbb2-819d-464b-8de2-2cb7417a990c-kube-api-access-24ljd\") pod \"node-exporter-lltsv\" (UID: \"cb7cdbb2-819d-464b-8de2-2cb7417a990c\") " pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:29.861867 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.861839 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpj86\" (UniqueName: \"kubernetes.io/projected/8da23b9b-1fa4-4e0c-a3a6-07323caf75b8-kube-api-access-hpj86\") pod \"kube-state-metrics-785778ff74-dxf4r\" (UID: \"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.894894 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.894857 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" Jul 16 18:01:29.916887 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:29.916843 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lltsv" Jul 16 18:01:30.246468 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:30.246375 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f98baa66-7bb6-4a97-a77d-c23c0b905228-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:30.249465 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:30.249436 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f98baa66-7bb6-4a97-a77d-c23c0b905228-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7pv6b\" (UID: \"f98baa66-7bb6-4a97-a77d-c23c0b905228\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:30.464661 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:30.464630 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" Jul 16 18:01:30.989566 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:30.989521 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7cdbb2_819d_464b_8de2_2cb7417a990c.slice/crio-e9569356b053aa956bd5b792dbb08243a7c1b6695468515563571334ce347a8f WatchSource:0}: Error finding container e9569356b053aa956bd5b792dbb08243a7c1b6695468515563571334ce347a8f: Status 404 returned error can't find the container with id e9569356b053aa956bd5b792dbb08243a7c1b6695468515563571334ce347a8f Jul 16 18:01:31.124690 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:31.124548 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-dxf4r"] Jul 16 18:01:31.127262 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:31.127236 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da23b9b_1fa4_4e0c_a3a6_07323caf75b8.slice/crio-a2952893cfe955f8e2c596c00b9d84815fe5fd1b6de62ac6f4615a54d3afe068 WatchSource:0}: Error finding container a2952893cfe955f8e2c596c00b9d84815fe5fd1b6de62ac6f4615a54d3afe068: Status 404 returned error can't find the container with id a2952893cfe955f8e2c596c00b9d84815fe5fd1b6de62ac6f4615a54d3afe068 Jul 16 18:01:31.141535 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:31.141506 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b"] Jul 16 18:01:31.144887 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:01:31.144854 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf98baa66_7bb6_4a97_a77d_c23c0b905228.slice/crio-8eb722cea6d75dd250df6315f64e399b876575105a13457348a81b0d5756d9b9 WatchSource:0}: Error finding container 8eb722cea6d75dd250df6315f64e399b876575105a13457348a81b0d5756d9b9: Status 404 returned error can't find the container with id 8eb722cea6d75dd250df6315f64e399b876575105a13457348a81b0d5756d9b9 Jul 16 18:01:31.996319 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:31.996235 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7648c55f86-cdpfx" event={"ID":"b0ed1b99-089b-4113-b7d4-72495451807a","Type":"ContainerStarted","Data":"e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf"} Jul 16 18:01:31.998028 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:31.997997 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lltsv" event={"ID":"cb7cdbb2-819d-464b-8de2-2cb7417a990c","Type":"ContainerStarted","Data":"e9569356b053aa956bd5b792dbb08243a7c1b6695468515563571334ce347a8f"} Jul 16 18:01:31.999326 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:31.999301 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" event={"ID":"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8","Type":"ContainerStarted","Data":"a2952893cfe955f8e2c596c00b9d84815fe5fd1b6de62ac6f4615a54d3afe068"} Jul 16 18:01:32.001339 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:32.001318 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" event={"ID":"f98baa66-7bb6-4a97-a77d-c23c0b905228","Type":"ContainerStarted","Data":"2abcece9209bdd8541b6f67d7aeed6da83bfe64a7f33893c80801ff8a9f0326c"} Jul 16 18:01:32.001426 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:32.001363 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" event={"ID":"f98baa66-7bb6-4a97-a77d-c23c0b905228","Type":"ContainerStarted","Data":"dfb71aa157c70ea4b237f981d2ca5a8ae28b4956f43f227e68e7ffffae8ba003"} Jul 16 18:01:32.001426 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:32.001393 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" event={"ID":"f98baa66-7bb6-4a97-a77d-c23c0b905228","Type":"ContainerStarted","Data":"8eb722cea6d75dd250df6315f64e399b876575105a13457348a81b0d5756d9b9"} Jul 16 18:01:32.016970 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:32.016171 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7648c55f86-cdpfx" podStartSLOduration=2.445157462 podStartE2EDuration="6.016150394s" totalImagesPullingTime="3.570992932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:32.014604098 +0000 UTC m=+86.032408018" watchObservedRunningTime="2026-07-16 18:01:32.016150394 +0000 UTC m=+86.033954314" Jul 16 18:01:32.957477 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:32.957391 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-48zz7" Jul 16 18:01:33.014479 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:33.014179 2548 generic.go:356] "Generic (PLEG): container finished" podID="cb7cdbb2-819d-464b-8de2-2cb7417a990c" containerID="220fdc567d4a821ff5b83b1ecc2d015ac3bcbdd6fe9a0ba7af574ba4ed8b9fbc" exitCode=0 Jul 16 18:01:33.015113 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:33.015021 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lltsv" event={"ID":"cb7cdbb2-819d-464b-8de2-2cb7417a990c","Type":"ContainerDied","Data":"220fdc567d4a821ff5b83b1ecc2d015ac3bcbdd6fe9a0ba7af574ba4ed8b9fbc"} Jul 16 18:01:33.018464 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:33.018432 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" event={"ID":"f98baa66-7bb6-4a97-a77d-c23c0b905228","Type":"ContainerStarted","Data":"42726be4c2926c9cfb20a9df828a20124de41f90354535d0020f59170d7cfa8e"} Jul 16 18:01:33.055278 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:33.054962 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7pv6b" podStartSLOduration=2.652172389 podStartE2EDuration="4.05494152s" totalImagesPullingTime="1.402769131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:33.053034316 +0000 UTC m=+87.070838238" watchObservedRunningTime="2026-07-16 18:01:33.05494152 +0000 UTC m=+87.072745441" Jul 16 18:01:34.025763 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:34.025708 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lltsv" event={"ID":"cb7cdbb2-819d-464b-8de2-2cb7417a990c","Type":"ContainerStarted","Data":"f8a9f849b12d22ea7a06c2aa98da9793aab00fe5738468fbff74f3202e1c6cec"} Jul 16 18:01:34.026265 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:34.025789 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lltsv" event={"ID":"cb7cdbb2-819d-464b-8de2-2cb7417a990c","Type":"ContainerStarted","Data":"6c43e22258ec194d59395a7022aba6dfb8fc09cd62c14eba53e826cb63fe6cc9"} Jul 16 18:01:34.028427 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:34.028394 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" event={"ID":"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8","Type":"ContainerStarted","Data":"16f48a031e3da14c568b42f48bbd118890517a7f6a42226d6cefb7c556ad070e"} Jul 16 18:01:34.028572 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:34.028474 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" event={"ID":"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8","Type":"ContainerStarted","Data":"27d90fcce8a2938824fc15bf867e30a18381b09aaaf3bb287b9bba0f5f3aa347"} Jul 16 18:01:34.028572 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:34.028533 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" event={"ID":"8da23b9b-1fa4-4e0c-a3a6-07323caf75b8","Type":"ContainerStarted","Data":"b0aee6968832824f75b9fd8d7a35547c090c276583e929552b954f17c4bcaef7"} Jul 16 18:01:34.049575 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:34.049514 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lltsv" podStartSLOduration=3.277453408 podStartE2EDuration="5.049493004s" totalImagesPullingTime="1.697033951s" totalInitContainerRuntime="75.005645ms" isStatefulPod=true podCreationTimestamp="2026-07-16 18:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:34.047405017 +0000 UTC m=+88.065208937" watchObservedRunningTime="2026-07-16 18:01:34.049493004 +0000 UTC m=+88.067296903" Jul 16 18:01:34.069684 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:34.069630 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-dxf4r" podStartSLOduration=2.88574107 podStartE2EDuration="5.069611512s" totalImagesPullingTime="2.183870442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:34.067288989 +0000 UTC m=+88.085092908" watchObservedRunningTime="2026-07-16 18:01:34.069611512 +0000 UTC m=+88.087415430" Jul 16 18:01:35.973373 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.973299 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 18:01:35.980671 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.980438 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:35.984265 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.984069 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 18:01:35.984265 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.984227 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 18:01:35.984265 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.984231 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 18:01:35.984526 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.984244 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7gt97\"" Jul 16 18:01:35.984588 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.984572 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 18:01:35.986240 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.986176 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 18:01:35.986373 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.986289 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 18:01:35.986373 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.986357 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 18:01:35.987385 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.987226 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 18:01:35.987385 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.987244 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 18:01:35.987385 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.987261 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 18:01:35.987385 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.987279 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 18:01:35.987385 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.987230 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 18:01:35.987998 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.987908 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-427rclhsn6msp\"" Jul 16 18:01:35.988277 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.988258 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 18:01:35.991794 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.991767 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 18:01:35.994705 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:35.994681 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 18:01:36.004394 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.004360 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 18:01:36.098512 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098480 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-config\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.098695 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098516 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.098695 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098555 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.098695 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098582 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.098695 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098647 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.098695 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098680 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.098924 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098714 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.098924 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098774 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.098924 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098837 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.098924 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098878 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.098924 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098897 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-web-config\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.098924 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098918 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.099154 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098946 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.099154 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098962 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.099154 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.098982 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11c53e85-d99a-4de5-a20f-441420cfca65-config-out\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.099154 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.099009 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.099154 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.099037 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwtgh\" (UniqueName: \"kubernetes.io/projected/11c53e85-d99a-4de5-a20f-441420cfca65-kube-api-access-vwtgh\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.099154 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.099055 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.099154 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.099094 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.099154 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.099135 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11c53e85-d99a-4de5-a20f-441420cfca65-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.199923 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.199850 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.199923 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.199918 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200201 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.199941 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-web-config\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200201 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.199962 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200201 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.199992 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200201 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200014 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200201 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200045 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11c53e85-d99a-4de5-a20f-441420cfca65-config-out\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200201 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200067 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200201 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200123 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwtgh\" (UniqueName: \"kubernetes.io/projected/11c53e85-d99a-4de5-a20f-441420cfca65-kube-api-access-vwtgh\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200201 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200150 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200201 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200180 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200629 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200211 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11c53e85-d99a-4de5-a20f-441420cfca65-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200629 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200260 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-config\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200629 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200285 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200629 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200320 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200629 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200347 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200629 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200376 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200629 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200418 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200629 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200443 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.200629 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.200480 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.201248 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.201226 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.202028 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.201772 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.203884 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.202740 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.203884 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.203455 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.203884 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.203785 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.204526 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.204197 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.204748 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.204724 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.205019 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.204995 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.205373 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.205351 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11c53e85-d99a-4de5-a20f-441420cfca65-config-out\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.205806 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.205784 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.205894 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.205871 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.206406 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.206348 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.207256 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.207204 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-config\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.207920 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.207873 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11c53e85-d99a-4de5-a20f-441420cfca65-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.209164 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.208962 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.209439 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.209399 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.209626 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.209601 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.209697 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.209666 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-web-config\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.210222 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.210198 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.213902 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.213870 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwtgh\" (UniqueName: \"kubernetes.io/projected/11c53e85-d99a-4de5-a20f-441420cfca65-kube-api-access-vwtgh\") pod \"prometheus-k8s-0\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.294965 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.294926 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:01:36.474186 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.473775 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 18:01:36.975113 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.975054 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:36.975590 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.975144 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:36.980699 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:36.980672 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:37.044033 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:37.043980 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerStarted","Data":"ffec331efd291874b40a61033588221b712a0853519bf683f3cde9e31b185140"} Jul 16 18:01:37.048526 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:37.048498 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:01:42.952618 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:42.952588 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86977454cd-zrxxx" Jul 16 18:01:45.090191 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:45.090140 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-t8rtf" event={"ID":"afac0037-70a2-46dd-8f85-2f67596daf48","Type":"ContainerStarted","Data":"c012772518f455ccc441fb62e30a26f1e4344269dca127ebfc30f40e1053f8eb"} Jul 16 18:01:45.090675 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:45.090251 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-t8rtf" Jul 16 18:01:45.104348 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:45.104315 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-t8rtf" Jul 16 18:01:45.107137 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:45.107055 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-t8rtf" podStartSLOduration=1.771383801 podStartE2EDuration="24.107031809s" totalImagesPullingTime="22.335648008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:45.106119027 +0000 UTC m=+99.123922938" watchObservedRunningTime="2026-07-16 18:01:45.107031809 +0000 UTC m=+99.124835730" Jul 16 18:01:46.097251 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:46.097211 2548 generic.go:356] "Generic (PLEG): container finished" podID="11c53e85-d99a-4de5-a20f-441420cfca65" containerID="e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e" exitCode=0 Jul 16 18:01:46.097747 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:46.097301 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerDied","Data":"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e"} Jul 16 18:01:46.825877 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:46.825835 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7648c55f86-cdpfx"] Jul 16 18:01:51.123597 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:51.123491 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerStarted","Data":"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9"} Jul 16 18:01:52.133046 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:52.132982 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerStarted","Data":"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06"} Jul 16 18:01:52.950745 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:52.950713 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8zgv8" Jul 16 18:01:54.148885 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:54.148854 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerStarted","Data":"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad"} Jul 16 18:01:55.156925 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:55.156892 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerStarted","Data":"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2"} Jul 16 18:01:55.157398 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:55.156958 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerStarted","Data":"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587"} Jul 16 18:01:55.157398 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:55.156986 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerStarted","Data":"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec"} Jul 16 18:01:55.204723 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:55.203903 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.506680629 podStartE2EDuration="20.203877007s" totalImagesPullingTime="16.675449761s" totalInitContainerRuntime="21.746617ms" isStatefulPod=false podCreationTimestamp="2026-07-16 18:01:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:55.202467908 +0000 UTC m=+109.220271840" watchObservedRunningTime="2026-07-16 18:01:55.203877007 +0000 UTC m=+109.221680927" Jul 16 18:01:56.295431 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:01:56.295397 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:11.850907 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:11.850845 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7648c55f86-cdpfx" podUID="b0ed1b99-089b-4113-b7d4-72495451807a" containerName="console" containerID="cri-o://e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf" gracePeriod=15 Jul 16 18:02:12.134094 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.134017 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:02:12.220314 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.220270 2548 generic.go:356] "Generic (PLEG): container finished" podID="b0ed1b99-089b-4113-b7d4-72495451807a" containerID="e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf" exitCode=0 Jul 16 18:02:12.220473 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.220328 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7648c55f86-cdpfx" Jul 16 18:02:12.220473 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.220359 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7648c55f86-cdpfx" event={"ID":"b0ed1b99-089b-4113-b7d4-72495451807a","Type":"ContainerDied","Data":"e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf"} Jul 16 18:02:12.220473 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.220435 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7648c55f86-cdpfx" event={"ID":"b0ed1b99-089b-4113-b7d4-72495451807a","Type":"ContainerDied","Data":"81142eef6b6e243b6e792c55bada4ee00eff3efaed513ac8bdad9b6be2d29ed5"} Jul 16 18:02:12.220473 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.220455 2548 scope.go:117] "RemoveContainer" containerID="e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf" Jul 16 18:02:12.228398 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.228379 2548 scope.go:117] "RemoveContainer" containerID="e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf" Jul 16 18:02:12.228534 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.228518 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-oauth-serving-cert\") pod \"b0ed1b99-089b-4113-b7d4-72495451807a\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " Jul 16 18:02:12.228582 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.228574 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ed1b99-089b-4113-b7d4-72495451807a-console-serving-cert\") pod \"b0ed1b99-089b-4113-b7d4-72495451807a\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " Jul 16 18:02:12.228621 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.228606 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ed1b99-089b-4113-b7d4-72495451807a-console-oauth-config\") pod \"b0ed1b99-089b-4113-b7d4-72495451807a\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " Jul 16 18:02:12.228682 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.228668 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-console-config\") pod \"b0ed1b99-089b-4113-b7d4-72495451807a\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " Jul 16 18:02:12.228738 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:02:12.228705 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf\": container with ID starting with e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf not found: ID does not exist" containerID="e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf" Jul 16 18:02:12.228790 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.228741 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf"} err="failed to get container status \"e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf\": rpc error: code = NotFound desc = could not find container \"e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf\": container with ID starting with e87cc59f8c0903888198d18e82aeca4d168f2427a0bfe4671ecd0c0e1b24e9cf not found: ID does not exist" Jul 16 18:02:12.228790 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.228778 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-service-ca\") pod \"b0ed1b99-089b-4113-b7d4-72495451807a\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " Jul 16 18:02:12.228895 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.228823 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz4k9\" (UniqueName: \"kubernetes.io/projected/b0ed1b99-089b-4113-b7d4-72495451807a-kube-api-access-bz4k9\") pod \"b0ed1b99-089b-4113-b7d4-72495451807a\" (UID: \"b0ed1b99-089b-4113-b7d4-72495451807a\") " Jul 16 18:02:12.228895 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.228849 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0ed1b99-089b-4113-b7d4-72495451807a" (UID: "b0ed1b99-089b-4113-b7d4-72495451807a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:02:12.229075 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.229055 2548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-oauth-serving-cert\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:12.229207 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.229086 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-console-config" (OuterVolumeSpecName: "console-config") pod "b0ed1b99-089b-4113-b7d4-72495451807a" (UID: "b0ed1b99-089b-4113-b7d4-72495451807a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:02:12.229207 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.229190 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0ed1b99-089b-4113-b7d4-72495451807a" (UID: "b0ed1b99-089b-4113-b7d4-72495451807a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:02:12.231042 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.231013 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ed1b99-089b-4113-b7d4-72495451807a-kube-api-access-bz4k9" (OuterVolumeSpecName: "kube-api-access-bz4k9") pod "b0ed1b99-089b-4113-b7d4-72495451807a" (UID: "b0ed1b99-089b-4113-b7d4-72495451807a"). InnerVolumeSpecName "kube-api-access-bz4k9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:02:12.231174 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.231122 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ed1b99-089b-4113-b7d4-72495451807a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0ed1b99-089b-4113-b7d4-72495451807a" (UID: "b0ed1b99-089b-4113-b7d4-72495451807a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:02:12.231174 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.231140 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ed1b99-089b-4113-b7d4-72495451807a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0ed1b99-089b-4113-b7d4-72495451807a" (UID: "b0ed1b99-089b-4113-b7d4-72495451807a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:02:12.329480 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.329441 2548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-console-config\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:12.329480 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.329474 2548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ed1b99-089b-4113-b7d4-72495451807a-service-ca\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:12.329480 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.329483 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz4k9\" (UniqueName: \"kubernetes.io/projected/b0ed1b99-089b-4113-b7d4-72495451807a-kube-api-access-bz4k9\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:12.329480 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.329492 2548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ed1b99-089b-4113-b7d4-72495451807a-console-serving-cert\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:12.329729 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.329501 2548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ed1b99-089b-4113-b7d4-72495451807a-console-oauth-config\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:12.544356 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.544317 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7648c55f86-cdpfx"] Jul 16 18:02:12.548518 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:12.548488 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7648c55f86-cdpfx"] Jul 16 18:02:14.521547 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:14.521508 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ed1b99-089b-4113-b7d4-72495451807a" path="/var/lib/kubelet/pods/b0ed1b99-089b-4113-b7d4-72495451807a/volumes" Jul 16 18:02:36.296035 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:36.295990 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:36.360322 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:36.360293 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:36.375726 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:36.375685 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:54.404577 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.404535 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 18:02:54.405088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.404813 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="prometheus" containerID="cri-o://cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9" gracePeriod=600 Jul 16 18:02:54.405088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.404853 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="thanos-sidecar" containerID="cri-o://d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad" gracePeriod=600 Jul 16 18:02:54.405088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.404881 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2" gracePeriod=600 Jul 16 18:02:54.405088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.404850 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="kube-rbac-proxy" containerID="cri-o://a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587" gracePeriod=600 Jul 16 18:02:54.405088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.404922 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="kube-rbac-proxy-web" containerID="cri-o://2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec" gracePeriod=600 Jul 16 18:02:54.405088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.404926 2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="config-reloader" containerID="cri-o://c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06" gracePeriod=600 Jul 16 18:02:54.664666 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.664637 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:54.784693 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.784655 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-metrics-client-ca\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.784883 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.784701 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwtgh\" (UniqueName: \"kubernetes.io/projected/11c53e85-d99a-4de5-a20f-441420cfca65-kube-api-access-vwtgh\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.784883 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.784731 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-kube-rbac-proxy\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.784883 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.784853 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-web-config\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785040 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.784885 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-trusted-ca-bundle\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785040 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.784921 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-serving-certs-ca-bundle\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785040 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.784948 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785227 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785084 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:02:54.785227 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785185 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-grpc-tls\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785227 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785219 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-kubelet-serving-ca-bundle\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785371 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785251 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-1\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785371 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785281 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-config\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785371 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785306 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-2\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785371 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785308 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:02:54.785371 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785332 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-0\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785371 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785360 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-thanos-prometheus-http-client-file\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785659 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785389 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785659 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785444 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-tls\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785659 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785469 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-metrics-client-certs\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785659 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785509 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11c53e85-d99a-4de5-a20f-441420cfca65-tls-assets\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785659 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785552 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11c53e85-d99a-4de5-a20f-441420cfca65-config-out\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785659 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785575 2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-db\") pod \"11c53e85-d99a-4de5-a20f-441420cfca65\" (UID: \"11c53e85-d99a-4de5-a20f-441420cfca65\") " Jul 16 18:02:54.785967 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785816 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-metrics-client-ca\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.785967 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785834 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.788377 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785312 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:02:54.788377 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.785567 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:02:54.788377 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.787207 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:02:54.788377 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.787354 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:02:54.788377 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.787417 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:02:54.788377 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.787665 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:02:54.788377 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.787731 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:02:54.788377 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.788009 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:02:54.788377 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.788045 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:02:54.788377 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.788139 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11c53e85-d99a-4de5-a20f-441420cfca65-kube-api-access-vwtgh" (OuterVolumeSpecName: "kube-api-access-vwtgh") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "kube-api-access-vwtgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:02:54.788967 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.788847 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 18:02:54.789491 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.789458 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:02:54.789881 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.789853 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-config" (OuterVolumeSpecName: "config") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:02:54.790062 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.790034 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:02:54.790240 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.790075 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:02:54.790527 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.790504 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11c53e85-d99a-4de5-a20f-441420cfca65-config-out" (OuterVolumeSpecName: "config-out") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 18:02:54.790682 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.790661 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11c53e85-d99a-4de5-a20f-441420cfca65-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 18:02:54.797899 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.797874 2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-web-config" (OuterVolumeSpecName: "web-config") pod "11c53e85-d99a-4de5-a20f-441420cfca65" (UID: "11c53e85-d99a-4de5-a20f-441420cfca65"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 18:02:54.886791 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886744 2548 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-config\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.886791 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886784 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.886791 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886796 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886808 2548 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886819 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886831 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886841 2548 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-metrics-client-certs\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886849 2548 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11c53e85-d99a-4de5-a20f-441420cfca65-tls-assets\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886857 2548 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11c53e85-d99a-4de5-a20f-441420cfca65-config-out\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886864 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-db\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886872 2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwtgh\" (UniqueName: \"kubernetes.io/projected/11c53e85-d99a-4de5-a20f-441420cfca65-kube-api-access-vwtgh\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886881 2548 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-kube-rbac-proxy\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886889 2548 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-web-config\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886897 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886906 2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886914 2548 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11c53e85-d99a-4de5-a20f-441420cfca65-secret-grpc-tls\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886922 2548 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:54.887026 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:54.886929 2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11c53e85-d99a-4de5-a20f-441420cfca65-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-204.ec2.internal\" DevicePath \"\"" Jul 16 18:02:55.380327 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380288 2548 generic.go:356] "Generic (PLEG): container finished" podID="11c53e85-d99a-4de5-a20f-441420cfca65" containerID="9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2" exitCode=0 Jul 16 18:02:55.380327 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380319 2548 generic.go:356] "Generic (PLEG): container finished" podID="11c53e85-d99a-4de5-a20f-441420cfca65" containerID="a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587" exitCode=0 Jul 16 18:02:55.380327 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380328 2548 generic.go:356] "Generic (PLEG): container finished" podID="11c53e85-d99a-4de5-a20f-441420cfca65" containerID="2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec" exitCode=0 Jul 16 18:02:55.380327 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380337 2548 generic.go:356] "Generic (PLEG): container finished" podID="11c53e85-d99a-4de5-a20f-441420cfca65" containerID="d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad" exitCode=0 Jul 16 18:02:55.380687 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380345 2548 generic.go:356] "Generic (PLEG): container finished" podID="11c53e85-d99a-4de5-a20f-441420cfca65" containerID="c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06" exitCode=0 Jul 16 18:02:55.380687 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380354 2548 generic.go:356] "Generic (PLEG): container finished" podID="11c53e85-d99a-4de5-a20f-441420cfca65" containerID="cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9" exitCode=0 Jul 16 18:02:55.380687 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380367 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerDied","Data":"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2"} Jul 16 18:02:55.380687 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380384 2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.380687 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380460 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerDied","Data":"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587"} Jul 16 18:02:55.380687 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380504 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerDied","Data":"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec"} Jul 16 18:02:55.380687 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380527 2548 scope.go:117] "RemoveContainer" containerID="9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2" Jul 16 18:02:55.380687 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380543 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerDied","Data":"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad"} Jul 16 18:02:55.380687 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380584 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerDied","Data":"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06"} Jul 16 18:02:55.380687 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380627 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerDied","Data":"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9"} Jul 16 18:02:55.380687 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.380667 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11c53e85-d99a-4de5-a20f-441420cfca65","Type":"ContainerDied","Data":"ffec331efd291874b40a61033588221b712a0853519bf683f3cde9e31b185140"} Jul 16 18:02:55.393449 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.393425 2548 scope.go:117] "RemoveContainer" containerID="a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587" Jul 16 18:02:55.400343 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.400320 2548 scope.go:117] "RemoveContainer" containerID="2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec" Jul 16 18:02:55.407563 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.407413 2548 scope.go:117] "RemoveContainer" containerID="d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad" Jul 16 18:02:55.408803 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.408780 2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 18:02:55.414735 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.414644 2548 scope.go:117] "RemoveContainer" containerID="c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06" Jul 16 18:02:55.416661 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.416635 2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 18:02:55.433221 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.433196 2548 scope.go:117] "RemoveContainer" containerID="cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9" Jul 16 18:02:55.440968 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.440948 2548 scope.go:117] "RemoveContainer" containerID="e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e" Jul 16 18:02:55.448054 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.448012 2548 scope.go:117] "RemoveContainer" containerID="9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2" Jul 16 18:02:55.448348 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:02:55.448326 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": container with ID starting with 9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2 not found: ID does not exist" containerID="9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2" Jul 16 18:02:55.448432 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.448362 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2"} err="failed to get container status \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": rpc error: code = NotFound desc = could not find container \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": container with ID starting with 9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2 not found: ID does not exist" Jul 16 18:02:55.448432 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.448391 2548 scope.go:117] "RemoveContainer" containerID="a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587" Jul 16 18:02:55.448681 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:02:55.448659 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": container with ID starting with a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587 not found: ID does not exist" containerID="a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587" Jul 16 18:02:55.448723 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.448692 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587"} err="failed to get container status \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": rpc error: code = NotFound desc = could not find container \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": container with ID starting with a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587 not found: ID does not exist" Jul 16 18:02:55.448723 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.448716 2548 scope.go:117] "RemoveContainer" containerID="2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec" Jul 16 18:02:55.448822 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.448807 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 18:02:55.448951 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:02:55.448935 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": container with ID starting with 2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec not found: ID does not exist" containerID="2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec" Jul 16 18:02:55.449015 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.448958 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec"} err="failed to get container status \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": rpc error: code = NotFound desc = could not find container \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": container with ID starting with 2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec not found: ID does not exist" Jul 16 18:02:55.449015 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.448978 2548 scope.go:117] "RemoveContainer" containerID="d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad" Jul 16 18:02:55.449160 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449145 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ed1b99-089b-4113-b7d4-72495451807a" containerName="console" Jul 16 18:02:55.449203 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449163 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ed1b99-089b-4113-b7d4-72495451807a" containerName="console" Jul 16 18:02:55.449203 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449176 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="config-reloader" Jul 16 18:02:55.449203 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449184 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="config-reloader" Jul 16 18:02:55.449203 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449196 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="kube-rbac-proxy-web" Jul 16 18:02:55.449334 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449205 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="kube-rbac-proxy-web" Jul 16 18:02:55.449334 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449217 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="kube-rbac-proxy" Jul 16 18:02:55.449334 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449222 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="kube-rbac-proxy" Jul 16 18:02:55.449334 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449233 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="thanos-sidecar" Jul 16 18:02:55.449334 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449238 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="thanos-sidecar" Jul 16 18:02:55.449334 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449245 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="init-config-reloader" Jul 16 18:02:55.449334 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:02:55.449244 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": container with ID starting with d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad not found: ID does not exist" containerID="d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad" Jul 16 18:02:55.449334 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449268 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad"} err="failed to get container status \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": rpc error: code = NotFound desc = could not find container \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": container with ID starting with d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad not found: ID does not exist" Jul 16 18:02:55.449334 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449283 2548 scope.go:117] "RemoveContainer" containerID="c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06" Jul 16 18:02:55.449334 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449250 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="init-config-reloader" Jul 16 18:02:55.449334 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449333 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="kube-rbac-proxy-thanos" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449341 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="kube-rbac-proxy-thanos" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449352 2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="prometheus" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449358 2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="prometheus" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449432 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ed1b99-089b-4113-b7d4-72495451807a" containerName="console" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449444 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="config-reloader" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449452 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="kube-rbac-proxy" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449461 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="prometheus" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449467 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="kube-rbac-proxy-web" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449475 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="thanos-sidecar" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449480 2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" containerName="kube-rbac-proxy-thanos" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:02:55.449502 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": container with ID starting with c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06 not found: ID does not exist" containerID="c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449523 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06"} err="failed to get container status \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": rpc error: code = NotFound desc = could not find container \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": container with ID starting with c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06 not found: ID does not exist" Jul 16 18:02:55.449686 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449538 2548 scope.go:117] "RemoveContainer" containerID="cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9" Jul 16 18:02:55.450206 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:02:55.449779 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": container with ID starting with cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9 not found: ID does not exist" containerID="cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9" Jul 16 18:02:55.450206 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449809 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9"} err="failed to get container status \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": rpc error: code = NotFound desc = could not find container \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": container with ID starting with cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9 not found: ID does not exist" Jul 16 18:02:55.450206 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.449828 2548 scope.go:117] "RemoveContainer" containerID="e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e" Jul 16 18:02:55.450206 ip-10-0-141-204 kubenswrapper[2548]: E0716 18:02:55.450053 2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": container with ID starting with e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e not found: ID does not exist" containerID="e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e" Jul 16 18:02:55.450206 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.450072 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e"} err="failed to get container status \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": rpc error: code = NotFound desc = could not find container \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": container with ID starting with e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e not found: ID does not exist" Jul 16 18:02:55.450206 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.450085 2548 scope.go:117] "RemoveContainer" containerID="9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2" Jul 16 18:02:55.450445 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.450316 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2"} err="failed to get container status \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": rpc error: code = NotFound desc = could not find container \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": container with ID starting with 9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2 not found: ID does not exist" Jul 16 18:02:55.450445 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.450350 2548 scope.go:117] "RemoveContainer" containerID="a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587" Jul 16 18:02:55.450586 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.450561 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587"} err="failed to get container status \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": rpc error: code = NotFound desc = could not find container \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": container with ID starting with a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587 not found: ID does not exist" Jul 16 18:02:55.450663 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.450589 2548 scope.go:117] "RemoveContainer" containerID="2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec" Jul 16 18:02:55.450811 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.450793 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec"} err="failed to get container status \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": rpc error: code = NotFound desc = could not find container \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": container with ID starting with 2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec not found: ID does not exist" Jul 16 18:02:55.450891 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.450813 2548 scope.go:117] "RemoveContainer" containerID="d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad" Jul 16 18:02:55.451025 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.451008 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad"} err="failed to get container status \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": rpc error: code = NotFound desc = could not find container \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": container with ID starting with d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad not found: ID does not exist" Jul 16 18:02:55.451082 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.451026 2548 scope.go:117] "RemoveContainer" containerID="c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06" Jul 16 18:02:55.451305 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.451283 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06"} err="failed to get container status \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": rpc error: code = NotFound desc = could not find container \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": container with ID starting with c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06 not found: ID does not exist" Jul 16 18:02:55.451399 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.451306 2548 scope.go:117] "RemoveContainer" containerID="cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9" Jul 16 18:02:55.451568 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.451544 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9"} err="failed to get container status \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": rpc error: code = NotFound desc = could not find container \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": container with ID starting with cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9 not found: ID does not exist" Jul 16 18:02:55.451706 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.451569 2548 scope.go:117] "RemoveContainer" containerID="e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e" Jul 16 18:02:55.451836 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.451816 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e"} err="failed to get container status \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": rpc error: code = NotFound desc = could not find container \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": container with ID starting with e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e not found: ID does not exist" Jul 16 18:02:55.451879 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.451837 2548 scope.go:117] "RemoveContainer" containerID="9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2" Jul 16 18:02:55.452075 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.452056 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2"} err="failed to get container status \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": rpc error: code = NotFound desc = could not find container \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": container with ID starting with 9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2 not found: ID does not exist" Jul 16 18:02:55.452175 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.452076 2548 scope.go:117] "RemoveContainer" containerID="a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587" Jul 16 18:02:55.452344 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.452325 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587"} err="failed to get container status \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": rpc error: code = NotFound desc = could not find container \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": container with ID starting with a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587 not found: ID does not exist" Jul 16 18:02:55.452389 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.452345 2548 scope.go:117] "RemoveContainer" containerID="2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec" Jul 16 18:02:55.452538 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.452518 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec"} err="failed to get container status \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": rpc error: code = NotFound desc = could not find container \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": container with ID starting with 2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec not found: ID does not exist" Jul 16 18:02:55.452593 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.452539 2548 scope.go:117] "RemoveContainer" containerID="d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad" Jul 16 18:02:55.452841 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.452820 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad"} err="failed to get container status \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": rpc error: code = NotFound desc = could not find container \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": container with ID starting with d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad not found: ID does not exist" Jul 16 18:02:55.452972 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.452841 2548 scope.go:117] "RemoveContainer" containerID="c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06" Jul 16 18:02:55.453146 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.453124 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06"} err="failed to get container status \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": rpc error: code = NotFound desc = could not find container \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": container with ID starting with c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06 not found: ID does not exist" Jul 16 18:02:55.453146 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.453142 2548 scope.go:117] "RemoveContainer" containerID="cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9" Jul 16 18:02:55.453414 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.453393 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9"} err="failed to get container status \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": rpc error: code = NotFound desc = could not find container \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": container with ID starting with cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9 not found: ID does not exist" Jul 16 18:02:55.453466 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.453417 2548 scope.go:117] "RemoveContainer" containerID="e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e" Jul 16 18:02:55.453654 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.453634 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e"} err="failed to get container status \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": rpc error: code = NotFound desc = could not find container \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": container with ID starting with e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e not found: ID does not exist" Jul 16 18:02:55.453702 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.453657 2548 scope.go:117] "RemoveContainer" containerID="9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2" Jul 16 18:02:55.453837 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.453819 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.453894 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.453875 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2"} err="failed to get container status \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": rpc error: code = NotFound desc = could not find container \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": container with ID starting with 9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2 not found: ID does not exist" Jul 16 18:02:55.453940 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.453897 2548 scope.go:117] "RemoveContainer" containerID="a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587" Jul 16 18:02:55.454271 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.454244 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587"} err="failed to get container status \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": rpc error: code = NotFound desc = could not find container \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": container with ID starting with a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587 not found: ID does not exist" Jul 16 18:02:55.454271 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.454272 2548 scope.go:117] "RemoveContainer" containerID="2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec" Jul 16 18:02:55.454588 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.454559 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec"} err="failed to get container status \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": rpc error: code = NotFound desc = could not find container \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": container with ID starting with 2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec not found: ID does not exist" Jul 16 18:02:55.454588 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.454587 2548 scope.go:117] "RemoveContainer" containerID="d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad" Jul 16 18:02:55.454816 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.454794 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad"} err="failed to get container status \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": rpc error: code = NotFound desc = could not find container \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": container with ID starting with d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad not found: ID does not exist" Jul 16 18:02:55.454870 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.454816 2548 scope.go:117] "RemoveContainer" containerID="c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06" Jul 16 18:02:55.455069 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.455044 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06"} err="failed to get container status \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": rpc error: code = NotFound desc = could not find container \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": container with ID starting with c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06 not found: ID does not exist" Jul 16 18:02:55.455069 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.455068 2548 scope.go:117] "RemoveContainer" containerID="cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9" Jul 16 18:02:55.455379 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.455358 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9"} err="failed to get container status \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": rpc error: code = NotFound desc = could not find container \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": container with ID starting with cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9 not found: ID does not exist" Jul 16 18:02:55.455433 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.455381 2548 scope.go:117] "RemoveContainer" containerID="e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e" Jul 16 18:02:55.455616 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.455597 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e"} err="failed to get container status \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": rpc error: code = NotFound desc = could not find container \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": container with ID starting with e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e not found: ID does not exist" Jul 16 18:02:55.455674 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.455618 2548 scope.go:117] "RemoveContainer" containerID="9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2" Jul 16 18:02:55.455827 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.455812 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2"} err="failed to get container status \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": rpc error: code = NotFound desc = could not find container \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": container with ID starting with 9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2 not found: ID does not exist" Jul 16 18:02:55.455880 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.455826 2548 scope.go:117] "RemoveContainer" containerID="a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587" Jul 16 18:02:55.456021 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.456007 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587"} err="failed to get container status \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": rpc error: code = NotFound desc = could not find container \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": container with ID starting with a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587 not found: ID does not exist" Jul 16 18:02:55.456072 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.456021 2548 scope.go:117] "RemoveContainer" containerID="2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec" Jul 16 18:02:55.456281 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.456262 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec"} err="failed to get container status \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": rpc error: code = NotFound desc = could not find container \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": container with ID starting with 2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec not found: ID does not exist" Jul 16 18:02:55.456328 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.456281 2548 scope.go:117] "RemoveContainer" containerID="d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad" Jul 16 18:02:55.456610 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.456586 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad"} err="failed to get container status \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": rpc error: code = NotFound desc = could not find container \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": container with ID starting with d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad not found: ID does not exist" Jul 16 18:02:55.456674 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.456611 2548 scope.go:117] "RemoveContainer" containerID="c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06" Jul 16 18:02:55.456834 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.456813 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06"} err="failed to get container status \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": rpc error: code = NotFound desc = could not find container \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": container with ID starting with c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06 not found: ID does not exist" Jul 16 18:02:55.456943 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.456835 2548 scope.go:117] "RemoveContainer" containerID="cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9" Jul 16 18:02:55.456943 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.456930 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 18:02:55.457088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457068 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 18:02:55.457088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457077 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 18:02:55.457252 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457090 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 18:02:55.457252 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457115 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9"} err="failed to get container status \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": rpc error: code = NotFound desc = could not find container \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": container with ID starting with cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9 not found: ID does not exist" Jul 16 18:02:55.457252 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457138 2548 scope.go:117] "RemoveContainer" containerID="e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e" Jul 16 18:02:55.457443 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457417 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e"} err="failed to get container status \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": rpc error: code = NotFound desc = could not find container \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": container with ID starting with e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e not found: ID does not exist" Jul 16 18:02:55.457509 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457441 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 18:02:55.457563 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457506 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 18:02:55.457563 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457555 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 18:02:55.457658 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457444 2548 scope.go:117] "RemoveContainer" containerID="9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2" Jul 16 18:02:55.457757 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457740 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 18:02:55.457823 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457780 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-427rclhsn6msp\"" Jul 16 18:02:55.457823 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457797 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7gt97\"" Jul 16 18:02:55.457920 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457797 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 18:02:55.457920 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457888 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2"} err="failed to get container status \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": rpc error: code = NotFound desc = could not find container \"9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2\": container with ID starting with 9c4b971b38cbf80946e83169f758a18665c6aa587a849bbfb384f2c09696cdf2 not found: ID does not exist" Jul 16 18:02:55.457920 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.457916 2548 scope.go:117] "RemoveContainer" containerID="a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587" Jul 16 18:02:55.458076 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.458052 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 18:02:55.458329 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.458310 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 18:02:55.458329 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.458323 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 18:02:55.458454 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.458367 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 18:02:55.458454 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.458399 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587"} err="failed to get container status \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": rpc error: code = NotFound desc = could not find container \"a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587\": container with ID starting with a684b1ad685f05c4d95127abac683122095b3d4e712ab62bd5d1f129db1b9587 not found: ID does not exist" Jul 16 18:02:55.458454 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.458421 2548 scope.go:117] "RemoveContainer" containerID="2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec" Jul 16 18:02:55.458753 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.458728 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec"} err="failed to get container status \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": rpc error: code = NotFound desc = could not find container \"2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec\": container with ID starting with 2598034b6445916cff79f22a910ae870ee2ef92e3b7494d50db16b42c2b369ec not found: ID does not exist" Jul 16 18:02:55.458753 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.458754 2548 scope.go:117] "RemoveContainer" containerID="d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad" Jul 16 18:02:55.459021 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.458995 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad"} err="failed to get container status \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": rpc error: code = NotFound desc = could not find container \"d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad\": container with ID starting with d5b62709326b3a16671c7d3d52126bea189d9516024457a863ecfbcc135c79ad not found: ID does not exist" Jul 16 18:02:55.459082 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.459023 2548 scope.go:117] "RemoveContainer" containerID="c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06" Jul 16 18:02:55.459318 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.459300 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06"} err="failed to get container status \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": rpc error: code = NotFound desc = could not find container \"c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06\": container with ID starting with c7191e49f7d4f0a76bf7864d7b8261543831fa92fb8ec5f477895bb9cec07e06 not found: ID does not exist" Jul 16 18:02:55.459367 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.459319 2548 scope.go:117] "RemoveContainer" containerID="cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9" Jul 16 18:02:55.459576 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.459547 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9"} err="failed to get container status \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": rpc error: code = NotFound desc = could not find container \"cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9\": container with ID starting with cce1ef20414981615a612cce3aac6a983acf48421e41ff9c47219d93c5bb25c9 not found: ID does not exist" Jul 16 18:02:55.459576 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.459575 2548 scope.go:117] "RemoveContainer" containerID="e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e" Jul 16 18:02:55.459805 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.459784 2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e"} err="failed to get container status \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": rpc error: code = NotFound desc = could not find container \"e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e\": container with ID starting with e0c6e314dde396a5d94a95405f429287a421447e2c5f144ccaba523a789f097e not found: ID does not exist" Jul 16 18:02:55.460877 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.460856 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 18:02:55.464453 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.464435 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 18:02:55.473536 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.473515 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 18:02:55.591445 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591399 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591640 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591467 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591640 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591493 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591640 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591520 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-web-config\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591640 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591553 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591640 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591574 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591640 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591602 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-config\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591937 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591648 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591937 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591670 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591937 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591727 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591937 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591765 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591937 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591793 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591937 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591817 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591937 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591841 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591937 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591866 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591937 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591890 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.591937 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591918 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.592319 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591946 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.592319 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.591992 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-config-out\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.592319 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.592038 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx8zb\" (UniqueName: \"kubernetes.io/projected/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-kube-api-access-gx8zb\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693159 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693051 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693159 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693095 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693159 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693135 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693159 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693159 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-web-config\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693450 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693182 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693450 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693198 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693450 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693217 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-config\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693450 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693242 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693450 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693366 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693450 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693397 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693450 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693440 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693795 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693470 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693795 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693497 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693795 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693523 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693795 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693547 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693795 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693572 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693795 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693602 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693795 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693635 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693795 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693667 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-config-out\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.693795 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.693706 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx8zb\" (UniqueName: \"kubernetes.io/projected/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-kube-api-access-gx8zb\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.694255 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.694181 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.697381 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.696468 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-web-config\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.697381 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.696474 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.697381 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.696478 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.697381 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.696624 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.697381 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.696627 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.697381 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.696781 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.697381 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.696987 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.697381 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.697247 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.697866 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.697550 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.697866 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.697666 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.698008 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.697984 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.698067 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.698042 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.698148 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.698074 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.698537 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.698508 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-config\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.698998 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.698969 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.699095 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.699077 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.699485 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.699465 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.699900 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.699881 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-config-out\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.702797 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.702775 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx8zb\" (UniqueName: \"kubernetes.io/projected/a616b4f7-ac12-4e72-a7d2-e87dd4750aa9-kube-api-access-gx8zb\") pod \"prometheus-k8s-0\" (UID: \"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.763809 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.763768 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:02:55.902419 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:55.902299 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 18:02:55.904817 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:02:55.904788 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda616b4f7_ac12_4e72_a7d2_e87dd4750aa9.slice/crio-a944027fb94491b2d87a43e66ffd800cdbea1174d5f6d9faaf1e5dcaf8af8a2d WatchSource:0}: Error finding container a944027fb94491b2d87a43e66ffd800cdbea1174d5f6d9faaf1e5dcaf8af8a2d: Status 404 returned error can't find the container with id a944027fb94491b2d87a43e66ffd800cdbea1174d5f6d9faaf1e5dcaf8af8a2d Jul 16 18:02:56.385702 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:56.385667 2548 generic.go:356] "Generic (PLEG): container finished" podID="a616b4f7-ac12-4e72-a7d2-e87dd4750aa9" containerID="32fd7d436d278f27f9412144c9cf52306ba6b3027894f40f68f2ef9c6dc60eb4" exitCode=0 Jul 16 18:02:56.385903 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:56.385758 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9","Type":"ContainerDied","Data":"32fd7d436d278f27f9412144c9cf52306ba6b3027894f40f68f2ef9c6dc60eb4"} Jul 16 18:02:56.385903 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:56.385848 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9","Type":"ContainerStarted","Data":"a944027fb94491b2d87a43e66ffd800cdbea1174d5f6d9faaf1e5dcaf8af8a2d"} Jul 16 18:02:56.525448 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:56.525407 2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11c53e85-d99a-4de5-a20f-441420cfca65" path="/var/lib/kubelet/pods/11c53e85-d99a-4de5-a20f-441420cfca65/volumes" Jul 16 18:02:57.394117 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:57.394075 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9","Type":"ContainerStarted","Data":"9675a60c69781f5214a23153cf3a29c632c27c1b0272c19a48fe7c44fee76eb0"} Jul 16 18:02:57.394293 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:57.394153 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9","Type":"ContainerStarted","Data":"140e1e89f158177b487318cfb2142ce12b8577dd311ec4399ad0f0c7a4d4ac44"} Jul 16 18:02:57.394293 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:57.394180 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9","Type":"ContainerStarted","Data":"26ecaf95341031ffe5cc22be7225c2388afd473de91d9242c9763761506b3995"} Jul 16 18:02:57.394293 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:57.394205 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9","Type":"ContainerStarted","Data":"f07a22fed5f8d6bc035029c20a164145cdebb713f6a1f012cd413dda47d88287"} Jul 16 18:02:57.394293 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:57.394233 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9","Type":"ContainerStarted","Data":"5687ff964d0a4fd7367c1c55f772d70807b852c470a277e396a8fef21f7b6e39"} Jul 16 18:02:57.394293 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:57.394257 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a616b4f7-ac12-4e72-a7d2-e87dd4750aa9","Type":"ContainerStarted","Data":"f48f74447be212f609aec4c6f2d282bb627af6e7cb513767207d99f938202c85"} Jul 16 18:02:57.426447 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:02:57.426392 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.407445126 podStartE2EDuration="2.426373893s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.928767ms" isStatefulPod=false podCreationTimestamp="2026-07-16 18:02:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:02:57.42526636 +0000 UTC m=+171.443070283" watchObservedRunningTime="2026-07-16 18:02:57.426373893 +0000 UTC m=+171.444177811" Jul 16 18:03:00.764068 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:03:00.763980 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:03:55.764632 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:03:55.764597 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:03:55.780866 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:03:55.780842 2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:03:56.627159 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:03:56.627132 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 18:05:06.377667 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:06.377633 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/ovn-acl-logging/0.log" Jul 16 18:05:06.382166 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:06.382128 2548 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 18:05:06.385487 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:06.385461 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/ovn-acl-logging/0.log" Jul 16 18:05:29.525367 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:29.525339 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fslwp_66d0fe0e-abd1-43c4-b06a-6803c1626df8/global-pull-secret-syncer/0.log" Jul 16 18:05:29.650444 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:29.650409 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dbrvx_3e8dfead-29d2-4ac6-8f2c-2bda20b5d14a/konnectivity-agent/0.log" Jul 16 18:05:29.719948 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:29.719918 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-204.ec2.internal_644b13fd518434df8a933cb0806e9ec0/haproxy/0.log" Jul 16 18:05:33.308330 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.308299 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-dxf4r_8da23b9b-1fa4-4e0c-a3a6-07323caf75b8/kube-state-metrics/0.log" Jul 16 18:05:33.338899 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.338872 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-dxf4r_8da23b9b-1fa4-4e0c-a3a6-07323caf75b8/kube-rbac-proxy-main/0.log" Jul 16 18:05:33.364212 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.364183 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-dxf4r_8da23b9b-1fa4-4e0c-a3a6-07323caf75b8/kube-rbac-proxy-self/0.log" Jul 16 18:05:33.545407 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.545383 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lltsv_cb7cdbb2-819d-464b-8de2-2cb7417a990c/node-exporter/0.log" Jul 16 18:05:33.573968 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.573903 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lltsv_cb7cdbb2-819d-464b-8de2-2cb7417a990c/kube-rbac-proxy/0.log" Jul 16 18:05:33.603625 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.603601 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lltsv_cb7cdbb2-819d-464b-8de2-2cb7417a990c/init-textfile/0.log" Jul 16 18:05:33.714652 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.714621 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7pv6b_f98baa66-7bb6-4a97-a77d-c23c0b905228/kube-rbac-proxy-main/0.log" Jul 16 18:05:33.742179 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.742153 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7pv6b_f98baa66-7bb6-4a97-a77d-c23c0b905228/kube-rbac-proxy-self/0.log" Jul 16 18:05:33.773603 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.773577 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7pv6b_f98baa66-7bb6-4a97-a77d-c23c0b905228/openshift-state-metrics/0.log" Jul 16 18:05:33.818400 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.818367 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a616b4f7-ac12-4e72-a7d2-e87dd4750aa9/prometheus/0.log" Jul 16 18:05:33.842669 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.842596 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a616b4f7-ac12-4e72-a7d2-e87dd4750aa9/config-reloader/0.log" Jul 16 18:05:33.867803 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.867778 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a616b4f7-ac12-4e72-a7d2-e87dd4750aa9/thanos-sidecar/0.log" Jul 16 18:05:33.892207 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.892180 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a616b4f7-ac12-4e72-a7d2-e87dd4750aa9/kube-rbac-proxy-web/0.log" Jul 16 18:05:33.919082 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.919059 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a616b4f7-ac12-4e72-a7d2-e87dd4750aa9/kube-rbac-proxy/0.log" Jul 16 18:05:33.943202 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.943180 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a616b4f7-ac12-4e72-a7d2-e87dd4750aa9/kube-rbac-proxy-thanos/0.log" Jul 16 18:05:33.967945 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:33.967919 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a616b4f7-ac12-4e72-a7d2-e87dd4750aa9/init-config-reloader/0.log" Jul 16 18:05:34.005492 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:34.005465 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-dbd8c_09541b00-0bbb-4653-9e9e-34197feb2ce8/prometheus-operator/0.log" Jul 16 18:05:34.029835 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:34.029802 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-dbd8c_09541b00-0bbb-4653-9e9e-34197feb2ce8/kube-rbac-proxy/0.log" Jul 16 18:05:34.061858 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:34.061813 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-shzms_bde2c5a8-30ab-4c71-91ac-36183e4fd12b/prometheus-operator-admission-webhook/0.log" Jul 16 18:05:36.503301 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:36.503271 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-t8rtf_afac0037-70a2-46dd-8f85-2f67596daf48/download-server/0.log" Jul 16 18:05:37.172851 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.172816 2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2"] Jul 16 18:05:37.175022 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.175005 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.178131 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.178094 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qfjhm\"/\"kube-root-ca.crt\"" Jul 16 18:05:37.178918 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.178896 2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qfjhm\"/\"default-dockercfg-mxdz6\"" Jul 16 18:05:37.179022 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.178897 2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qfjhm\"/\"openshift-service-ca.crt\"" Jul 16 18:05:37.189321 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.189296 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2"] Jul 16 18:05:37.202225 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.202179 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-lib-modules\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.202600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.202488 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-podres\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.202600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.202545 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxhn2\" (UniqueName: \"kubernetes.io/projected/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-kube-api-access-nxhn2\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.202600 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.202578 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-sys\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.202743 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.202626 2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-proc\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.303848 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.303814 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxhn2\" (UniqueName: \"kubernetes.io/projected/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-kube-api-access-nxhn2\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.303848 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.303845 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-sys\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.304088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.303866 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-proc\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.304088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.303929 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-lib-modules\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.304088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.303954 2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-podres\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.304088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.303956 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-sys\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.304088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.304018 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-proc\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.304088 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.304089 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-podres\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.304349 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.304087 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-lib-modules\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.313198 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.313174 2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxhn2\" (UniqueName: \"kubernetes.io/projected/cb402261-64f9-4b9f-ba1a-34a4cdf917c0-kube-api-access-nxhn2\") pod \"perf-node-gather-daemonset-6tmd2\" (UID: \"cb402261-64f9-4b9f-ba1a-34a4cdf917c0\") " pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.485307 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.485215 2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.611193 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.611155 2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2"] Jul 16 18:05:37.613357 ip-10-0-141-204 kubenswrapper[2548]: W0716 18:05:37.613322 2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcb402261_64f9_4b9f_ba1a_34a4cdf917c0.slice/crio-73f7f281cab92229ea2667da51b4963bae982b4e62d3c64523b1210327562dc0 WatchSource:0}: Error finding container 73f7f281cab92229ea2667da51b4963bae982b4e62d3c64523b1210327562dc0: Status 404 returned error can't find the container with id 73f7f281cab92229ea2667da51b4963bae982b4e62d3c64523b1210327562dc0 Jul 16 18:05:37.828716 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.828676 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-48zz7_ddc52a4b-0bce-4ead-bebd-5c441386bdf8/dns/0.log" Jul 16 18:05:37.850962 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.850933 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-48zz7_ddc52a4b-0bce-4ead-bebd-5c441386bdf8/kube-rbac-proxy/0.log" Jul 16 18:05:37.977655 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.977622 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" event={"ID":"cb402261-64f9-4b9f-ba1a-34a4cdf917c0","Type":"ContainerStarted","Data":"8cd2c5885fa5cd521079c5bb6ab8d40469360154e807e79ea8c3de2f980a3249"} Jul 16 18:05:37.977842 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.977677 2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" event={"ID":"cb402261-64f9-4b9f-ba1a-34a4cdf917c0","Type":"ContainerStarted","Data":"73f7f281cab92229ea2667da51b4963bae982b4e62d3c64523b1210327562dc0"} Jul 16 18:05:37.977842 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.977718 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:37.993985 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:37.993937 2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" podStartSLOduration=0.993919471 podStartE2EDuration="993.919471ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:05:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:05:37.992867447 +0000 UTC m=+332.010671366" watchObservedRunningTime="2026-07-16 18:05:37.993919471 +0000 UTC m=+332.011723393" Jul 16 18:05:38.029329 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:38.029301 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fxkpf_1e0c6f04-267f-436c-bf71-fb8cbf6ca7d7/dns-node-resolver/0.log" Jul 16 18:05:38.461626 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:38.461593 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86977454cd-zrxxx_eade24af-17f3-4e72-8f79-4a512640681c/registry/0.log" Jul 16 18:05:38.485386 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:38.485352 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bzjkl_42fadce5-4688-43ff-b549-24da2f6def18/node-ca/0.log" Jul 16 18:05:39.594273 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:39.594239 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4xfqn_feb74991-99e7-4e5b-9107-7843035254b2/serve-healthcheck-canary/0.log" Jul 16 18:05:40.036353 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:40.036323 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9t8bs_0203802b-4e91-443d-bfd5-231ffde10de5/kube-rbac-proxy/0.log" Jul 16 18:05:40.059395 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:40.059366 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9t8bs_0203802b-4e91-443d-bfd5-231ffde10de5/exporter/0.log" Jul 16 18:05:40.085531 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:40.085505 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9t8bs_0203802b-4e91-443d-bfd5-231ffde10de5/extractor/0.log" Jul 16 18:05:43.990759 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:43.990731 2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qfjhm/perf-node-gather-daemonset-6tmd2" Jul 16 18:05:45.404393 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:45.404362 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59wmx_4e00fd32-cd94-4741-a005-fbe723cfc5d5/kube-multus-additional-cni-plugins/0.log" Jul 16 18:05:45.431389 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:45.431363 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59wmx_4e00fd32-cd94-4741-a005-fbe723cfc5d5/egress-router-binary-copy/0.log" Jul 16 18:05:45.459573 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:45.459546 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59wmx_4e00fd32-cd94-4741-a005-fbe723cfc5d5/cni-plugins/0.log" Jul 16 18:05:45.482919 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:45.482896 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59wmx_4e00fd32-cd94-4741-a005-fbe723cfc5d5/bond-cni-plugin/0.log" Jul 16 18:05:45.505624 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:45.505604 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59wmx_4e00fd32-cd94-4741-a005-fbe723cfc5d5/routeoverride-cni/0.log" Jul 16 18:05:45.533446 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:45.533418 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59wmx_4e00fd32-cd94-4741-a005-fbe723cfc5d5/whereabouts-cni-bincopy/0.log" Jul 16 18:05:45.557255 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:45.557227 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59wmx_4e00fd32-cd94-4741-a005-fbe723cfc5d5/whereabouts-cni/0.log" Jul 16 18:05:45.949542 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:45.949510 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zcv4g_33959b9d-18c5-4082-9c71-68efea2e06bc/kube-multus/0.log" Jul 16 18:05:46.064737 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:46.064659 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8r665_89d21151-3342-4fc2-ab77-68629dc8896e/network-metrics-daemon/0.log" Jul 16 18:05:46.085796 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:46.085769 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8r665_89d21151-3342-4fc2-ab77-68629dc8896e/kube-rbac-proxy/0.log" Jul 16 18:05:47.307437 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:47.307411 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/ovn-controller/0.log" Jul 16 18:05:47.330628 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:47.330601 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/ovn-acl-logging/0.log" Jul 16 18:05:47.330628 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:47.330623 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/ovn-acl-logging/1.log" Jul 16 18:05:47.351545 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:47.351520 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/kube-rbac-proxy-node/0.log" Jul 16 18:05:47.374424 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:47.374400 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 18:05:47.397019 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:47.396992 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/northd/0.log" Jul 16 18:05:47.419617 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:47.419582 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/nbdb/0.log" Jul 16 18:05:47.442076 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:47.442052 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/sbdb/0.log" Jul 16 18:05:47.476353 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:47.476302 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t69v6_4d5ed8e5-e63c-4506-a370-cfe068cd8ff6/ovnkube-controller/0.log" Jul 16 18:05:48.539825 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:48.539795 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-8zgv8_022d8ead-bbfa-4500-96c9-ec2216a12abf/network-check-target-container/0.log" Jul 16 18:05:49.518222 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:49.518196 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-sjmsp_20e24960-2a4d-461a-9b92-374682a4d176/iptables-alerter/0.log" Jul 16 18:05:50.123476 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:50.123447 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-r2jww_ec9cc724-8586-4f80-af6d-8e10ee17433f/tuned/0.log" Jul 16 18:05:53.474942 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:53.474906 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-fzfqq_a1e527a1-0819-4c70-95a0-93857af48d83/csi-driver/0.log" Jul 16 18:05:53.502332 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:53.502305 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-fzfqq_a1e527a1-0819-4c70-95a0-93857af48d83/csi-node-driver-registrar/0.log" Jul 16 18:05:53.524590 ip-10-0-141-204 kubenswrapper[2548]: I0716 18:05:53.524553 2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-fzfqq_a1e527a1-0819-4c70-95a0-93857af48d83/csi-liveness-probe/0.log"