Jul 28 06:49:23.028587 ip-10-0-130-140 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 06:49:23.028599 ip-10-0-130-140 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 06:49:23.028606 ip-10-0-130-140 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 06:49:23.028870 ip-10-0-130-140 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 06:49:32.298268 ip-10-0-130-140 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 28 06:49:32.298280 ip-10-0-130-140 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5d583fe3dcd74e2f923c48af2e0a44c6 -- Jul 28 06:51:22.775078 ip-10-0-130-140 systemd[1]: Starting Kubernetes Kubelet... Jul 28 06:51:23.166804 ip-10-0-130-140 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 06:51:23.166804 ip-10-0-130-140 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 06:51:23.166804 ip-10-0-130-140 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 06:51:23.166804 ip-10-0-130-140 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 06:51:23.167421 ip-10-0-130-140 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 06:51:23.167907 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.167784 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 06:51:23.172611 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172593 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:51:23.172611 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172611 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172615 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172619 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172623 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172626 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172629 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172632 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172635 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172638 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172642 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172645 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172647 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172650 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172653 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172656 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172659 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172669 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172672 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172675 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172678 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:51:23.172693 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172683 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172687 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172690 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172693 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172696 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172700 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172703 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172706 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172709 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172712 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172715 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172718 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172720 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172723 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172726 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172728 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172731 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172735 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172738 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:51:23.173227 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172740 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172745 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172750 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172753 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172756 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172759 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172762 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172765 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172768 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172771 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172775 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172778 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172781 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172783 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172786 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172790 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172794 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172797 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172800 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:51:23.173764 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172802 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172805 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172808 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172811 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172814 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172817 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172820 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172823 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172837 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172840 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172843 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172846 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172849 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172852 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172854 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172857 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172860 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172863 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172865 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:51:23.174288 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172868 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172871 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172874 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172876 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172879 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172883 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172886 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172888 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172891 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172895 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172898 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172900 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172903 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172906 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172909 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172912 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172916 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172920 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172923 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:51:23.174781 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172925 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.172928 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173712 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173720 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173723 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173728 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173733 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173736 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173739 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173742 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173745 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173748 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173751 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173754 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173757 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173760 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173763 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173766 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173770 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173773 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:51:23.175313 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173776 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173779 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173783 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173786 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173789 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173792 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173795 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173797 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173800 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173803 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173806 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173808 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173811 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173813 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173816 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173819 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173822 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173824 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173844 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:51:23.175867 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173848 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173851 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173853 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173858 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173860 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173863 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173866 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173869 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173871 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173877 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173881 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173884 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173887 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173890 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173893 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173899 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173902 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173905 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173907 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173912 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:51:23.176366 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173915 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173919 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173922 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173926 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173929 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173932 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173936 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173938 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173941 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173944 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173947 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173950 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173953 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173955 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173958 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173961 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173964 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173966 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173969 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:51:23.176951 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173972 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173974 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173977 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173980 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173983 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173986 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173989 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173992 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173995 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.173999 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174001 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174004 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174007 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174010 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174012 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174015 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174018 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174021 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174024 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174027 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:51:23.177454 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174029 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174032 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174035 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174437 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174442 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174445 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174448 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174451 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174454 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174457 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174460 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174463 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174466 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174469 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174473 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174476 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174481 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174484 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174488 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:51:23.178016 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174492 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174495 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174499 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174502 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174505 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174508 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174513 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174516 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174520 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174523 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174526 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174529 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174532 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174535 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174537 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174540 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174543 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174546 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174549 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:51:23.178507 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174552 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174555 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174558 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174561 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174564 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174567 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174569 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174572 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174575 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174578 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174580 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174584 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174586 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174589 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174594 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174597 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174600 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174602 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174605 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174608 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:51:23.179030 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174610 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174613 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174616 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174618 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174621 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174624 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174627 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174629 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174632 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174635 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174637 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174640 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174643 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174646 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174649 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174652 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174654 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174657 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174660 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174663 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:51:23.179543 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174666 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174668 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174671 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174674 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174676 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174679 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174682 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174685 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174689 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174692 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174695 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174697 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174700 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174703 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174707 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174711 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174714 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174717 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174719 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:51:23.180095 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174722 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174725 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174728 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174730 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.174733 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174812 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174820 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174844 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174850 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174855 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174858 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174863 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174868 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174872 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174875 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174879 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174883 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174886 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174889 2554 flags.go:64] FLAG: --cgroup-root="" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174896 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174899 2554 flags.go:64] FLAG: --client-ca-file="" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174903 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174907 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174912 2554 flags.go:64] FLAG: --cluster-domain="" Jul 28 06:51:23.180604 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174916 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174919 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174923 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174926 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174931 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174934 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174937 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174941 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174944 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174947 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174951 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174954 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174957 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174961 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174964 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174968 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174971 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174974 2554 flags.go:64] FLAG: --enable-server="true" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174977 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174981 2554 flags.go:64] FLAG: --event-burst="100" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174984 2554 flags.go:64] FLAG: --event-qps="50" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174988 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174991 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174995 2554 flags.go:64] FLAG: --eviction-hard="" Jul 28 06:51:23.181292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.174999 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175002 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175005 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175010 2554 flags.go:64] FLAG: --eviction-soft="" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175013 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175017 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175020 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175024 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175027 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175030 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175033 2554 flags.go:64] FLAG: --feature-gates="" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175037 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175041 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175044 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175048 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175051 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175054 2554 flags.go:64] FLAG: --help="false" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175057 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175060 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175064 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175067 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175070 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175074 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175077 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 06:51:23.181929 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175080 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175083 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175086 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175089 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175093 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175096 2554 flags.go:64] FLAG: --kube-reserved="" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175099 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175102 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175105 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175108 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175111 2554 flags.go:64] FLAG: --lock-file="" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175116 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175119 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175123 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175129 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175132 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175136 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175139 2554 flags.go:64] FLAG: --logging-format="text" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175142 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175146 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175149 2554 flags.go:64] FLAG: --manifest-url="" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175152 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175156 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175159 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175164 2554 flags.go:64] FLAG: --max-pods="110" Jul 28 06:51:23.182691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175167 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175170 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175173 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175176 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175180 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175183 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175186 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175194 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175197 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175200 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175203 2554 flags.go:64] FLAG: --pod-cidr="" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175206 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175212 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175215 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175219 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175222 2554 flags.go:64] FLAG: --port="10250" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175226 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175229 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00e2a796808d06232" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175232 2554 flags.go:64] FLAG: --qos-reserved="" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175237 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175240 2554 flags.go:64] FLAG: --register-node="true" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175252 2554 flags.go:64] FLAG: --register-with-taints="" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175256 2554 flags.go:64] FLAG: --registry-burst="10" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175262 2554 flags.go:64] FLAG: --registry-qps="5" Jul 28 06:51:23.183636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175265 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175268 2554 flags.go:64] FLAG: --reserved-memory="" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175278 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175281 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175285 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175288 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175292 2554 flags.go:64] FLAG: --runonce="false" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175295 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175298 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175301 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175304 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175307 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175311 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175314 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175318 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175322 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175325 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175329 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175332 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175335 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175340 2554 flags.go:64] FLAG: --system-cgroups="" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175344 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175351 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175354 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175357 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 06:51:23.184825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175362 2554 flags.go:64] FLAG: --tls-min-version="" Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175365 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175369 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175373 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175376 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175379 2554 flags.go:64] FLAG: --v="2" Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175383 2554 flags.go:64] FLAG: --version="false" Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175389 2554 flags.go:64] FLAG: --vmodule="" Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175393 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.175397 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175537 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175542 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175545 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175548 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175551 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175554 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175557 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175560 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175562 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175565 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175568 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175571 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:51:23.185630 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175574 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175576 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175579 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175582 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175585 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175590 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175593 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175596 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175599 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175602 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175604 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175609 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175614 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175617 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175621 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175632 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175635 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175638 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175641 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:51:23.186241 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175644 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175647 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175650 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175652 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175655 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175658 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175661 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175664 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175666 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175669 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175672 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175675 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175677 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175680 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175683 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175686 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175688 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175691 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175696 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175698 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:51:23.186759 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175701 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175704 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175707 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175710 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175712 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175716 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175719 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175722 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175724 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175727 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175730 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175733 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175736 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175739 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175742 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175744 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175747 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175750 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175752 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:51:23.187318 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175755 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175758 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175761 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175764 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175766 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175769 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175771 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175774 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175777 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175780 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175783 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175788 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175792 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175795 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175798 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175801 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175804 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175806 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175810 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:51:23.187881 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175814 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175818 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175822 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175825 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175841 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175844 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175847 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175850 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175853 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.175856 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.176721 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.186492 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.186515 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.187423 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.187432 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 06:51:23.188384 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187503 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187509 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187513 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187517 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187522 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187525 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187529 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187534 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187537 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187541 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187544 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187547 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187551 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187554 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187557 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187560 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187563 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187567 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187570 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:51:23.188789 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187573 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187576 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187579 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187582 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187585 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187588 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187591 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187593 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187596 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187599 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187603 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187606 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187609 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187612 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187615 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187618 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187621 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187624 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187626 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187629 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:51:23.189298 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187632 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187635 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187637 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187640 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187643 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187646 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187648 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187658 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187661 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187664 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187666 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187669 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187673 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187675 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187678 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187681 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187684 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187686 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187691 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187695 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:51:23.189823 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187698 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187701 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187705 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187708 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187711 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187714 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187717 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187720 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187722 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187725 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187728 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187731 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187733 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187736 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187739 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187742 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187745 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187748 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187750 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:51:23.190367 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187753 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187767 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187770 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187773 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187776 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187779 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187782 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187784 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187787 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187790 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187794 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187796 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187799 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187802 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187805 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187808 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187810 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187813 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187816 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187819 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:51:23.190893 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187822 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.187841 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187972 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187978 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187981 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187985 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187987 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187990 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187993 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187996 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.187999 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188001 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188005 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188007 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188011 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:51:23.191461 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188014 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188017 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188020 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188023 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188026 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188029 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188032 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188035 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188037 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188040 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188043 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188046 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188049 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188052 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188054 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188057 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188060 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188063 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188065 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188068 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:51:23.191884 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188071 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188075 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188080 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188083 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188085 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188088 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188091 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188094 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188096 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188099 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188102 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188104 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188108 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188110 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188113 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188116 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188119 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188122 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188125 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188128 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:51:23.192401 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188131 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188133 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188136 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188139 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188143 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188147 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188150 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188153 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188156 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188159 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188162 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188164 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188167 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188170 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188173 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188175 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188178 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188181 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188183 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:51:23.192945 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188186 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188189 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188192 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188194 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188198 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188202 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188206 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188209 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188212 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188215 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188218 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188222 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188225 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188228 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188231 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188234 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188236 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188239 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188242 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:51:23.193433 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188255 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188258 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188261 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188264 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188267 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188270 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188273 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:23.188276 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.188282 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.188427 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.190813 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.192609 2554 server.go:1019] "Starting client certificate rotation" Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.192726 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 06:51:23.194048 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.193676 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 06:51:23.195444 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.195431 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 06:51:23.196803 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.196784 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 06:51:23.213254 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.213226 2554 log.go:25] "Validated CRI v1 runtime API" Jul 28 06:51:23.215919 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.215900 2554 log.go:25] "Validated CRI v1 image API" Jul 28 06:51:23.217558 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.217542 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 06:51:23.221088 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.221066 2554 fs.go:135] Filesystem UUIDs: map[601c70ce-7a61-454c-80f1-519ae676273e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d2b3641c-cc68-4acc-8e3f-9f119edd1d5a:/dev/nvme0n1p4] Jul 28 06:51:23.221171 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.221089 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 06:51:23.226460 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.226337 2554 manager.go:216] Machine: {Timestamp:2026-07-28 06:51:23.224994322 +0000 UTC m=+0.329684425 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3130151 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec293b9344831f437b3fed4e772b8289 SystemUUID:ec293b93-4483-1f43-7b3f-ed4e772b8289 BootID:5d583fe3-dcd7-4e2f-923c-48af2e0a44c6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:b9:c8:d2:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:b9:c8:d2:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:d8:d9:52:51:2b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 06:51:23.226460 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.226455 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 06:51:23.226587 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.226545 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 06:51:23.231213 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.230950 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 06:51:23.231367 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.231213 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-140.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 06:51:23.232166 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.232147 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 06:51:23.232166 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.232168 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 06:51:23.232266 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.232176 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 06:51:23.233111 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.233099 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 06:51:23.234039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.234027 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 06:51:23.235983 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.235960 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 06:51:23.236246 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.236227 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 28 06:51:23.236389 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.236378 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 06:51:23.236427 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.236414 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 28 06:51:23.236456 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.236429 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 06:51:23.236456 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.236447 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 06:51:23.236456 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.236457 2554 kubelet.go:398] "Adding apiserver pod source" Jul 28 06:51:23.236542 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.236467 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 06:51:23.236963 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.236948 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 06:51:23.237028 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.236971 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 06:51:23.239284 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.239262 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 06:51:23.241259 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.241244 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 06:51:23.241305 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.241277 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 06:51:23.243039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.243025 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 06:51:23.243103 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.243044 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 06:51:23.243103 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.243052 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 06:51:23.243103 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.243058 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 06:51:23.243103 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.243070 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 06:51:23.243103 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.243077 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 06:51:23.243103 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.243087 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 06:51:23.243103 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.243093 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 06:51:23.243103 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.243100 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 06:51:23.243103 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.243106 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 06:51:23.243356 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.243115 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 06:51:23.243356 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.243122 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 06:51:23.244713 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.244698 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 06:51:23.244713 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.244712 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 06:51:23.247633 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.247602 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 06:51:23.247633 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.247602 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 06:51:23.247778 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.247652 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-140.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 06:51:23.248625 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.248611 2554 server.go:1268] "Started kubelet" Jul 28 06:51:23.248729 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.248693 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 06:51:23.248811 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.248729 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 06:51:23.248888 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.248847 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 06:51:23.249763 ip-10-0-130-140 systemd[1]: Started Kubernetes Kubelet. Jul 28 06:51:23.251108 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.250739 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 06:51:23.251342 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.251260 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 28 06:51:23.254061 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.254040 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 06:51:23.256509 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.255201 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-140.ec2.internal.18c6617b026d696f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-140.ec2.internal,UID:ip-10-0-130-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-140.ec2.internal,},FirstTimestamp:2026-07-28 06:51:23.248576879 +0000 UTC m=+0.353266982,LastTimestamp:2026-07-28 06:51:23.248576879 +0000 UTC m=+0.353266982,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-140.ec2.internal,}" Jul 28 06:51:23.259101 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.259081 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 06:51:23.259222 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.259175 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 06:51:23.259798 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.259724 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:23.260120 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.260022 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 06:51:23.260120 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.260051 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 06:51:23.260237 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.260038 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 06:51:23.260237 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.260212 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 28 06:51:23.260237 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.260221 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 28 06:51:23.260650 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.260632 2554 factory.go:153] Registering CRI-O factory Jul 28 06:51:23.260650 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.260651 2554 factory.go:223] Registration of the crio container factory successfully Jul 28 06:51:23.260833 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.260711 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 06:51:23.260833 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.260722 2554 factory.go:55] Registering systemd factory Jul 28 06:51:23.260833 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.260729 2554 factory.go:223] Registration of the systemd container factory successfully Jul 28 06:51:23.260833 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.260747 2554 factory.go:103] Registering Raw factory Jul 28 06:51:23.260833 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.260758 2554 manager.go:1196] Started watching for new ooms in manager Jul 28 06:51:23.261421 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.261400 2554 manager.go:349] Starting recovery of all containers Jul 28 06:51:23.264755 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.264398 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 06:51:23.265142 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.265094 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 06:51:23.270566 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.270533 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 06:51:23.276248 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.276221 2554 manager.go:354] Recovery completed Jul 28 06:51:23.281175 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.281157 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:23.284256 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.284232 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zwwd2" Jul 28 06:51:23.284543 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.284523 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:23.284585 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.284560 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:23.284585 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.284572 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:23.285229 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.285211 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:23.285325 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.285214 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 06:51:23.285325 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.285287 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 06:51:23.285325 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.285306 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 28 06:51:23.286564 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.286546 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:23.286631 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.286578 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:23.286631 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.286591 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:23.287114 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.287031 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-140.ec2.internal.18c6617b04923ce9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-140.ec2.internal,UID:ip-10-0-130-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-140.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-140.ec2.internal,},FirstTimestamp:2026-07-28 06:51:23.284544745 +0000 UTC m=+0.389234851,LastTimestamp:2026-07-28 06:51:23.284544745 +0000 UTC m=+0.389234851,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-140.ec2.internal,}" Jul 28 06:51:23.287603 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.287589 2554 policy_none.go:49] "None policy: Start" Jul 28 06:51:23.287680 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.287607 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 06:51:23.287680 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.287618 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 06:51:23.288970 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.288957 2554 policy_none.go:47] "Start" Jul 28 06:51:23.292195 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.292031 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zwwd2" Jul 28 06:51:23.298176 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.298056 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-140.ec2.internal.18c6617b04928fa7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-140.ec2.internal,UID:ip-10-0-130-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-140.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-140.ec2.internal,},FirstTimestamp:2026-07-28 06:51:23.284565927 +0000 UTC m=+0.389256031,LastTimestamp:2026-07-28 06:51:23.284565927 +0000 UTC m=+0.389256031,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-140.ec2.internal,}" Jul 28 06:51:23.330504 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.330484 2554 manager.go:337] "Starting Device Plugin manager" Jul 28 06:51:23.330638 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.330556 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 06:51:23.330638 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.330572 2554 server.go:87] "Starting device plugin registration server" Jul 28 06:51:23.330952 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.330936 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 06:51:23.331054 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.330961 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 06:51:23.331143 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.331126 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 06:51:23.331228 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.331216 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 06:51:23.331228 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.331228 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 06:51:23.331956 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.331929 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 06:51:23.332058 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.331989 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:23.413112 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.413034 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 06:51:23.413112 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.413082 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 06:51:23.413112 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.413108 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 06:51:23.414648 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.413148 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 06:51:23.415864 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.415826 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:51:23.431706 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.431678 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:23.432677 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.432656 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:23.432790 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.432694 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:23.432790 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.432723 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:23.432790 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.432764 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.442830 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.442805 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.442830 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.442832 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-140.ec2.internal\": node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:23.469689 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.469656 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:23.513833 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.513787 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-140.ec2.internal"] Jul 28 06:51:23.514031 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.513888 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:23.515793 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.515776 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:23.515868 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.515812 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:23.515868 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.515824 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:23.517187 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.517174 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:23.517316 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.517299 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.517361 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.517333 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:23.517913 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.517896 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:23.518021 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.517925 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:23.518021 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.517941 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:23.518021 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.517996 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:23.518171 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.518032 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:23.518171 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.518048 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:23.519255 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.519240 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.519331 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.519265 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:23.520026 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.520002 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:23.520113 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.520040 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:23.520113 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.520054 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:23.550024 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.549997 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-140.ec2.internal\" not found" node="ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.556268 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.556237 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-140.ec2.internal\" not found" node="ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.561423 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.561403 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5742a08682b14dec412b7167019da7bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal\" (UID: \"5742a08682b14dec412b7167019da7bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.561527 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.561436 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5742a08682b14dec412b7167019da7bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal\" (UID: \"5742a08682b14dec412b7167019da7bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.561527 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.561464 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a16892ee32f85011fc1a1806c8666fbf-config\") pod \"kube-apiserver-proxy-ip-10-0-130-140.ec2.internal\" (UID: \"a16892ee32f85011fc1a1806c8666fbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.570719 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.570699 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:23.661876 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.661840 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5742a08682b14dec412b7167019da7bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal\" (UID: \"5742a08682b14dec412b7167019da7bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.661876 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.661779 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5742a08682b14dec412b7167019da7bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal\" (UID: \"5742a08682b14dec412b7167019da7bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.662110 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.661913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5742a08682b14dec412b7167019da7bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal\" (UID: \"5742a08682b14dec412b7167019da7bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.662110 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.661938 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a16892ee32f85011fc1a1806c8666fbf-config\") pod \"kube-apiserver-proxy-ip-10-0-130-140.ec2.internal\" (UID: \"a16892ee32f85011fc1a1806c8666fbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.662110 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.661980 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a16892ee32f85011fc1a1806c8666fbf-config\") pod \"kube-apiserver-proxy-ip-10-0-130-140.ec2.internal\" (UID: \"a16892ee32f85011fc1a1806c8666fbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.662110 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.661992 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5742a08682b14dec412b7167019da7bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal\" (UID: \"5742a08682b14dec412b7167019da7bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.671628 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.671560 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:23.771689 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.771638 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:23.858497 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.858453 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.859639 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:23.859623 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-140.ec2.internal" Jul 28 06:51:23.871809 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.871778 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:23.971964 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:23.971841 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:24.072963 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:24.072913 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:24.173212 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:24.173169 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:24.191727 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.191691 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 06:51:24.191922 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.191903 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 06:51:24.273782 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:24.273697 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:24.297300 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.297255 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 06:46:24 +0000 UTC" deadline="2028-05-13 14:21:42.68083366 +0000 UTC" Jul 28 06:51:24.297300 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.297292 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15727h30m18.383544542s" Jul 28 06:51:24.353734 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.353705 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:24.355278 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.355257 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:24.355380 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.355300 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:24.355380 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.355315 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:24.373606 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.373580 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:51:24.373842 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:24.373823 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:24.469585 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:24.469545 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5742a08682b14dec412b7167019da7bd.slice/crio-1937b851bde916516537989d12cbc2bd7f1746f161e63caaca20e6d8410a109c WatchSource:0}: Error finding container 1937b851bde916516537989d12cbc2bd7f1746f161e63caaca20e6d8410a109c: Status 404 returned error can't find the container with id 1937b851bde916516537989d12cbc2bd7f1746f161e63caaca20e6d8410a109c Jul 28 06:51:24.469861 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:24.469840 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16892ee32f85011fc1a1806c8666fbf.slice/crio-90621c039eccd27d1707a2b01c2c3d070dc130aa53e8d0422db8a3e3576fedb7 WatchSource:0}: Error finding container 90621c039eccd27d1707a2b01c2c3d070dc130aa53e8d0422db8a3e3576fedb7: Status 404 returned error can't find the container with id 90621c039eccd27d1707a2b01c2c3d070dc130aa53e8d0422db8a3e3576fedb7 Jul 28 06:51:24.474430 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:24.474408 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:24.474511 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.474468 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 06:51:24.480549 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.480525 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:51:24.575202 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:24.575106 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-140.ec2.internal\" not found" Jul 28 06:51:24.617151 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.617125 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:51:24.662588 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.662546 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" Jul 28 06:51:24.676012 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.675989 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 06:51:24.677099 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.677084 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-140.ec2.internal" Jul 28 06:51:24.685657 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:24.685638 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 06:51:25.238138 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.238105 2554 apiserver.go:52] "Watching apiserver" Jul 28 06:51:25.246569 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.246541 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 06:51:25.247068 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.247045 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal","openshift-multus/multus-additional-cni-plugins-cv4p9","openshift-multus/network-metrics-daemon-jkdfq","openshift-network-operator/iptables-alerter-8zrm2","kube-system/global-pull-secret-syncer-ltj9k","kube-system/konnectivity-agent-8l97s","kube-system/kube-apiserver-proxy-ip-10-0-130-140.ec2.internal","openshift-multus/multus-v52f6","openshift-network-diagnostics/network-check-target-j8vjh","openshift-ovn-kubernetes/ovnkube-node-lhsp6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf","openshift-cluster-node-tuning-operator/tuned-lxc6x","openshift-dns/node-resolver-6f54g","openshift-image-registry/node-ca-sbnt5"] Jul 28 06:51:25.248912 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.248889 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.250562 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.250535 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6f54g" Jul 28 06:51:25.251606 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.251587 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 06:51:25.252158 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.252134 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 06:51:25.252158 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.252148 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-464qk\"" Jul 28 06:51:25.252321 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.252218 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 06:51:25.252694 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.252458 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:25.252694 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.252613 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:25.252923 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.252905 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 06:51:25.253001 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.252964 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 06:51:25.253137 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.252905 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 06:51:25.253386 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.253364 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 06:51:25.253570 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.253364 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fbscp\"" Jul 28 06:51:25.253570 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.253539 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 06:51:25.256589 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.255914 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8zrm2" Jul 28 06:51:25.257754 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.257282 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:25.257754 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.257364 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:25.259808 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.259378 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 06:51:25.259808 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.259631 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 06:51:25.259808 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.259644 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:51:25.260031 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.259933 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6nhm5\"" Jul 28 06:51:25.260096 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.260031 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8l97s" Jul 28 06:51:25.260167 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.260148 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 06:51:25.261888 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.261781 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:25.261888 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.261849 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:25.262523 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.262482 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 06:51:25.262624 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.262553 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 06:51:25.262694 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.262639 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rshgw\"" Jul 28 06:51:25.264616 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.264597 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sbnt5" Jul 28 06:51:25.266435 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.266414 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.266972 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.266949 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 06:51:25.267098 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.267019 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 06:51:25.267190 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.267137 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 06:51:25.267494 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.267473 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5j55v\"" Jul 28 06:51:25.268447 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.268429 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.269138 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.269117 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 06:51:25.269241 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.269151 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 06:51:25.269241 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.269163 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 06:51:25.269416 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.269399 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 06:51:25.269514 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.269497 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 06:51:25.269648 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.269630 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sjcdz\"" Jul 28 06:51:25.270409 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270385 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.270409 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270403 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-systemd-units\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.270565 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270434 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-slash\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.270565 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270467 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44c04fab-c090-48db-903a-41b4abd0ee63-ovnkube-config\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.270565 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270483 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44c04fab-c090-48db-903a-41b4abd0ee63-env-overrides\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.270565 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270500 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gfb5\" (UniqueName: \"kubernetes.io/projected/44c04fab-c090-48db-903a-41b4abd0ee63-kube-api-access-2gfb5\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.270565 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270520 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7mmh\" (UniqueName: \"kubernetes.io/projected/ea272cb3-32b4-4d87-a15f-0a2be6dc8d06-kube-api-access-w7mmh\") pod \"node-resolver-6f54g\" (UID: \"ea272cb3-32b4-4d87-a15f-0a2be6dc8d06\") " pod="openshift-dns/node-resolver-6f54g" Jul 28 06:51:25.270565 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270536 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e64e45e-2297-46a0-977d-510debf6875a-host-slash\") pod \"iptables-alerter-8zrm2\" (UID: \"1e64e45e-2297-46a0-977d-510debf6875a\") " pod="openshift-network-operator/iptables-alerter-8zrm2" Jul 28 06:51:25.270930 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270570 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-kubelet-config\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:25.270930 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270594 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-dbus\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:25.270930 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270612 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-kubelet\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.270930 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270629 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-etc-openvswitch\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.270930 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270645 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-cni-netd\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.270930 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270661 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44c04fab-c090-48db-903a-41b4abd0ee63-ovnkube-script-lib\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.270930 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270676 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8txfb\" (UniqueName: \"kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb\") pod \"network-check-target-j8vjh\" (UID: \"15292834-c484-4c15-9ab0-a9f85d854b6d\") " pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:25.270930 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270693 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e64e45e-2297-46a0-977d-510debf6875a-iptables-alerter-script\") pod \"iptables-alerter-8zrm2\" (UID: \"1e64e45e-2297-46a0-977d-510debf6875a\") " pod="openshift-network-operator/iptables-alerter-8zrm2" Jul 28 06:51:25.270930 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270719 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:25.270930 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270747 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:25.270930 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270766 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh7m2\" (UniqueName: \"kubernetes.io/projected/03922df9-9b4e-4dec-80de-12e819531552-kube-api-access-gh7m2\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:25.270930 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270833 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-log-socket\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.271414 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.270956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0fb4bd44-8dcd-44b4-b252-68ea1f99aca9-konnectivity-ca\") pod \"konnectivity-agent-8l97s\" (UID: \"0fb4bd44-8dcd-44b4-b252-68ea1f99aca9\") " pod="kube-system/konnectivity-agent-8l97s" Jul 28 06:51:25.271414 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271053 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44c04fab-c090-48db-903a-41b4abd0ee63-ovn-node-metrics-cert\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.271414 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea272cb3-32b4-4d87-a15f-0a2be6dc8d06-hosts-file\") pod \"node-resolver-6f54g\" (UID: \"ea272cb3-32b4-4d87-a15f-0a2be6dc8d06\") " pod="openshift-dns/node-resolver-6f54g" Jul 28 06:51:25.271414 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271144 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-run-netns\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.271414 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271271 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 06:51:25.271414 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271302 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-flc5h\"" Jul 28 06:51:25.271414 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271271 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 06:51:25.271755 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271424 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-run-systemd\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.271755 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271465 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-run-openvswitch\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.271755 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271491 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-cni-bin\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.271755 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271515 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea272cb3-32b4-4d87-a15f-0a2be6dc8d06-tmp-dir\") pod \"node-resolver-6f54g\" (UID: \"ea272cb3-32b4-4d87-a15f-0a2be6dc8d06\") " pod="openshift-dns/node-resolver-6f54g" Jul 28 06:51:25.271755 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271543 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-var-lib-openvswitch\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.271755 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271569 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-node-log\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.271755 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271603 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.271755 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhfq4\" (UniqueName: \"kubernetes.io/projected/1e64e45e-2297-46a0-977d-510debf6875a-kube-api-access-lhfq4\") pod \"iptables-alerter-8zrm2\" (UID: \"1e64e45e-2297-46a0-977d-510debf6875a\") " pod="openshift-network-operator/iptables-alerter-8zrm2" Jul 28 06:51:25.271755 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271663 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-run-ovn\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.271755 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271689 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.271755 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.271731 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0fb4bd44-8dcd-44b4-b252-68ea1f99aca9-agent-certs\") pod \"konnectivity-agent-8l97s\" (UID: \"0fb4bd44-8dcd-44b4-b252-68ea1f99aca9\") " pod="kube-system/konnectivity-agent-8l97s" Jul 28 06:51:25.272308 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.272270 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.272895 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.272729 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 06:51:25.272895 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.272746 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 06:51:25.272895 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.272757 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kfbrk\"" Jul 28 06:51:25.273107 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.272906 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 06:51:25.274860 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.274821 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:51:25.274968 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.274874 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 06:51:25.274968 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.274872 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pkmq5\"" Jul 28 06:51:25.291024 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.290991 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vlhgd" Jul 28 06:51:25.301119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.300896 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vlhgd" Jul 28 06:51:25.339456 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.339421 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:51:25.364014 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.362956 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 06:51:25.372997 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.372973 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-run-multus-certs\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.373084 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373008 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65d16ac8-a186-4b01-af64-a1178eb64830-system-cni-dir\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.373084 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373026 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65d16ac8-a186-4b01-af64-a1178eb64830-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.373084 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373064 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-socket-dir\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.373186 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373097 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea272cb3-32b4-4d87-a15f-0a2be6dc8d06-hosts-file\") pod \"node-resolver-6f54g\" (UID: \"ea272cb3-32b4-4d87-a15f-0a2be6dc8d06\") " pod="openshift-dns/node-resolver-6f54g" Jul 28 06:51:25.373186 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373120 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-run-systemd\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.373186 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373160 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-run-systemd\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.373186 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373157 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-run-openvswitch\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.373306 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373213 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea272cb3-32b4-4d87-a15f-0a2be6dc8d06-hosts-file\") pod \"node-resolver-6f54g\" (UID: \"ea272cb3-32b4-4d87-a15f-0a2be6dc8d06\") " pod="openshift-dns/node-resolver-6f54g" Jul 28 06:51:25.373306 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373272 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65d16ac8-a186-4b01-af64-a1178eb64830-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.373306 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373286 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-run-openvswitch\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.373398 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373330 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-node-log\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.373398 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373359 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.373459 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373398 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-node-log\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.373459 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373439 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-cni-binary-copy\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.373530 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373477 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-var-lib-cni-multus\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.373530 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373486 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.373530 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373524 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f8d803f-7f02-4da7-9bca-04ab104246a7-host\") pod \"node-ca-sbnt5\" (UID: \"4f8d803f-7f02-4da7-9bca-04ab104246a7\") " pod="openshift-image-registry/node-ca-sbnt5" Jul 28 06:51:25.373635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373550 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-registration-dir\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.373635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373589 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8tc9\" (UniqueName: \"kubernetes.io/projected/3af08d58-d360-4ab2-bfd8-4320061d1e7f-kube-api-access-l8tc9\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.373635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhfq4\" (UniqueName: \"kubernetes.io/projected/1e64e45e-2297-46a0-977d-510debf6875a-kube-api-access-lhfq4\") pod \"iptables-alerter-8zrm2\" (UID: \"1e64e45e-2297-46a0-977d-510debf6875a\") " pod="openshift-network-operator/iptables-alerter-8zrm2" Jul 28 06:51:25.373820 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0fb4bd44-8dcd-44b4-b252-68ea1f99aca9-agent-certs\") pod \"konnectivity-agent-8l97s\" (UID: \"0fb4bd44-8dcd-44b4-b252-68ea1f99aca9\") " pod="kube-system/konnectivity-agent-8l97s" Jul 28 06:51:25.373820 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373689 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-slash\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.373820 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373717 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gfb5\" (UniqueName: \"kubernetes.io/projected/44c04fab-c090-48db-903a-41b4abd0ee63-kube-api-access-2gfb5\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.373820 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373736 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-multus-daemon-config\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.373820 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373752 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-sysctl-d\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.373820 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373781 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7mmh\" (UniqueName: \"kubernetes.io/projected/ea272cb3-32b4-4d87-a15f-0a2be6dc8d06-kube-api-access-w7mmh\") pod \"node-resolver-6f54g\" (UID: \"ea272cb3-32b4-4d87-a15f-0a2be6dc8d06\") " pod="openshift-dns/node-resolver-6f54g" Jul 28 06:51:25.373820 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373807 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e64e45e-2297-46a0-977d-510debf6875a-host-slash\") pod \"iptables-alerter-8zrm2\" (UID: \"1e64e45e-2297-46a0-977d-510debf6875a\") " pod="openshift-network-operator/iptables-alerter-8zrm2" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373869 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-kubelet-config\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373909 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-dbus\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373913 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-slash\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373934 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-kubelet\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373973 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-kubelet\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373987 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44c04fab-c090-48db-903a-41b4abd0ee63-ovnkube-script-lib\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.373983 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e64e45e-2297-46a0-977d-510debf6875a-host-slash\") pod \"iptables-alerter-8zrm2\" (UID: \"1e64e45e-2297-46a0-977d-510debf6875a\") " pod="openshift-network-operator/iptables-alerter-8zrm2" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374003 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-kubelet-config\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374029 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374056 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374064 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-multus-socket-dir-parent\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374096 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e64e45e-2297-46a0-977d-510debf6875a-iptables-alerter-script\") pod \"iptables-alerter-8zrm2\" (UID: \"1e64e45e-2297-46a0-977d-510debf6875a\") " pod="openshift-network-operator/iptables-alerter-8zrm2" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374121 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:25.374149 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374145 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-cnibin\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.374167 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374188 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-dbus\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374169 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-hostroot\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.374229 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374234 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-var-lib-kubelet\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.374258 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs podName:03922df9-9b4e-4dec-80de-12e819531552 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:25.874232258 +0000 UTC m=+2.978922372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs") pod "network-metrics-daemon-jkdfq" (UID: "03922df9-9b4e-4dec-80de-12e819531552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.374304 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret podName:6cbb34ff-cb3d-4f84-92f3-8a72dbb938de nodeName:}" failed. No retries permitted until 2026-07-28 06:51:25.874291292 +0000 UTC m=+2.978981388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret") pod "global-pull-secret-syncer-ltj9k" (UID: "6cbb34ff-cb3d-4f84-92f3-8a72dbb938de") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374323 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf55c\" (UniqueName: \"kubernetes.io/projected/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-kube-api-access-rf55c\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374355 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65d16ac8-a186-4b01-af64-a1178eb64830-cnibin\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374382 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-systemd\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374411 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-log-socket\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374440 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-multus-cni-dir\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374469 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65d16ac8-a186-4b01-af64-a1178eb64830-cni-binary-copy\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374498 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65d16ac8-a186-4b01-af64-a1178eb64830-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374497 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-log-socket\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.374857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374535 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374578 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-sysctl-conf\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374604 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-lib-modules\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374626 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28x7m\" (UniqueName: \"kubernetes.io/projected/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-kube-api-access-28x7m\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374652 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e64e45e-2297-46a0-977d-510debf6875a-iptables-alerter-script\") pod \"iptables-alerter-8zrm2\" (UID: \"1e64e45e-2297-46a0-977d-510debf6875a\") " pod="openshift-network-operator/iptables-alerter-8zrm2" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374686 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/44c04fab-c090-48db-903a-41b4abd0ee63-ovnkube-script-lib\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374658 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-sys\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374752 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-run-netns\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374777 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-cni-bin\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374803 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-run-netns\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374850 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-etc-kubernetes\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374876 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374902 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-tmp\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374928 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea272cb3-32b4-4d87-a15f-0a2be6dc8d06-tmp-dir\") pod \"node-resolver-6f54g\" (UID: \"ea272cb3-32b4-4d87-a15f-0a2be6dc8d06\") " pod="openshift-dns/node-resolver-6f54g" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-var-lib-openvswitch\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.374977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-system-cni-dir\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375000 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-run\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.375635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375025 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-var-lib-kubelet\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375051 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-run-ovn\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375079 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375107 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxjkg\" (UniqueName: \"kubernetes.io/projected/4f8d803f-7f02-4da7-9bca-04ab104246a7-kube-api-access-vxjkg\") pod \"node-ca-sbnt5\" (UID: \"4f8d803f-7f02-4da7-9bca-04ab104246a7\") " pod="openshift-image-registry/node-ca-sbnt5" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375132 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-sys-fs\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375158 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-sysconfig\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375177 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-kubernetes\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375202 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-systemd-units\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375208 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-var-lib-openvswitch\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375228 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44c04fab-c090-48db-903a-41b4abd0ee63-ovnkube-config\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375251 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44c04fab-c090-48db-903a-41b4abd0ee63-env-overrides\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375257 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-run-netns\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375276 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-var-lib-cni-bin\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375301 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-cni-bin\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375304 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-etc-openvswitch\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375338 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-cni-netd\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375386 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-systemd-units\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.376501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375401 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh7m2\" (UniqueName: \"kubernetes.io/projected/03922df9-9b4e-4dec-80de-12e819531552-kube-api-access-gh7m2\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375404 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-run-ovn\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375420 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375435 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-host-cni-netd\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375464 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-os-release\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375480 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/44c04fab-c090-48db-903a-41b4abd0ee63-etc-openvswitch\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375494 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-multus-conf-dir\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375540 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65d16ac8-a186-4b01-af64-a1178eb64830-os-release\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375568 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-modprobe-d\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375600 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txfb\" (UniqueName: \"kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb\") pod \"network-check-target-j8vjh\" (UID: \"15292834-c484-4c15-9ab0-a9f85d854b6d\") " pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375625 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-device-dir\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375661 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-tuned\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375682 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea272cb3-32b4-4d87-a15f-0a2be6dc8d06-tmp-dir\") pod \"node-resolver-6f54g\" (UID: \"ea272cb3-32b4-4d87-a15f-0a2be6dc8d06\") " pod="openshift-dns/node-resolver-6f54g" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375688 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-run-k8s-cni-cncf-io\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f8d803f-7f02-4da7-9bca-04ab104246a7-serviceca\") pod \"node-ca-sbnt5\" (UID: \"4f8d803f-7f02-4da7-9bca-04ab104246a7\") " pod="openshift-image-registry/node-ca-sbnt5" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375741 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bphl\" (UniqueName: \"kubernetes.io/projected/65d16ac8-a186-4b01-af64-a1178eb64830-kube-api-access-2bphl\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375788 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-host\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.377119 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375816 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0fb4bd44-8dcd-44b4-b252-68ea1f99aca9-konnectivity-ca\") pod \"konnectivity-agent-8l97s\" (UID: \"0fb4bd44-8dcd-44b4-b252-68ea1f99aca9\") " pod="kube-system/konnectivity-agent-8l97s" Jul 28 06:51:25.377635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375838 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/44c04fab-c090-48db-903a-41b4abd0ee63-env-overrides\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.377635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.375842 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44c04fab-c090-48db-903a-41b4abd0ee63-ovn-node-metrics-cert\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.377635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.376069 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/44c04fab-c090-48db-903a-41b4abd0ee63-ovnkube-config\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.377635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.376419 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0fb4bd44-8dcd-44b4-b252-68ea1f99aca9-konnectivity-ca\") pod \"konnectivity-agent-8l97s\" (UID: \"0fb4bd44-8dcd-44b4-b252-68ea1f99aca9\") " pod="kube-system/konnectivity-agent-8l97s" Jul 28 06:51:25.378132 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.378112 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0fb4bd44-8dcd-44b4-b252-68ea1f99aca9-agent-certs\") pod \"konnectivity-agent-8l97s\" (UID: \"0fb4bd44-8dcd-44b4-b252-68ea1f99aca9\") " pod="kube-system/konnectivity-agent-8l97s" Jul 28 06:51:25.378373 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.378354 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/44c04fab-c090-48db-903a-41b4abd0ee63-ovn-node-metrics-cert\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.381445 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.381386 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:51:25.381445 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.381410 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:51:25.381445 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.381424 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8txfb for pod openshift-network-diagnostics/network-check-target-j8vjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:25.381648 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.381484 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb podName:15292834-c484-4c15-9ab0-a9f85d854b6d nodeName:}" failed. No retries permitted until 2026-07-28 06:51:25.881466722 +0000 UTC m=+2.986156838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8txfb" (UniqueName: "kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb") pod "network-check-target-j8vjh" (UID: "15292834-c484-4c15-9ab0-a9f85d854b6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:25.383388 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.383305 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhfq4\" (UniqueName: \"kubernetes.io/projected/1e64e45e-2297-46a0-977d-510debf6875a-kube-api-access-lhfq4\") pod \"iptables-alerter-8zrm2\" (UID: \"1e64e45e-2297-46a0-977d-510debf6875a\") " pod="openshift-network-operator/iptables-alerter-8zrm2" Jul 28 06:51:25.383738 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.383717 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gfb5\" (UniqueName: \"kubernetes.io/projected/44c04fab-c090-48db-903a-41b4abd0ee63-kube-api-access-2gfb5\") pod \"ovnkube-node-lhsp6\" (UID: \"44c04fab-c090-48db-903a-41b4abd0ee63\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.383821 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.383796 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7mmh\" (UniqueName: \"kubernetes.io/projected/ea272cb3-32b4-4d87-a15f-0a2be6dc8d06-kube-api-access-w7mmh\") pod \"node-resolver-6f54g\" (UID: \"ea272cb3-32b4-4d87-a15f-0a2be6dc8d06\") " pod="openshift-dns/node-resolver-6f54g" Jul 28 06:51:25.383940 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.383865 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh7m2\" (UniqueName: \"kubernetes.io/projected/03922df9-9b4e-4dec-80de-12e819531552-kube-api-access-gh7m2\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:25.418485 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.418414 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-140.ec2.internal" event={"ID":"a16892ee32f85011fc1a1806c8666fbf","Type":"ContainerStarted","Data":"90621c039eccd27d1707a2b01c2c3d070dc130aa53e8d0422db8a3e3576fedb7"} Jul 28 06:51:25.419694 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.419665 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" event={"ID":"5742a08682b14dec412b7167019da7bd","Type":"ContainerStarted","Data":"1937b851bde916516537989d12cbc2bd7f1746f161e63caaca20e6d8410a109c"} Jul 28 06:51:25.476818 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.476749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-var-lib-cni-bin\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.476818 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.476818 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-os-release\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.477075 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.476849 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-multus-conf-dir\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.477075 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.476905 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-multus-conf-dir\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.477075 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.476923 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65d16ac8-a186-4b01-af64-a1178eb64830-os-release\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.477075 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.476944 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-os-release\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.477075 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.476962 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-modprobe-d\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.477075 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477010 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-device-dir\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.477075 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477014 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65d16ac8-a186-4b01-af64-a1178eb64830-os-release\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.477075 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477036 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-tuned\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.477075 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477029 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-var-lib-cni-bin\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477112 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-device-dir\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477145 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-modprobe-d\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477155 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-run-k8s-cni-cncf-io\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477186 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-run-k8s-cni-cncf-io\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477188 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f8d803f-7f02-4da7-9bca-04ab104246a7-serviceca\") pod \"node-ca-sbnt5\" (UID: \"4f8d803f-7f02-4da7-9bca-04ab104246a7\") " pod="openshift-image-registry/node-ca-sbnt5" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477219 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bphl\" (UniqueName: \"kubernetes.io/projected/65d16ac8-a186-4b01-af64-a1178eb64830-kube-api-access-2bphl\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-host\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-run-multus-certs\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477300 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65d16ac8-a186-4b01-af64-a1178eb64830-system-cni-dir\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477326 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65d16ac8-a186-4b01-af64-a1178eb64830-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477357 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-socket-dir\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477369 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-host\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477394 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65d16ac8-a186-4b01-af64-a1178eb64830-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477439 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65d16ac8-a186-4b01-af64-a1178eb64830-system-cni-dir\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477447 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-cni-binary-copy\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477474 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-var-lib-cni-multus\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.477519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477498 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f8d803f-7f02-4da7-9bca-04ab104246a7-host\") pod \"node-ca-sbnt5\" (UID: \"4f8d803f-7f02-4da7-9bca-04ab104246a7\") " pod="openshift-image-registry/node-ca-sbnt5" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477511 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-run-multus-certs\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477522 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-registration-dir\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477549 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8tc9\" (UniqueName: \"kubernetes.io/projected/3af08d58-d360-4ab2-bfd8-4320061d1e7f-kube-api-access-l8tc9\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477607 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-var-lib-cni-multus\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477624 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f8d803f-7f02-4da7-9bca-04ab104246a7-host\") pod \"node-ca-sbnt5\" (UID: \"4f8d803f-7f02-4da7-9bca-04ab104246a7\") " pod="openshift-image-registry/node-ca-sbnt5" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-multus-daemon-config\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477675 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4f8d803f-7f02-4da7-9bca-04ab104246a7-serviceca\") pod \"node-ca-sbnt5\" (UID: \"4f8d803f-7f02-4da7-9bca-04ab104246a7\") " pod="openshift-image-registry/node-ca-sbnt5" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477682 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-registration-dir\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477680 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-sysctl-d\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477748 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-multus-socket-dir-parent\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477777 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-sysctl-d\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477789 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-cnibin\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477853 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-hostroot\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477854 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-multus-socket-dir-parent\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477898 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-hostroot\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477929 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-var-lib-kubelet\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477936 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-cnibin\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.478366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477956 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf55c\" (UniqueName: \"kubernetes.io/projected/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-kube-api-access-rf55c\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477984 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-var-lib-kubelet\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.477982 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-socket-dir\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478014 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65d16ac8-a186-4b01-af64-a1178eb64830-cnibin\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478043 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-systemd\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478082 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-multus-cni-dir\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478094 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65d16ac8-a186-4b01-af64-a1178eb64830-cnibin\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478110 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65d16ac8-a186-4b01-af64-a1178eb64830-cni-binary-copy\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478137 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-systemd\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478143 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65d16ac8-a186-4b01-af64-a1178eb64830-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478164 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-cni-binary-copy\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478168 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478215 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-sysctl-conf\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478241 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-lib-modules\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478248 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-multus-daemon-config\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478271 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478270 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28x7m\" (UniqueName: \"kubernetes.io/projected/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-kube-api-access-28x7m\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.479264 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478298 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-sys\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478307 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65d16ac8-a186-4b01-af64-a1178eb64830-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478318 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-run-netns\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478345 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-host-run-netns\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478186 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-multus-cni-dir\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478347 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-etc-kubernetes\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478386 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-etc-kubernetes\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478390 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-lib-modules\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478392 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-sys\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478358 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-sysctl-conf\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478395 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-tmp\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478498 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-system-cni-dir\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478515 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478529 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-run\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-var-lib-kubelet\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478568 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-run\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478582 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-system-cni-dir\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.480039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478610 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxjkg\" (UniqueName: \"kubernetes.io/projected/4f8d803f-7f02-4da7-9bca-04ab104246a7-kube-api-access-vxjkg\") pod \"node-ca-sbnt5\" (UID: \"4f8d803f-7f02-4da7-9bca-04ab104246a7\") " pod="openshift-image-registry/node-ca-sbnt5" Jul 28 06:51:25.480953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478617 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-var-lib-kubelet\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478641 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-sys-fs\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.480953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478669 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-sysconfig\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478697 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-kubernetes\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478716 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3af08d58-d360-4ab2-bfd8-4320061d1e7f-sys-fs\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.480953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478750 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-sysconfig\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.478778 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-kubernetes\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.480953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.480691 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65d16ac8-a186-4b01-af64-a1178eb64830-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.480953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.480700 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65d16ac8-a186-4b01-af64-a1178eb64830-cni-binary-copy\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.481305 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.481058 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65d16ac8-a186-4b01-af64-a1178eb64830-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.481305 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.481060 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-etc-tuned\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.481864 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.481819 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-tmp\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.486940 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.486917 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxjkg\" (UniqueName: \"kubernetes.io/projected/4f8d803f-7f02-4da7-9bca-04ab104246a7-kube-api-access-vxjkg\") pod \"node-ca-sbnt5\" (UID: \"4f8d803f-7f02-4da7-9bca-04ab104246a7\") " pod="openshift-image-registry/node-ca-sbnt5" Jul 28 06:51:25.487064 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.487042 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bphl\" (UniqueName: \"kubernetes.io/projected/65d16ac8-a186-4b01-af64-a1178eb64830-kube-api-access-2bphl\") pod \"multus-additional-cni-plugins-cv4p9\" (UID: \"65d16ac8-a186-4b01-af64-a1178eb64830\") " pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.487156 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.487136 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28x7m\" (UniqueName: \"kubernetes.io/projected/c7f3b871-a2a5-4419-a2ad-cd6cd64913d5-kube-api-access-28x7m\") pod \"tuned-lxc6x\" (UID: \"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5\") " pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.487899 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.487879 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8tc9\" (UniqueName: \"kubernetes.io/projected/3af08d58-d360-4ab2-bfd8-4320061d1e7f-kube-api-access-l8tc9\") pod \"aws-ebs-csi-driver-node-mm9kf\" (UID: \"3af08d58-d360-4ab2-bfd8-4320061d1e7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.487988 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.487914 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf55c\" (UniqueName: \"kubernetes.io/projected/d8dc0d0e-e243-4869-82b8-d3ab1ec203b6-kube-api-access-rf55c\") pod \"multus-v52f6\" (UID: \"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6\") " pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.563039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.562938 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:25.571917 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.571887 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6f54g" Jul 28 06:51:25.583020 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.582983 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8zrm2" Jul 28 06:51:25.590091 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.590056 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8l97s" Jul 28 06:51:25.598111 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.598075 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sbnt5" Jul 28 06:51:25.605367 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.605337 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cv4p9" Jul 28 06:51:25.613458 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.613432 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v52f6" Jul 28 06:51:25.621036 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.621004 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" Jul 28 06:51:25.626825 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.626796 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" Jul 28 06:51:25.730519 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:25.730484 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f3b871_a2a5_4419_a2ad_cd6cd64913d5.slice/crio-8901ce9b162f713675ee625317a36aed742991bd7067a1d8232e0d2a677aebaa WatchSource:0}: Error finding container 8901ce9b162f713675ee625317a36aed742991bd7067a1d8232e0d2a677aebaa: Status 404 returned error can't find the container with id 8901ce9b162f713675ee625317a36aed742991bd7067a1d8232e0d2a677aebaa Jul 28 06:51:25.732513 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:25.732428 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d16ac8_a186_4b01_af64_a1178eb64830.slice/crio-34c4d447ebce8adafc22730e36be0bf9fba7fab6ac55173281d8e0df78ecf0ab WatchSource:0}: Error finding container 34c4d447ebce8adafc22730e36be0bf9fba7fab6ac55173281d8e0df78ecf0ab: Status 404 returned error can't find the container with id 34c4d447ebce8adafc22730e36be0bf9fba7fab6ac55173281d8e0df78ecf0ab Jul 28 06:51:25.735537 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:25.735509 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea272cb3_32b4_4d87_a15f_0a2be6dc8d06.slice/crio-48d5cdfe7a2407f7d6255c8878c2cc01fe44036d7679ebb08ceb0111556e7de2 WatchSource:0}: Error finding container 48d5cdfe7a2407f7d6255c8878c2cc01fe44036d7679ebb08ceb0111556e7de2: Status 404 returned error can't find the container with id 48d5cdfe7a2407f7d6255c8878c2cc01fe44036d7679ebb08ceb0111556e7de2 Jul 28 06:51:25.736742 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:25.736714 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c04fab_c090_48db_903a_41b4abd0ee63.slice/crio-6ca333c1ac0df1b7080082312e45d25019b5591a32589b73f888c343eacba983 WatchSource:0}: Error finding container 6ca333c1ac0df1b7080082312e45d25019b5591a32589b73f888c343eacba983: Status 404 returned error can't find the container with id 6ca333c1ac0df1b7080082312e45d25019b5591a32589b73f888c343eacba983 Jul 28 06:51:25.738010 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:25.737985 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8d803f_7f02_4da7_9bca_04ab104246a7.slice/crio-8baa92e54f9ad1a59a890dfa82b914269c8d7a74773a0e542685ac7f6c89419e WatchSource:0}: Error finding container 8baa92e54f9ad1a59a890dfa82b914269c8d7a74773a0e542685ac7f6c89419e: Status 404 returned error can't find the container with id 8baa92e54f9ad1a59a890dfa82b914269c8d7a74773a0e542685ac7f6c89419e Jul 28 06:51:25.739426 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:25.739363 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af08d58_d360_4ab2_bfd8_4320061d1e7f.slice/crio-5e9e5fd39cbffc225b6731f65fc40a636da39066a1bed92a98bda569e7084335 WatchSource:0}: Error finding container 5e9e5fd39cbffc225b6731f65fc40a636da39066a1bed92a98bda569e7084335: Status 404 returned error can't find the container with id 5e9e5fd39cbffc225b6731f65fc40a636da39066a1bed92a98bda569e7084335 Jul 28 06:51:25.741728 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:25.741372 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e64e45e_2297_46a0_977d_510debf6875a.slice/crio-5a8019b8e80beb655669947507bc146b5d76921ddde82a565889b1411ab724a8 WatchSource:0}: Error finding container 5a8019b8e80beb655669947507bc146b5d76921ddde82a565889b1411ab724a8: Status 404 returned error can't find the container with id 5a8019b8e80beb655669947507bc146b5d76921ddde82a565889b1411ab724a8 Jul 28 06:51:25.742189 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:51:25.742057 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb4bd44_8dcd_44b4_b252_68ea1f99aca9.slice/crio-9ff8c12c0510d52666a492435b817511c00b9a2682869ae61c5a21401983725b WatchSource:0}: Error finding container 9ff8c12c0510d52666a492435b817511c00b9a2682869ae61c5a21401983725b: Status 404 returned error can't find the container with id 9ff8c12c0510d52666a492435b817511c00b9a2682869ae61c5a21401983725b Jul 28 06:51:25.881292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.881205 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:25.881292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.881269 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:25.881474 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.881326 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:25.881474 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.881413 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs podName:03922df9-9b4e-4dec-80de-12e819531552 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:26.881385033 +0000 UTC m=+3.986075123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs") pod "network-metrics-daemon-jkdfq" (UID: "03922df9-9b4e-4dec-80de-12e819531552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:25.881474 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.881445 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:25.881616 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.881513 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret podName:6cbb34ff-cb3d-4f84-92f3-8a72dbb938de nodeName:}" failed. No retries permitted until 2026-07-28 06:51:26.881491905 +0000 UTC m=+3.986181994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret") pod "global-pull-secret-syncer-ltj9k" (UID: "6cbb34ff-cb3d-4f84-92f3-8a72dbb938de") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:25.982104 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:25.981824 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txfb\" (UniqueName: \"kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb\") pod \"network-check-target-j8vjh\" (UID: \"15292834-c484-4c15-9ab0-a9f85d854b6d\") " pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:25.982248 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.982016 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:51:25.982248 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.982164 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:51:25.982248 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.982182 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8txfb for pod openshift-network-diagnostics/network-check-target-j8vjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:25.982409 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:25.982256 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb podName:15292834-c484-4c15-9ab0-a9f85d854b6d nodeName:}" failed. No retries permitted until 2026-07-28 06:51:26.982236398 +0000 UTC m=+4.086926491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8txfb" (UniqueName: "kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb") pod "network-check-target-j8vjh" (UID: "15292834-c484-4c15-9ab0-a9f85d854b6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:26.304892 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.304690 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 06:46:25 +0000 UTC" deadline="2028-04-06 22:23:29.54543651 +0000 UTC" Jul 28 06:51:26.304892 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.304782 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14847h32m3.240659472s" Jul 28 06:51:26.432683 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.431714 2554 generic.go:356] "Generic (PLEG): container finished" podID="5742a08682b14dec412b7167019da7bd" containerID="917f6a96c5014cb845fc555de4e2a46df034c1976e610a516f096fa37820e2dc" exitCode=0 Jul 28 06:51:26.432683 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.431844 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" event={"ID":"5742a08682b14dec412b7167019da7bd","Type":"ContainerDied","Data":"917f6a96c5014cb845fc555de4e2a46df034c1976e610a516f096fa37820e2dc"} Jul 28 06:51:26.444711 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.444665 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" event={"ID":"44c04fab-c090-48db-903a-41b4abd0ee63","Type":"ContainerStarted","Data":"6ca333c1ac0df1b7080082312e45d25019b5591a32589b73f888c343eacba983"} Jul 28 06:51:26.450218 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.450123 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" event={"ID":"3af08d58-d360-4ab2-bfd8-4320061d1e7f","Type":"ContainerStarted","Data":"5e9e5fd39cbffc225b6731f65fc40a636da39066a1bed92a98bda569e7084335"} Jul 28 06:51:26.459448 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.459367 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cv4p9" event={"ID":"65d16ac8-a186-4b01-af64-a1178eb64830","Type":"ContainerStarted","Data":"34c4d447ebce8adafc22730e36be0bf9fba7fab6ac55173281d8e0df78ecf0ab"} Jul 28 06:51:26.463720 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.463647 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" event={"ID":"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5","Type":"ContainerStarted","Data":"8901ce9b162f713675ee625317a36aed742991bd7067a1d8232e0d2a677aebaa"} Jul 28 06:51:26.466256 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.466162 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v52f6" event={"ID":"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6","Type":"ContainerStarted","Data":"e6b3b0bd414e30c45d0afb164ee768022da1e55e29afce681d996b1befbfcbf6"} Jul 28 06:51:26.468763 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.468683 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8l97s" event={"ID":"0fb4bd44-8dcd-44b4-b252-68ea1f99aca9","Type":"ContainerStarted","Data":"9ff8c12c0510d52666a492435b817511c00b9a2682869ae61c5a21401983725b"} Jul 28 06:51:26.476277 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.476241 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8zrm2" event={"ID":"1e64e45e-2297-46a0-977d-510debf6875a","Type":"ContainerStarted","Data":"5a8019b8e80beb655669947507bc146b5d76921ddde82a565889b1411ab724a8"} Jul 28 06:51:26.478619 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.478587 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sbnt5" event={"ID":"4f8d803f-7f02-4da7-9bca-04ab104246a7","Type":"ContainerStarted","Data":"8baa92e54f9ad1a59a890dfa82b914269c8d7a74773a0e542685ac7f6c89419e"} Jul 28 06:51:26.480593 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.480563 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6f54g" event={"ID":"ea272cb3-32b4-4d87-a15f-0a2be6dc8d06","Type":"ContainerStarted","Data":"48d5cdfe7a2407f7d6255c8878c2cc01fe44036d7679ebb08ceb0111556e7de2"} Jul 28 06:51:26.892307 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.892211 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:26.892307 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.892265 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:26.892598 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:26.892431 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:26.892598 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:26.892501 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret podName:6cbb34ff-cb3d-4f84-92f3-8a72dbb938de nodeName:}" failed. No retries permitted until 2026-07-28 06:51:28.892481548 +0000 UTC m=+5.997171638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret") pod "global-pull-secret-syncer-ltj9k" (UID: "6cbb34ff-cb3d-4f84-92f3-8a72dbb938de") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:26.892730 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:26.892658 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:26.892730 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:26.892706 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs podName:03922df9-9b4e-4dec-80de-12e819531552 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:28.89268891 +0000 UTC m=+5.997379001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs") pod "network-metrics-daemon-jkdfq" (UID: "03922df9-9b4e-4dec-80de-12e819531552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:26.993381 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:26.993327 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txfb\" (UniqueName: \"kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb\") pod \"network-check-target-j8vjh\" (UID: \"15292834-c484-4c15-9ab0-a9f85d854b6d\") " pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:26.993632 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:26.993584 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:51:26.993632 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:26.993608 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:51:26.993632 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:26.993622 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8txfb for pod openshift-network-diagnostics/network-check-target-j8vjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:26.993805 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:26.993686 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb podName:15292834-c484-4c15-9ab0-a9f85d854b6d nodeName:}" failed. No retries permitted until 2026-07-28 06:51:28.993666685 +0000 UTC m=+6.098356798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8txfb" (UniqueName: "kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb") pod "network-check-target-j8vjh" (UID: "15292834-c484-4c15-9ab0-a9f85d854b6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:27.305515 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:27.305408 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 06:46:25 +0000 UTC" deadline="2028-02-04 06:54:55.944710648 +0000 UTC" Jul 28 06:51:27.305515 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:27.305458 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13344h3m28.639258175s" Jul 28 06:51:27.416740 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:27.416707 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:27.417015 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:27.416885 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:27.417396 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:27.417375 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:27.417517 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:27.417494 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:27.417612 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:27.417569 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:27.417761 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:27.417651 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:27.503136 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:27.503093 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" event={"ID":"5742a08682b14dec412b7167019da7bd","Type":"ContainerStarted","Data":"585cec2ec5695063c09584932c3297ad0935fd95bc58671d3bf5db4e664f2a67"} Jul 28 06:51:27.527936 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:27.527852 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-140.ec2.internal" podStartSLOduration=2.527829313 podStartE2EDuration="2.527829313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:51:27.527191094 +0000 UTC m=+4.631881208" watchObservedRunningTime="2026-07-28 06:51:27.527829313 +0000 UTC m=+4.632519418" Jul 28 06:51:28.913566 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:28.913519 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:28.914094 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:28.913584 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:28.914094 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:28.913792 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:28.914094 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:28.913881 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret podName:6cbb34ff-cb3d-4f84-92f3-8a72dbb938de nodeName:}" failed. No retries permitted until 2026-07-28 06:51:32.913862065 +0000 UTC m=+10.018552160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret") pod "global-pull-secret-syncer-ltj9k" (UID: "6cbb34ff-cb3d-4f84-92f3-8a72dbb938de") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:28.914385 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:28.914364 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:28.914446 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:28.914432 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs podName:03922df9-9b4e-4dec-80de-12e819531552 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:32.914413424 +0000 UTC m=+10.019103519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs") pod "network-metrics-daemon-jkdfq" (UID: "03922df9-9b4e-4dec-80de-12e819531552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:29.014961 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:29.014918 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txfb\" (UniqueName: \"kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb\") pod \"network-check-target-j8vjh\" (UID: \"15292834-c484-4c15-9ab0-a9f85d854b6d\") " pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:29.015158 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:29.015119 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:51:29.015158 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:29.015140 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:51:29.015158 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:29.015156 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8txfb for pod openshift-network-diagnostics/network-check-target-j8vjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:29.015328 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:29.015223 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb podName:15292834-c484-4c15-9ab0-a9f85d854b6d nodeName:}" failed. No retries permitted until 2026-07-28 06:51:33.015203329 +0000 UTC m=+10.119893423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8txfb" (UniqueName: "kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb") pod "network-check-target-j8vjh" (UID: "15292834-c484-4c15-9ab0-a9f85d854b6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:29.414561 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:29.414514 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:29.414784 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:29.414661 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:29.415058 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:29.414514 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:29.415058 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:29.414891 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:29.415058 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:29.415015 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:29.415274 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:29.415119 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:31.413714 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:31.413679 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:31.414224 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:31.413845 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:31.414224 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:31.413944 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:31.414224 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:31.414060 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:31.414224 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:31.414090 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:31.414224 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:31.414171 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:32.952077 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:32.952040 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:32.952077 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:32.952088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:32.952612 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:32.952234 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:32.952612 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:32.952236 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:32.952612 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:32.952307 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs podName:03922df9-9b4e-4dec-80de-12e819531552 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:40.952285988 +0000 UTC m=+18.056976090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs") pod "network-metrics-daemon-jkdfq" (UID: "03922df9-9b4e-4dec-80de-12e819531552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:32.952612 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:32.952339 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret podName:6cbb34ff-cb3d-4f84-92f3-8a72dbb938de nodeName:}" failed. No retries permitted until 2026-07-28 06:51:40.952322665 +0000 UTC m=+18.057012761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret") pod "global-pull-secret-syncer-ltj9k" (UID: "6cbb34ff-cb3d-4f84-92f3-8a72dbb938de") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:33.053005 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:33.052968 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txfb\" (UniqueName: \"kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb\") pod \"network-check-target-j8vjh\" (UID: \"15292834-c484-4c15-9ab0-a9f85d854b6d\") " pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:33.053190 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:33.053171 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:51:33.053273 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:33.053196 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:51:33.053273 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:33.053210 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8txfb for pod openshift-network-diagnostics/network-check-target-j8vjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:33.053377 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:33.053279 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb podName:15292834-c484-4c15-9ab0-a9f85d854b6d nodeName:}" failed. No retries permitted until 2026-07-28 06:51:41.053258051 +0000 UTC m=+18.157948146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8txfb" (UniqueName: "kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb") pod "network-check-target-j8vjh" (UID: "15292834-c484-4c15-9ab0-a9f85d854b6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:33.415383 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:33.415306 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:33.415539 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:33.415430 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:33.415539 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:33.415524 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:33.415680 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:33.415654 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:33.415777 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:33.415742 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:33.415883 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:33.415861 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:35.414022 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:35.413974 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:35.414433 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:35.413974 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:35.414433 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:35.414103 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:35.414433 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:35.414215 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:35.414433 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:35.414262 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:35.414433 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:35.414328 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:37.414358 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:37.414321 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:37.414796 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:37.414322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:37.414796 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:37.414442 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:37.414796 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:37.414533 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:37.414796 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:37.414333 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:37.414796 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:37.414618 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:39.414256 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:39.414220 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:39.414256 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:39.414245 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:39.414739 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:39.414221 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:39.414739 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:39.414399 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:39.414739 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:39.414449 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:39.414739 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:39.414542 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:41.013625 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:41.013586 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:41.013625 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:41.013632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:41.014204 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:41.013745 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:41.014204 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:41.013808 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:41.014204 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:41.013828 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs podName:03922df9-9b4e-4dec-80de-12e819531552 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:57.013809447 +0000 UTC m=+34.118499545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs") pod "network-metrics-daemon-jkdfq" (UID: "03922df9-9b4e-4dec-80de-12e819531552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:41.014204 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:41.013864 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret podName:6cbb34ff-cb3d-4f84-92f3-8a72dbb938de nodeName:}" failed. No retries permitted until 2026-07-28 06:51:57.013847651 +0000 UTC m=+34.118537753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret") pod "global-pull-secret-syncer-ltj9k" (UID: "6cbb34ff-cb3d-4f84-92f3-8a72dbb938de") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:41.114162 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:41.114123 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txfb\" (UniqueName: \"kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb\") pod \"network-check-target-j8vjh\" (UID: \"15292834-c484-4c15-9ab0-a9f85d854b6d\") " pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:41.114325 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:41.114268 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:51:41.114325 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:41.114281 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:51:41.114325 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:41.114290 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8txfb for pod openshift-network-diagnostics/network-check-target-j8vjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:41.114444 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:41.114340 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb podName:15292834-c484-4c15-9ab0-a9f85d854b6d nodeName:}" failed. No retries permitted until 2026-07-28 06:51:57.114327079 +0000 UTC m=+34.219017168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8txfb" (UniqueName: "kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb") pod "network-check-target-j8vjh" (UID: "15292834-c484-4c15-9ab0-a9f85d854b6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:41.413821 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:41.413716 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:41.413821 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:41.413716 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:41.414052 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:41.413737 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:41.414052 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:41.413889 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:41.414052 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:41.413995 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:41.414186 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:41.414070 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:43.414632 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:43.414598 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:43.415189 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:43.414709 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:43.415189 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:43.414714 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:43.415189 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:43.414737 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:43.415189 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:43.414881 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:43.415189 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:43.414945 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:45.413900 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:45.413863 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:45.414402 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:45.413864 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:45.414402 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:45.414002 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:45.414402 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:45.413869 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:45.414402 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:45.414054 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:45.414402 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:45.414119 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:46.545108 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.544722 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-140.ec2.internal" event={"ID":"a16892ee32f85011fc1a1806c8666fbf","Type":"ContainerStarted","Data":"30d6ab1b9837425d4c7cb225cbfafec07fca89ba48e11cdade93e61c61f8198c"} Jul 28 06:51:46.546833 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.546816 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovn-acl-logging/0.log" Jul 28 06:51:46.547132 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.547113 2554 generic.go:356] "Generic (PLEG): container finished" podID="44c04fab-c090-48db-903a-41b4abd0ee63" containerID="9f8443a801cf1fe450ab882d90b571dbb48853a13f0da4fe99157a772c7b8e64" exitCode=1 Jul 28 06:51:46.547193 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.547177 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" event={"ID":"44c04fab-c090-48db-903a-41b4abd0ee63","Type":"ContainerStarted","Data":"57b5a86b48ed6843ebd1d5e45f38843e20f59ada574521195e5cc3fab54a077e"} Jul 28 06:51:46.547253 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.547238 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" event={"ID":"44c04fab-c090-48db-903a-41b4abd0ee63","Type":"ContainerStarted","Data":"50a93d024147483d5ef480d9039471bbadd8c5e491b29f853405b1d40ea31741"} Jul 28 06:51:46.547298 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.547283 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" event={"ID":"44c04fab-c090-48db-903a-41b4abd0ee63","Type":"ContainerDied","Data":"9f8443a801cf1fe450ab882d90b571dbb48853a13f0da4fe99157a772c7b8e64"} Jul 28 06:51:46.547345 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.547318 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" event={"ID":"44c04fab-c090-48db-903a-41b4abd0ee63","Type":"ContainerStarted","Data":"0c1b276bf3d528990ef6e04e2bae6648681da62a91b47734d582d6833e07f78b"} Jul 28 06:51:46.548537 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.548518 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" event={"ID":"3af08d58-d360-4ab2-bfd8-4320061d1e7f","Type":"ContainerStarted","Data":"2d05240a18944cbdce2b1401a5ffc3a9bdf201d1126a8231d9f9fe76c37423d3"} Jul 28 06:51:46.550004 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.549983 2554 generic.go:356] "Generic (PLEG): container finished" podID="65d16ac8-a186-4b01-af64-a1178eb64830" containerID="b748646eb930a41f5c87fc1be81260bdc4e18c6896596623d65aaed277609464" exitCode=0 Jul 28 06:51:46.550093 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.550075 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cv4p9" event={"ID":"65d16ac8-a186-4b01-af64-a1178eb64830","Type":"ContainerDied","Data":"b748646eb930a41f5c87fc1be81260bdc4e18c6896596623d65aaed277609464"} Jul 28 06:51:46.551649 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.551620 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" event={"ID":"c7f3b871-a2a5-4419-a2ad-cd6cd64913d5","Type":"ContainerStarted","Data":"2b8f6edfff82b9675a9b889edf02dd18419f33d957c260c45387693bc2b67fc9"} Jul 28 06:51:46.553172 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.553148 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v52f6" event={"ID":"d8dc0d0e-e243-4869-82b8-d3ab1ec203b6","Type":"ContainerStarted","Data":"a0445edf16e6b768ecb1256056f3434e81164d87b53a85047d3cf683ef7f34d8"} Jul 28 06:51:46.554674 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.554610 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8l97s" event={"ID":"0fb4bd44-8dcd-44b4-b252-68ea1f99aca9","Type":"ContainerStarted","Data":"4fefe1a245fb6fc150f5690fb3eaf45e5623682746b7516c2e89efaac85245fe"} Jul 28 06:51:46.556036 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.556011 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sbnt5" event={"ID":"4f8d803f-7f02-4da7-9bca-04ab104246a7","Type":"ContainerStarted","Data":"385ab9d85ece45ce19f79057dffabd698e64ec9bf55247719cf6c8874769805b"} Jul 28 06:51:46.557572 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.557555 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6f54g" event={"ID":"ea272cb3-32b4-4d87-a15f-0a2be6dc8d06","Type":"ContainerStarted","Data":"7f102db09ed857e2679f9473b37f8273c1a741d0276205a733ca1bba0dd49f0f"} Jul 28 06:51:46.559530 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.559496 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-140.ec2.internal" podStartSLOduration=21.559484395 podStartE2EDuration="21.559484395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:51:46.559185609 +0000 UTC m=+23.663875718" watchObservedRunningTime="2026-07-28 06:51:46.559484395 +0000 UTC m=+23.664174505" Jul 28 06:51:46.596736 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.596683 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v52f6" podStartSLOduration=2.8237267040000003 podStartE2EDuration="22.596669693s" totalImagesPullingTime="19.772942989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:51:46.59612898 +0000 UTC m=+23.700819090" watchObservedRunningTime="2026-07-28 06:51:46.596669693 +0000 UTC m=+23.701359802" Jul 28 06:51:46.612599 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.612543 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lxc6x" podStartSLOduration=2.850138914 podStartE2EDuration="22.61252733s" totalImagesPullingTime="19.762388416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:51:46.612120859 +0000 UTC m=+23.716810969" watchObservedRunningTime="2026-07-28 06:51:46.61252733 +0000 UTC m=+23.717217440" Jul 28 06:51:46.626633 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.626533 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6f54g" podStartSLOduration=2.87179769 podStartE2EDuration="22.626511406s" totalImagesPullingTime="19.754713716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:51:46.625827802 +0000 UTC m=+23.730517905" watchObservedRunningTime="2026-07-28 06:51:46.626511406 +0000 UTC m=+23.731201516" Jul 28 06:51:46.649671 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.649612 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8l97s" podStartSLOduration=2.921963214 podStartE2EDuration="22.649596663s" totalImagesPullingTime="19.727633449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:51:46.649521474 +0000 UTC m=+23.754211587" watchObservedRunningTime="2026-07-28 06:51:46.649596663 +0000 UTC m=+23.754286772" Jul 28 06:51:46.673041 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:46.672982 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sbnt5" podStartSLOduration=2.920845055 podStartE2EDuration="22.67296059s" totalImagesPullingTime="19.752115535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:51:46.67231234 +0000 UTC m=+23.777002449" watchObservedRunningTime="2026-07-28 06:51:46.67296059 +0000 UTC m=+23.777650703" Jul 28 06:51:47.150184 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.150157 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 06:51:47.343022 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.342918 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T06:51:47.150177734Z","UUID":"35b8c49a-e3d4-4491-a187-34eb786accb9","Handler":null,"Name":"","Endpoint":""} Jul 28 06:51:47.344622 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.344588 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 06:51:47.344622 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.344628 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 06:51:47.413638 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.413604 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:47.413893 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.413656 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:47.413893 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.413609 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:47.413893 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:47.413741 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:47.413893 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:47.413844 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:47.414107 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:47.413942 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:47.562048 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.562002 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8zrm2" event={"ID":"1e64e45e-2297-46a0-977d-510debf6875a","Type":"ContainerStarted","Data":"0f0083b5f9abd4f685ca376a09cfa70395e30a780331d4dbb59edbaf5bf0c282"} Jul 28 06:51:47.565377 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.565340 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovn-acl-logging/0.log" Jul 28 06:51:47.565885 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.565859 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" event={"ID":"44c04fab-c090-48db-903a-41b4abd0ee63","Type":"ContainerStarted","Data":"25bc5a3b85858defef8a192d77371f6863705b2a3de14fa91c18c9419f06865e"} Jul 28 06:51:47.565995 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.565943 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" event={"ID":"44c04fab-c090-48db-903a-41b4abd0ee63","Type":"ContainerStarted","Data":"9ee776de0e65b2b753a15d3253ef8b777d6717c89dc30d5e45f54e8b765fd6a4"} Jul 28 06:51:47.568250 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.568226 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" event={"ID":"3af08d58-d360-4ab2-bfd8-4320061d1e7f","Type":"ContainerStarted","Data":"267b9df84975c2430883156721fff04422ce7cb4638660dcc41e60ab60b536b6"} Jul 28 06:51:47.576890 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:47.576848 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8zrm2" podStartSLOduration=3.847407527 podStartE2EDuration="23.576833675s" totalImagesPullingTime="19.729426148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:51:47.576503886 +0000 UTC m=+24.681193997" watchObservedRunningTime="2026-07-28 06:51:47.576833675 +0000 UTC m=+24.681523808" Jul 28 06:51:48.572709 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:48.572665 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" event={"ID":"3af08d58-d360-4ab2-bfd8-4320061d1e7f","Type":"ContainerStarted","Data":"1ace71d61a4161812d202ea996469d8d3e9220f2e22b2a349b0c8fe07df117cd"} Jul 28 06:51:49.413920 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:49.413698 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:49.414156 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:49.413698 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:49.414156 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:49.414014 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:49.414156 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:49.413698 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:49.414322 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:49.414112 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:49.414322 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:49.414286 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:49.578447 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:49.578422 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovn-acl-logging/0.log" Jul 28 06:51:49.578941 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:49.578903 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" event={"ID":"44c04fab-c090-48db-903a-41b4abd0ee63","Type":"ContainerStarted","Data":"8f50b93e7dcdd075a89faeec9db52aaaed17e21eb62adeeb74a52723c6af34ab"} Jul 28 06:51:49.725612 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:49.725530 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8l97s" Jul 28 06:51:49.726317 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:49.726295 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8l97s" Jul 28 06:51:49.742088 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:49.742032 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9kf" podStartSLOduration=3.461443957 podStartE2EDuration="25.7420143s" totalImagesPullingTime="22.280570343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:51:48.589814689 +0000 UTC m=+25.694504802" watchObservedRunningTime="2026-07-28 06:51:49.7420143 +0000 UTC m=+26.846704416" Jul 28 06:51:50.580975 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:50.580946 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8l97s" Jul 28 06:51:50.581503 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:50.581421 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8l97s" Jul 28 06:51:51.413985 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.413795 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:51.414129 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.413801 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:51.414129 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:51.414071 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:51.414227 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:51.414179 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:51.414227 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.413863 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:51.414323 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:51.414304 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:51.585803 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.585689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovn-acl-logging/0.log" Jul 28 06:51:51.586505 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.586119 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" event={"ID":"44c04fab-c090-48db-903a-41b4abd0ee63","Type":"ContainerStarted","Data":"4da73f63353aee17680c448e2d3a377fe2d41770824f4c92fbba820b2c73993e"} Jul 28 06:51:51.586505 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.586364 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:51.586505 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.586444 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:51.586505 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.586479 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:51.586654 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.586633 2554 scope.go:117] "RemoveContainer" containerID="9f8443a801cf1fe450ab882d90b571dbb48853a13f0da4fe99157a772c7b8e64" Jul 28 06:51:51.588338 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.588318 2554 generic.go:356] "Generic (PLEG): container finished" podID="65d16ac8-a186-4b01-af64-a1178eb64830" containerID="a38e51dee7b13786b2a7b0d716f7622157bcd16084a293838b9a65b60c8d4fd5" exitCode=0 Jul 28 06:51:51.588448 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.588379 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cv4p9" event={"ID":"65d16ac8-a186-4b01-af64-a1178eb64830","Type":"ContainerDied","Data":"a38e51dee7b13786b2a7b0d716f7622157bcd16084a293838b9a65b60c8d4fd5"} Jul 28 06:51:51.604304 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.604282 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:51.604428 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:51.604416 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:51:52.595207 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:52.595181 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovn-acl-logging/0.log" Jul 28 06:51:52.595918 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:52.595615 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" event={"ID":"44c04fab-c090-48db-903a-41b4abd0ee63","Type":"ContainerStarted","Data":"ab04398c2aa4a44059e1c1091cae13fcbb2f32c49bb4ffb8be18e25ca1539d7f"} Jul 28 06:51:52.622063 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:52.621993 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" podStartSLOduration=8.399691422 podStartE2EDuration="28.621973873s" totalImagesPullingTime="20.222282451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:51:52.621484073 +0000 UTC m=+29.726174178" watchObservedRunningTime="2026-07-28 06:51:52.621973873 +0000 UTC m=+29.726663984" Jul 28 06:51:53.392601 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:53.392570 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ltj9k"] Jul 28 06:51:53.392749 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:53.392731 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:53.392892 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:53.392863 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:53.396234 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:53.396203 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jkdfq"] Jul 28 06:51:53.396650 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:53.396335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:53.396650 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:53.396483 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:53.396894 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:53.396876 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j8vjh"] Jul 28 06:51:53.396989 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:53.396968 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:53.397108 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:53.397065 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:53.600322 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:53.600286 2554 generic.go:356] "Generic (PLEG): container finished" podID="65d16ac8-a186-4b01-af64-a1178eb64830" containerID="27382aa8d4627eb593dd59abc18b02200cc9ce628ad67362c771975e7ab02a2a" exitCode=0 Jul 28 06:51:53.600745 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:53.600382 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cv4p9" event={"ID":"65d16ac8-a186-4b01-af64-a1178eb64830","Type":"ContainerDied","Data":"27382aa8d4627eb593dd59abc18b02200cc9ce628ad67362c771975e7ab02a2a"} Jul 28 06:51:54.413737 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:54.413701 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:54.413737 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:54.413728 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:54.413964 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:54.413860 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:54.414004 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:54.413967 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:54.604357 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:54.604322 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cv4p9" event={"ID":"65d16ac8-a186-4b01-af64-a1178eb64830","Type":"ContainerStarted","Data":"5debc09de7120d07cbc10cc56cda129ee6bcf79e79596a71b379025f019f77fc"} Jul 28 06:51:55.413540 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:55.413313 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:55.413707 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:55.413588 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:55.608823 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:55.608791 2554 generic.go:356] "Generic (PLEG): container finished" podID="65d16ac8-a186-4b01-af64-a1178eb64830" containerID="5debc09de7120d07cbc10cc56cda129ee6bcf79e79596a71b379025f019f77fc" exitCode=0 Jul 28 06:51:55.609190 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:55.608837 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cv4p9" event={"ID":"65d16ac8-a186-4b01-af64-a1178eb64830","Type":"ContainerDied","Data":"5debc09de7120d07cbc10cc56cda129ee6bcf79e79596a71b379025f019f77fc"} Jul 28 06:51:56.413925 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:56.413882 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:56.413925 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:56.413916 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:56.414150 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:56.414015 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:56.414150 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:56.414135 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:57.039407 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:57.039370 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:57.039407 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:57.039414 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:57.040173 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:57.039500 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:57.040173 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:57.039559 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:57.040173 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:57.039571 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs podName:03922df9-9b4e-4dec-80de-12e819531552 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:29.039549565 +0000 UTC m=+66.144239655 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs") pod "network-metrics-daemon-jkdfq" (UID: "03922df9-9b4e-4dec-80de-12e819531552") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:57.040173 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:57.039616 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret podName:6cbb34ff-cb3d-4f84-92f3-8a72dbb938de nodeName:}" failed. No retries permitted until 2026-07-28 06:52:29.039599028 +0000 UTC m=+66.144289122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret") pod "global-pull-secret-syncer-ltj9k" (UID: "6cbb34ff-cb3d-4f84-92f3-8a72dbb938de") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:57.140745 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:57.140705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txfb\" (UniqueName: \"kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb\") pod \"network-check-target-j8vjh\" (UID: \"15292834-c484-4c15-9ab0-a9f85d854b6d\") " pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:57.140951 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:57.140887 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:51:57.140951 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:57.140915 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:51:57.140951 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:57.140930 2554 projected.go:196] Error preparing data for projected volume kube-api-access-8txfb for pod openshift-network-diagnostics/network-check-target-j8vjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:57.141112 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:57.141012 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb podName:15292834-c484-4c15-9ab0-a9f85d854b6d nodeName:}" failed. No retries permitted until 2026-07-28 06:52:29.140991891 +0000 UTC m=+66.245681980 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8txfb" (UniqueName: "kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb") pod "network-check-target-j8vjh" (UID: "15292834-c484-4c15-9ab0-a9f85d854b6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:57.413668 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:57.413634 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:57.413881 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:57.413767 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8vjh" podUID="15292834-c484-4c15-9ab0-a9f85d854b6d" Jul 28 06:51:58.413719 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:58.413682 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:51:58.414135 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:58.413848 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdfq" podUID="03922df9-9b4e-4dec-80de-12e819531552" Jul 28 06:51:58.414135 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:58.413900 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:51:58.414135 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:58.414000 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ltj9k" podUID="6cbb34ff-cb3d-4f84-92f3-8a72dbb938de" Jul 28 06:51:59.180671 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.180645 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-140.ec2.internal" event="NodeReady" Jul 28 06:51:59.180877 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.180817 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 06:51:59.221030 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.220996 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bb8d58dd6-5bhvj"] Jul 28 06:51:59.223819 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.223793 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.226627 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.226603 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 06:51:59.226782 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.226603 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 06:51:59.227125 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.227029 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xdvwc\"" Jul 28 06:51:59.231230 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.231202 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 06:51:59.232375 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.232354 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 06:51:59.240153 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.240117 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bb8d58dd6-5bhvj"] Jul 28 06:51:59.243485 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.243460 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-98g5h"] Jul 28 06:51:59.245642 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.245624 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.248888 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.248867 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 06:51:59.249011 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.248992 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 06:51:59.249371 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.249351 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tddhc\"" Jul 28 06:51:59.257798 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.257774 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-98g5h"] Jul 28 06:51:59.348248 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.348187 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pvkjq"] Jul 28 06:51:59.350466 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.350440 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pvkjq" Jul 28 06:51:59.353039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.353014 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 06:51:59.353174 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.353045 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lsj24\"" Jul 28 06:51:59.353174 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.353069 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 06:51:59.353174 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.353056 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 06:51:59.359625 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.359584 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pvkjq"] Jul 28 06:51:59.361601 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.361571 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e2757c8-14cb-46df-901b-d6b1f1076002-ca-trust-extracted\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.361744 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.361621 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.361744 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.361644 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-certificates\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.361744 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.361678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6p4v\" (UniqueName: \"kubernetes.io/projected/020008a7-3d30-42f9-b649-c94fed431d83-kube-api-access-g6p4v\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.361744 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.361718 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e2757c8-14cb-46df-901b-d6b1f1076002-trusted-ca\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.361989 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.361799 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5nrs\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-kube-api-access-z5nrs\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.361989 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.361840 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e2757c8-14cb-46df-901b-d6b1f1076002-image-registry-private-configuration\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.361989 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.361897 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.361989 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.361927 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e2757c8-14cb-46df-901b-d6b1f1076002-installation-pull-secrets\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.361989 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.361976 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-bound-sa-token\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.362289 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.362022 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/020008a7-3d30-42f9-b649-c94fed431d83-config-volume\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.362289 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.362046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/020008a7-3d30-42f9-b649-c94fed431d83-tmp-dir\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.372920 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.372881 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:51:59.414322 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.414293 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:51:59.416996 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.416972 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-982bk\"" Jul 28 06:51:59.416996 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.416987 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 06:51:59.417169 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.416976 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 06:51:59.462706 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.462658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/020008a7-3d30-42f9-b649-c94fed431d83-config-volume\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.462706 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.462705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/020008a7-3d30-42f9-b649-c94fed431d83-tmp-dir\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.462955 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.462797 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e2757c8-14cb-46df-901b-d6b1f1076002-ca-trust-extracted\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.462955 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.462828 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd7e1042-4a95-48b1-a22a-cd1407f09119-cert\") pod \"ingress-canary-pvkjq\" (UID: \"fd7e1042-4a95-48b1-a22a-cd1407f09119\") " pod="openshift-ingress-canary/ingress-canary-pvkjq" Jul 28 06:51:59.462955 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.462868 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.462955 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.462891 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-certificates\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.462955 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.462924 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94dfg\" (UniqueName: \"kubernetes.io/projected/fd7e1042-4a95-48b1-a22a-cd1407f09119-kube-api-access-94dfg\") pod \"ingress-canary-pvkjq\" (UID: \"fd7e1042-4a95-48b1-a22a-cd1407f09119\") " pod="openshift-ingress-canary/ingress-canary-pvkjq" Jul 28 06:51:59.462955 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.462954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6p4v\" (UniqueName: \"kubernetes.io/projected/020008a7-3d30-42f9-b649-c94fed431d83-kube-api-access-g6p4v\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.463202 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.462978 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e2757c8-14cb-46df-901b-d6b1f1076002-trusted-ca\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.463202 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.463007 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5nrs\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-kube-api-access-z5nrs\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.463202 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.463042 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e2757c8-14cb-46df-901b-d6b1f1076002-image-registry-private-configuration\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.463202 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.463076 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.463202 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.463098 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e2757c8-14cb-46df-901b-d6b1f1076002-installation-pull-secrets\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.463202 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.463118 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/020008a7-3d30-42f9-b649-c94fed431d83-tmp-dir\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.463202 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.463137 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-bound-sa-token\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.463504 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.463226 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e2757c8-14cb-46df-901b-d6b1f1076002-ca-trust-extracted\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.463504 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:59.463261 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:51:59.463504 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:59.463318 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls podName:020008a7-3d30-42f9-b649-c94fed431d83 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:59.96329932 +0000 UTC m=+37.067989408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls") pod "dns-default-98g5h" (UID: "020008a7-3d30-42f9-b649-c94fed431d83") : secret "dns-default-metrics-tls" not found Jul 28 06:51:59.463504 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:59.463354 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:51:59.463504 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:59.463371 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb8d58dd6-5bhvj: secret "image-registry-tls" not found Jul 28 06:51:59.463504 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:59.463436 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls podName:0e2757c8-14cb-46df-901b-d6b1f1076002 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:59.963414707 +0000 UTC m=+37.068104800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls") pod "image-registry-bb8d58dd6-5bhvj" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002") : secret "image-registry-tls" not found Jul 28 06:51:59.463504 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.463441 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/020008a7-3d30-42f9-b649-c94fed431d83-config-volume\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.463817 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.463578 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-certificates\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.464197 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.464155 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e2757c8-14cb-46df-901b-d6b1f1076002-trusted-ca\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.467866 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.467842 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e2757c8-14cb-46df-901b-d6b1f1076002-installation-pull-secrets\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.467978 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.467842 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e2757c8-14cb-46df-901b-d6b1f1076002-image-registry-private-configuration\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.471258 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.471212 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-bound-sa-token\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.471623 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.471598 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5nrs\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-kube-api-access-z5nrs\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.471735 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.471608 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6p4v\" (UniqueName: \"kubernetes.io/projected/020008a7-3d30-42f9-b649-c94fed431d83-kube-api-access-g6p4v\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.554643 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.554603 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:51:59.563835 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.563798 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd7e1042-4a95-48b1-a22a-cd1407f09119-cert\") pod \"ingress-canary-pvkjq\" (UID: \"fd7e1042-4a95-48b1-a22a-cd1407f09119\") " pod="openshift-ingress-canary/ingress-canary-pvkjq" Jul 28 06:51:59.563982 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.563866 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94dfg\" (UniqueName: \"kubernetes.io/projected/fd7e1042-4a95-48b1-a22a-cd1407f09119-kube-api-access-94dfg\") pod \"ingress-canary-pvkjq\" (UID: \"fd7e1042-4a95-48b1-a22a-cd1407f09119\") " pod="openshift-ingress-canary/ingress-canary-pvkjq" Jul 28 06:51:59.566421 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.566397 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd7e1042-4a95-48b1-a22a-cd1407f09119-cert\") pod \"ingress-canary-pvkjq\" (UID: \"fd7e1042-4a95-48b1-a22a-cd1407f09119\") " pod="openshift-ingress-canary/ingress-canary-pvkjq" Jul 28 06:51:59.572273 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.572250 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94dfg\" (UniqueName: \"kubernetes.io/projected/fd7e1042-4a95-48b1-a22a-cd1407f09119-kube-api-access-94dfg\") pod \"ingress-canary-pvkjq\" (UID: \"fd7e1042-4a95-48b1-a22a-cd1407f09119\") " pod="openshift-ingress-canary/ingress-canary-pvkjq" Jul 28 06:51:59.657583 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.657500 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:51:59.662331 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.662303 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pvkjq" Jul 28 06:51:59.756110 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.756074 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:51:59.856390 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.856354 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:51:59.966961 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.966810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:51:59.967107 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:51:59.967014 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:51:59.967107 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:59.967058 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:51:59.967107 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:59.967082 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb8d58dd6-5bhvj: secret "image-registry-tls" not found Jul 28 06:51:59.967210 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:59.967128 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:51:59.967210 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:59.967159 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls podName:0e2757c8-14cb-46df-901b-d6b1f1076002 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:00.967139261 +0000 UTC m=+38.071829369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls") pod "image-registry-bb8d58dd6-5bhvj" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002") : secret "image-registry-tls" not found Jul 28 06:51:59.967210 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:51:59.967186 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls podName:020008a7-3d30-42f9-b649-c94fed431d83 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:00.967169295 +0000 UTC m=+38.071859401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls") pod "dns-default-98g5h" (UID: "020008a7-3d30-42f9-b649-c94fed431d83") : secret "dns-default-metrics-tls" not found Jul 28 06:52:00.010380 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.010311 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pvkjq"] Jul 28 06:52:00.015082 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:00.015048 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd7e1042_4a95_48b1_a22a_cd1407f09119.slice/crio-d0ed3d79a58266a5771920ce9467b666473c406be20fd123a487685e976c90d2 WatchSource:0}: Error finding container d0ed3d79a58266a5771920ce9467b666473c406be20fd123a487685e976c90d2: Status 404 returned error can't find the container with id d0ed3d79a58266a5771920ce9467b666473c406be20fd123a487685e976c90d2 Jul 28 06:52:00.413547 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.413509 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:52:00.413721 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.413515 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:52:00.416343 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.416320 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 06:52:00.417290 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.417274 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4jsfj\"" Jul 28 06:52:00.417354 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.417296 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 06:52:00.499371 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.499338 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:00.622321 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.622285 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pvkjq" event={"ID":"fd7e1042-4a95-48b1-a22a-cd1407f09119","Type":"ContainerStarted","Data":"d0ed3d79a58266a5771920ce9467b666473c406be20fd123a487685e976c90d2"} Jul 28 06:52:00.624743 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.624716 2554 generic.go:356] "Generic (PLEG): container finished" podID="65d16ac8-a186-4b01-af64-a1178eb64830" containerID="9a4faf0077cd7b825210ecd14fc42a304c2a4b4dd316f8c9c05541a4fd745b29" exitCode=0 Jul 28 06:52:00.624869 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.624777 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cv4p9" event={"ID":"65d16ac8-a186-4b01-af64-a1178eb64830","Type":"ContainerDied","Data":"9a4faf0077cd7b825210ecd14fc42a304c2a4b4dd316f8c9c05541a4fd745b29"} Jul 28 06:52:00.900176 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.900141 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:00.952435 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.952347 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:00.976280 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.976233 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:52:00.976459 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:00.976305 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:52:00.976459 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:00.976376 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:52:00.976459 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:00.976394 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb8d58dd6-5bhvj: secret "image-registry-tls" not found Jul 28 06:52:00.976459 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:00.976397 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:00.976459 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:00.976460 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls podName:020008a7-3d30-42f9-b649-c94fed431d83 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:02.976441762 +0000 UTC m=+40.081131855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls") pod "dns-default-98g5h" (UID: "020008a7-3d30-42f9-b649-c94fed431d83") : secret "dns-default-metrics-tls" not found Jul 28 06:52:00.976679 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:00.976474 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls podName:0e2757c8-14cb-46df-901b-d6b1f1076002 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:02.976468587 +0000 UTC m=+40.081158676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls") pod "image-registry-bb8d58dd6-5bhvj" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002") : secret "image-registry-tls" not found Jul 28 06:52:01.631446 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:01.631376 2554 generic.go:356] "Generic (PLEG): container finished" podID="65d16ac8-a186-4b01-af64-a1178eb64830" containerID="64910e42c46f5d5eaf94c5ddf885221322e04fb707c392e35572928b256a3f75" exitCode=0 Jul 28 06:52:01.631446 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:01.631437 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cv4p9" event={"ID":"65d16ac8-a186-4b01-af64-a1178eb64830","Type":"ContainerDied","Data":"64910e42c46f5d5eaf94c5ddf885221322e04fb707c392e35572928b256a3f75"} Jul 28 06:52:02.637954 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:02.637909 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cv4p9" event={"ID":"65d16ac8-a186-4b01-af64-a1178eb64830","Type":"ContainerStarted","Data":"b8e2560040cf3623135397750ddf478057faa6992e27cfc16ffcf99cf0a91b9c"} Jul 28 06:52:02.660891 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:02.660821 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cv4p9" podStartSLOduration=8.233362839 podStartE2EDuration="38.66079772s" totalImagesPullingTime="30.427434881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:02.659035898 +0000 UTC m=+39.763726009" watchObservedRunningTime="2026-07-28 06:52:02.66079772 +0000 UTC m=+39.765487833" Jul 28 06:52:02.778809 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:02.778776 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:02.829387 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:02.829354 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:02.996394 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:02.996281 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:52:02.996394 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:02.996358 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:52:02.996696 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:02.996452 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:02.996696 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:02.996518 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls podName:020008a7-3d30-42f9-b649-c94fed431d83 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:06.996502768 +0000 UTC m=+44.101192856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls") pod "dns-default-98g5h" (UID: "020008a7-3d30-42f9-b649-c94fed431d83") : secret "dns-default-metrics-tls" not found Jul 28 06:52:02.996696 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:02.996455 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:52:02.996696 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:02.996551 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb8d58dd6-5bhvj: secret "image-registry-tls" not found Jul 28 06:52:02.996696 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:02.996593 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls podName:0e2757c8-14cb-46df-901b-d6b1f1076002 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:06.996581803 +0000 UTC m=+44.101271891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls") pod "image-registry-bb8d58dd6-5bhvj" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002") : secret "image-registry-tls" not found Jul 28 06:52:03.098979 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:03.098949 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:03.198799 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:03.198767 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:03.298570 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:03.298521 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:03.641316 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:03.641280 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pvkjq" event={"ID":"fd7e1042-4a95-48b1-a22a-cd1407f09119","Type":"ContainerStarted","Data":"a49d6108f941a7d75428eedda570bd78edd520fddc1666e86fd45f8495d23709"} Jul 28 06:52:03.656921 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:03.656870 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pvkjq" podStartSLOduration=1.514592061 podStartE2EDuration="4.656853785s" totalImagesPullingTime="3.142261724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:03.655261399 +0000 UTC m=+40.759951509" watchObservedRunningTime="2026-07-28 06:52:03.656853785 +0000 UTC m=+40.761543905" Jul 28 06:52:04.654689 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.654646 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v59t2"] Jul 28 06:52:04.670821 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.670794 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw"] Jul 28 06:52:04.670955 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.670912 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v59t2" Jul 28 06:52:04.673353 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.673328 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:52:04.673353 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.673345 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 28 06:52:04.673548 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.673328 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g8n4g\"" Jul 28 06:52:04.684704 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.684675 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc"] Jul 28 06:52:04.684864 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.684822 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" Jul 28 06:52:04.687485 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.687460 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 28 06:52:04.687603 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.687589 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 28 06:52:04.687661 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.687591 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 28 06:52:04.687661 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.687645 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:52:04.687774 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.687682 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-q2kwq\"" Jul 28 06:52:04.706737 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.706709 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v59t2"] Jul 28 06:52:04.706737 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.706744 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-pz549"] Jul 28 06:52:04.706914 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.706837 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:04.709403 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.709380 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 06:52:04.710647 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.710629 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 28 06:52:04.710647 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.710642 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 28 06:52:04.710785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.710744 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 06:52:04.719169 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.719147 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hd5kp\"" Jul 28 06:52:04.730965 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.730939 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc"] Jul 28 06:52:04.731071 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.730975 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw"] Jul 28 06:52:04.731071 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.730999 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-pz549"] Jul 28 06:52:04.731142 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.731080 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:04.733484 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.733469 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 28 06:52:04.733681 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.733667 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 06:52:04.733834 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.733817 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 28 06:52:04.733921 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.733828 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bfmlb\"" Jul 28 06:52:04.733921 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.733878 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 06:52:04.738183 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.738165 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 28 06:52:04.755710 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.755683 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-pjwt8"] Jul 28 06:52:04.765326 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.765302 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w"] Jul 28 06:52:04.765449 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.765434 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:04.768551 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.768519 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 06:52:04.768674 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.768556 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 06:52:04.768674 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.768587 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 06:52:04.768674 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.768530 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:52:04.768674 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.768625 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8vsj8\"" Jul 28 06:52:04.776829 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.775377 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-777cfd8465-gqkwd"] Jul 28 06:52:04.777356 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.777335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:04.780267 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.780243 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 06:52:04.780380 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.780294 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 06:52:04.780508 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.780487 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sr2gn\"" Jul 28 06:52:04.780865 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.780845 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 06:52:04.781583 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.781567 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:52:04.789468 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.789448 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-pjwt8"] Jul 28 06:52:04.789562 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.789479 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w"] Jul 28 06:52:04.789562 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.789496 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-777cfd8465-gqkwd"] Jul 28 06:52:04.789673 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.789575 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:04.792277 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.792252 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 28 06:52:04.792277 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.792260 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 06:52:04.792277 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.792268 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 28 06:52:04.792277 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.792275 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 28 06:52:04.792554 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.792345 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 06:52:04.792554 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.792346 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v657k\"" Jul 28 06:52:04.792634 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.792582 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 28 06:52:04.808355 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.808327 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-757q4\" (UniqueName: \"kubernetes.io/projected/8f79ab98-bd74-484b-a89e-1c92e1648192-kube-api-access-757q4\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:04.808355 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.808355 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81-serving-cert\") pod \"service-ca-operator-5d6c75f84f-cb5vw\" (UID: \"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" Jul 28 06:52:04.808535 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.808381 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2s8w\" (UniqueName: \"kubernetes.io/projected/b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81-kube-api-access-r2s8w\") pod \"service-ca-operator-5d6c75f84f-cb5vw\" (UID: \"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" Jul 28 06:52:04.808579 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.808555 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:04.808619 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.808589 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdx7t\" (UniqueName: \"kubernetes.io/projected/60ae09ae-e158-4dfa-a8be-b6749a669ca9-kube-api-access-vdx7t\") pod \"volume-data-source-validator-549c6d54cf-v59t2\" (UID: \"60ae09ae-e158-4dfa-a8be-b6749a669ca9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v59t2" Jul 28 06:52:04.808619 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.808608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81-config\") pod \"service-ca-operator-5d6c75f84f-cb5vw\" (UID: \"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" Jul 28 06:52:04.808784 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.808744 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8f79ab98-bd74-484b-a89e-1c92e1648192-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:04.858666 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.858635 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-9vqrc"] Jul 28 06:52:04.879349 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.879323 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh"] Jul 28 06:52:04.879501 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.879446 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9vqrc" Jul 28 06:52:04.881830 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.881808 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qzxd4\"" Jul 28 06:52:04.901554 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.901508 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-9vqrc"] Jul 28 06:52:04.901554 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.901555 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh"] Jul 28 06:52:04.901781 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.901634 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" Jul 28 06:52:04.902402 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.902378 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:04.904291 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.904269 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 06:52:04.904371 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.904322 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 06:52:04.904371 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.904272 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 06:52:04.904492 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.904473 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:52:04.904548 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.904534 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9r5tg\"" Jul 28 06:52:04.909053 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909035 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-757q4\" (UniqueName: \"kubernetes.io/projected/8f79ab98-bd74-484b-a89e-1c92e1648192-kube-api-access-757q4\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:04.909148 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909057 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81-serving-cert\") pod \"service-ca-operator-5d6c75f84f-cb5vw\" (UID: \"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" Jul 28 06:52:04.909148 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909082 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rkkd\" (UniqueName: \"kubernetes.io/projected/fb639d17-03f1-4d5a-ae49-2f913f4458a8-kube-api-access-6rkkd\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:04.909148 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909104 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2s8w\" (UniqueName: \"kubernetes.io/projected/b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81-kube-api-access-r2s8w\") pod \"service-ca-operator-5d6c75f84f-cb5vw\" (UID: \"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" Jul 28 06:52:04.909148 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909131 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abbf8914-c198-470e-aa64-59beb776cf8c-serving-cert\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:04.909298 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909185 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abbf8914-c198-470e-aa64-59beb776cf8c-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:04.909336 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909315 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abbf8914-c198-470e-aa64-59beb776cf8c-tmp\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:04.909378 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909346 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8f79ab98-bd74-484b-a89e-1c92e1648192-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:04.909378 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909366 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:04.909473 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909389 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:04.909473 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909409 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d42bcac-022f-4189-9937-6f1f633097ca-trusted-ca\") pod \"console-operator-584dcb6b54-pjwt8\" (UID: \"0d42bcac-022f-4189-9937-6f1f633097ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:04.909559 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909483 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/abbf8914-c198-470e-aa64-59beb776cf8c-snapshots\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:04.909559 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909520 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-stats-auth\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:04.909559 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909547 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d42bcac-022f-4189-9937-6f1f633097ca-config\") pod \"console-operator-584dcb6b54-pjwt8\" (UID: \"0d42bcac-022f-4189-9937-6f1f633097ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:04.909701 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909575 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46dgg\" (UniqueName: \"kubernetes.io/projected/abbf8914-c198-470e-aa64-59beb776cf8c-kube-api-access-46dgg\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:04.909701 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909619 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:04.909701 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909645 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f9n6w\" (UID: \"606e3d81-68fb-49c3-b4fb-73c2fbf22de9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:04.909701 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909675 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d42bcac-022f-4189-9937-6f1f633097ca-serving-cert\") pod \"console-operator-584dcb6b54-pjwt8\" (UID: \"0d42bcac-022f-4189-9937-6f1f633097ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:04.909701 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909698 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7982b\" (UniqueName: \"kubernetes.io/projected/0d42bcac-022f-4189-9937-6f1f633097ca-kube-api-access-7982b\") pod \"console-operator-584dcb6b54-pjwt8\" (UID: \"0d42bcac-022f-4189-9937-6f1f633097ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:04.909956 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909728 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdx7t\" (UniqueName: \"kubernetes.io/projected/60ae09ae-e158-4dfa-a8be-b6749a669ca9-kube-api-access-vdx7t\") pod \"volume-data-source-validator-549c6d54cf-v59t2\" (UID: \"60ae09ae-e158-4dfa-a8be-b6749a669ca9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v59t2" Jul 28 06:52:04.909956 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:04.909746 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 06:52:04.909956 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909781 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81-config\") pod \"service-ca-operator-5d6c75f84f-cb5vw\" (UID: \"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" Jul 28 06:52:04.909956 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909806 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-default-certificate\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:04.909956 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:04.909840 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls podName:8f79ab98-bd74-484b-a89e-1c92e1648192 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:05.409820921 +0000 UTC m=+42.514511016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nt2qc" (UID: "8f79ab98-bd74-484b-a89e-1c92e1648192") : secret "cluster-monitoring-operator-tls" not found Jul 28 06:52:04.909956 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909871 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc7z7\" (UniqueName: \"kubernetes.io/projected/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-kube-api-access-hc7z7\") pod \"cluster-samples-operator-6748489656-f9n6w\" (UID: \"606e3d81-68fb-49c3-b4fb-73c2fbf22de9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:04.909956 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.909904 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abbf8914-c198-470e-aa64-59beb776cf8c-service-ca-bundle\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:04.910271 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.910188 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8f79ab98-bd74-484b-a89e-1c92e1648192-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:04.910271 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.910257 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81-config\") pod \"service-ca-operator-5d6c75f84f-cb5vw\" (UID: \"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" Jul 28 06:52:04.912982 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.912965 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81-serving-cert\") pod \"service-ca-operator-5d6c75f84f-cb5vw\" (UID: \"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" Jul 28 06:52:04.921396 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.921372 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2s8w\" (UniqueName: \"kubernetes.io/projected/b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81-kube-api-access-r2s8w\") pod \"service-ca-operator-5d6c75f84f-cb5vw\" (UID: \"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" Jul 28 06:52:04.921509 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.921487 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-757q4\" (UniqueName: \"kubernetes.io/projected/8f79ab98-bd74-484b-a89e-1c92e1648192-kube-api-access-757q4\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:04.921553 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.921483 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdx7t\" (UniqueName: \"kubernetes.io/projected/60ae09ae-e158-4dfa-a8be-b6749a669ca9-kube-api-access-vdx7t\") pod \"volume-data-source-validator-549c6d54cf-v59t2\" (UID: \"60ae09ae-e158-4dfa-a8be-b6749a669ca9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v59t2" Jul 28 06:52:04.966988 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.966952 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:04.970029 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.969998 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-lksts"] Jul 28 06:52:04.981133 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.981104 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v59t2" Jul 28 06:52:04.992004 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.991976 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-lksts"] Jul 28 06:52:04.992136 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.992087 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:04.994316 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.994295 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" Jul 28 06:52:04.994607 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.994572 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 28 06:52:04.994809 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.994795 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 28 06:52:04.994882 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:04.994821 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fd8mh\"" Jul 28 06:52:05.010818 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.010794 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abbf8914-c198-470e-aa64-59beb776cf8c-tmp\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.010956 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.010834 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:05.010956 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.010864 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13b1db04-1403-4a27-aa67-92bdf5369cfb-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh\" (UID: \"13b1db04-1403-4a27-aa67-92bdf5369cfb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" Jul 28 06:52:05.010956 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.010932 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:05.011085 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.011019 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 06:52:05.011136 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d42bcac-022f-4189-9937-6f1f633097ca-trusted-ca\") pod \"console-operator-584dcb6b54-pjwt8\" (UID: \"0d42bcac-022f-4189-9937-6f1f633097ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:05.011136 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.011102 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs podName:fb639d17-03f1-4d5a-ae49-2f913f4458a8 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:05.511077654 +0000 UTC m=+42.615767757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs") pod "router-default-777cfd8465-gqkwd" (UID: "fb639d17-03f1-4d5a-ae49-2f913f4458a8") : secret "router-metrics-certs-default" not found Jul 28 06:52:05.011223 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.011161 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle podName:fb639d17-03f1-4d5a-ae49-2f913f4458a8 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:05.511142969 +0000 UTC m=+42.615833090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle") pod "router-default-777cfd8465-gqkwd" (UID: "fb639d17-03f1-4d5a-ae49-2f913f4458a8") : configmap references non-existent config key: service-ca.crt Jul 28 06:52:05.011223 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011204 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abbf8914-c198-470e-aa64-59beb776cf8c-tmp\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.011223 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011204 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqbmz\" (UniqueName: \"kubernetes.io/projected/5a29fe04-4fca-43eb-a716-23a566025dd8-kube-api-access-tqbmz\") pod \"network-check-source-7d88cb55d8-9vqrc\" (UID: \"5a29fe04-4fca-43eb-a716-23a566025dd8\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9vqrc" Jul 28 06:52:05.011362 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011240 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/abbf8914-c198-470e-aa64-59beb776cf8c-snapshots\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.011362 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011328 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-stats-auth\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:05.011362 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011358 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d42bcac-022f-4189-9937-6f1f633097ca-config\") pod \"console-operator-584dcb6b54-pjwt8\" (UID: \"0d42bcac-022f-4189-9937-6f1f633097ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:05.011498 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011388 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46dgg\" (UniqueName: \"kubernetes.io/projected/abbf8914-c198-470e-aa64-59beb776cf8c-kube-api-access-46dgg\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.011498 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011438 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f9n6w\" (UID: \"606e3d81-68fb-49c3-b4fb-73c2fbf22de9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:05.011498 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011470 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d42bcac-022f-4189-9937-6f1f633097ca-serving-cert\") pod \"console-operator-584dcb6b54-pjwt8\" (UID: \"0d42bcac-022f-4189-9937-6f1f633097ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:05.011498 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011494 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7982b\" (UniqueName: \"kubernetes.io/projected/0d42bcac-022f-4189-9937-6f1f633097ca-kube-api-access-7982b\") pod \"console-operator-584dcb6b54-pjwt8\" (UID: \"0d42bcac-022f-4189-9937-6f1f633097ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:05.011731 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011529 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-default-certificate\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:05.011731 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc7z7\" (UniqueName: \"kubernetes.io/projected/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-kube-api-access-hc7z7\") pod \"cluster-samples-operator-6748489656-f9n6w\" (UID: \"606e3d81-68fb-49c3-b4fb-73c2fbf22de9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:05.011731 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011596 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abbf8914-c198-470e-aa64-59beb776cf8c-service-ca-bundle\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.011731 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011624 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p4j7\" (UniqueName: \"kubernetes.io/projected/13b1db04-1403-4a27-aa67-92bdf5369cfb-kube-api-access-6p4j7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh\" (UID: \"13b1db04-1403-4a27-aa67-92bdf5369cfb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" Jul 28 06:52:05.011731 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011681 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/abbf8914-c198-470e-aa64-59beb776cf8c-snapshots\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.011731 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011683 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rkkd\" (UniqueName: \"kubernetes.io/projected/fb639d17-03f1-4d5a-ae49-2f913f4458a8-kube-api-access-6rkkd\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:05.011731 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011726 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abbf8914-c198-470e-aa64-59beb776cf8c-serving-cert\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.012949 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011788 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abbf8914-c198-470e-aa64-59beb776cf8c-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.012949 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.011842 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13b1db04-1403-4a27-aa67-92bdf5369cfb-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh\" (UID: \"13b1db04-1403-4a27-aa67-92bdf5369cfb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" Jul 28 06:52:05.012949 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.012104 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d42bcac-022f-4189-9937-6f1f633097ca-trusted-ca\") pod \"console-operator-584dcb6b54-pjwt8\" (UID: \"0d42bcac-022f-4189-9937-6f1f633097ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:05.012949 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.012441 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 06:52:05.012949 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.012498 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls podName:606e3d81-68fb-49c3-b4fb-73c2fbf22de9 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:05.512482938 +0000 UTC m=+42.617173051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls") pod "cluster-samples-operator-6748489656-f9n6w" (UID: "606e3d81-68fb-49c3-b4fb-73c2fbf22de9") : secret "samples-operator-tls" not found Jul 28 06:52:05.012949 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.012540 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abbf8914-c198-470e-aa64-59beb776cf8c-service-ca-bundle\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.012949 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.012613 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d42bcac-022f-4189-9937-6f1f633097ca-config\") pod \"console-operator-584dcb6b54-pjwt8\" (UID: \"0d42bcac-022f-4189-9937-6f1f633097ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:05.012949 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.012691 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abbf8914-c198-470e-aa64-59beb776cf8c-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.018688 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.018657 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-stats-auth\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:05.018688 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.018657 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abbf8914-c198-470e-aa64-59beb776cf8c-serving-cert\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.019546 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.019521 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-default-certificate\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:05.020394 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.020367 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d42bcac-022f-4189-9937-6f1f633097ca-serving-cert\") pod \"console-operator-584dcb6b54-pjwt8\" (UID: \"0d42bcac-022f-4189-9937-6f1f633097ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:05.026286 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.026246 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc7z7\" (UniqueName: \"kubernetes.io/projected/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-kube-api-access-hc7z7\") pod \"cluster-samples-operator-6748489656-f9n6w\" (UID: \"606e3d81-68fb-49c3-b4fb-73c2fbf22de9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:05.026367 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.026261 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46dgg\" (UniqueName: \"kubernetes.io/projected/abbf8914-c198-470e-aa64-59beb776cf8c-kube-api-access-46dgg\") pod \"insights-operator-5885fdb759-pz549\" (UID: \"abbf8914-c198-470e-aa64-59beb776cf8c\") " pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.026923 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.026903 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7982b\" (UniqueName: \"kubernetes.io/projected/0d42bcac-022f-4189-9937-6f1f633097ca-kube-api-access-7982b\") pod \"console-operator-584dcb6b54-pjwt8\" (UID: \"0d42bcac-022f-4189-9937-6f1f633097ca\") " pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:05.027503 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.027483 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rkkd\" (UniqueName: \"kubernetes.io/projected/fb639d17-03f1-4d5a-ae49-2f913f4458a8-kube-api-access-6rkkd\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:05.039661 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.039631 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-pz549" Jul 28 06:52:05.082790 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.076713 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:05.082790 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.078889 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:05.113725 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.112717 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d4368546-2213-46cf-b048-e93209e1f417-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-lksts\" (UID: \"d4368546-2213-46cf-b048-e93209e1f417\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:05.113725 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.112929 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p4j7\" (UniqueName: \"kubernetes.io/projected/13b1db04-1403-4a27-aa67-92bdf5369cfb-kube-api-access-6p4j7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh\" (UID: \"13b1db04-1403-4a27-aa67-92bdf5369cfb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" Jul 28 06:52:05.113725 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.113051 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13b1db04-1403-4a27-aa67-92bdf5369cfb-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh\" (UID: \"13b1db04-1403-4a27-aa67-92bdf5369cfb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" Jul 28 06:52:05.113725 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.113159 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13b1db04-1403-4a27-aa67-92bdf5369cfb-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh\" (UID: \"13b1db04-1403-4a27-aa67-92bdf5369cfb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" Jul 28 06:52:05.113725 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.113204 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqbmz\" (UniqueName: \"kubernetes.io/projected/5a29fe04-4fca-43eb-a716-23a566025dd8-kube-api-access-tqbmz\") pod \"network-check-source-7d88cb55d8-9vqrc\" (UID: \"5a29fe04-4fca-43eb-a716-23a566025dd8\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9vqrc" Jul 28 06:52:05.113725 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.113236 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lksts\" (UID: \"d4368546-2213-46cf-b048-e93209e1f417\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:05.114307 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.114279 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13b1db04-1403-4a27-aa67-92bdf5369cfb-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh\" (UID: \"13b1db04-1403-4a27-aa67-92bdf5369cfb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" Jul 28 06:52:05.116601 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.116556 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13b1db04-1403-4a27-aa67-92bdf5369cfb-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh\" (UID: \"13b1db04-1403-4a27-aa67-92bdf5369cfb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" Jul 28 06:52:05.131523 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.130801 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p4j7\" (UniqueName: \"kubernetes.io/projected/13b1db04-1403-4a27-aa67-92bdf5369cfb-kube-api-access-6p4j7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh\" (UID: \"13b1db04-1403-4a27-aa67-92bdf5369cfb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" Jul 28 06:52:05.131523 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.130926 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqbmz\" (UniqueName: \"kubernetes.io/projected/5a29fe04-4fca-43eb-a716-23a566025dd8-kube-api-access-tqbmz\") pod \"network-check-source-7d88cb55d8-9vqrc\" (UID: \"5a29fe04-4fca-43eb-a716-23a566025dd8\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9vqrc" Jul 28 06:52:05.171529 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.170637 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:05.171529 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.171447 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v59t2"] Jul 28 06:52:05.174487 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:05.174429 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ae09ae_e158_4dfa_a8be_b6749a669ca9.slice/crio-a3eb13170bcef27f801b3e66db04df56c953563fe8bfe1a01eb27b2c9e32faa6 WatchSource:0}: Error finding container a3eb13170bcef27f801b3e66db04df56c953563fe8bfe1a01eb27b2c9e32faa6: Status 404 returned error can't find the container with id a3eb13170bcef27f801b3e66db04df56c953563fe8bfe1a01eb27b2c9e32faa6 Jul 28 06:52:05.188627 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.188595 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9vqrc" Jul 28 06:52:05.190150 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.190124 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw"] Jul 28 06:52:05.194502 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:05.194476 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9accb7f_ca3d_45cc_b5a0_3af1b7ed3f81.slice/crio-18a1ce94618f95676519799756d712b78efbf9892d6e40be0c90b40a9576063d WatchSource:0}: Error finding container 18a1ce94618f95676519799756d712b78efbf9892d6e40be0c90b40a9576063d: Status 404 returned error can't find the container with id 18a1ce94618f95676519799756d712b78efbf9892d6e40be0c90b40a9576063d Jul 28 06:52:05.211083 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.211051 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" Jul 28 06:52:05.214471 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.214443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lksts\" (UID: \"d4368546-2213-46cf-b048-e93209e1f417\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:05.214617 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.214503 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d4368546-2213-46cf-b048-e93209e1f417-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-lksts\" (UID: \"d4368546-2213-46cf-b048-e93209e1f417\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:05.214683 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.214655 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 06:52:05.214781 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.214749 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert podName:d4368546-2213-46cf-b048-e93209e1f417 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:05.714726647 +0000 UTC m=+42.819416739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lksts" (UID: "d4368546-2213-46cf-b048-e93209e1f417") : secret "networking-console-plugin-cert" not found Jul 28 06:52:05.215100 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.215082 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d4368546-2213-46cf-b048-e93209e1f417-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-lksts\" (UID: \"d4368546-2213-46cf-b048-e93209e1f417\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:05.243969 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.243914 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-pz549"] Jul 28 06:52:05.249378 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:05.249347 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabbf8914_c198_470e_aa64_59beb776cf8c.slice/crio-603f46363dd33609203626943a80ecc1622325daed07df18c4ee25c7591d1a73 WatchSource:0}: Error finding container 603f46363dd33609203626943a80ecc1622325daed07df18c4ee25c7591d1a73: Status 404 returned error can't find the container with id 603f46363dd33609203626943a80ecc1622325daed07df18c4ee25c7591d1a73 Jul 28 06:52:05.261374 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.261299 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-pjwt8"] Jul 28 06:52:05.280738 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:05.280387 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d42bcac_022f_4189_9937_6f1f633097ca.slice/crio-d586bd8ca21abb3b40c7b2ffb79a61739be6c747c8370a005d93ddcc099dab6f WatchSource:0}: Error finding container d586bd8ca21abb3b40c7b2ffb79a61739be6c747c8370a005d93ddcc099dab6f: Status 404 returned error can't find the container with id d586bd8ca21abb3b40c7b2ffb79a61739be6c747c8370a005d93ddcc099dab6f Jul 28 06:52:05.416370 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.416290 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:05.416520 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.416427 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 06:52:05.416520 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.416486 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls podName:8f79ab98-bd74-484b-a89e-1c92e1648192 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:06.416469705 +0000 UTC m=+43.521159793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nt2qc" (UID: "8f79ab98-bd74-484b-a89e-1c92e1648192") : secret "cluster-monitoring-operator-tls" not found Jul 28 06:52:05.517330 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.517294 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f9n6w\" (UID: \"606e3d81-68fb-49c3-b4fb-73c2fbf22de9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:05.517513 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.517427 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:05.517513 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.517449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:05.517513 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.517451 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 06:52:05.517513 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.517512 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls podName:606e3d81-68fb-49c3-b4fb-73c2fbf22de9 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:06.517497116 +0000 UTC m=+43.622187205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls") pod "cluster-samples-operator-6748489656-f9n6w" (UID: "606e3d81-68fb-49c3-b4fb-73c2fbf22de9") : secret "samples-operator-tls" not found Jul 28 06:52:05.517704 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.517563 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle podName:fb639d17-03f1-4d5a-ae49-2f913f4458a8 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:06.517550864 +0000 UTC m=+43.622240953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle") pod "router-default-777cfd8465-gqkwd" (UID: "fb639d17-03f1-4d5a-ae49-2f913f4458a8") : configmap references non-existent config key: service-ca.crt Jul 28 06:52:05.517704 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.517580 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 06:52:05.517704 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.517638 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs podName:fb639d17-03f1-4d5a-ae49-2f913f4458a8 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:06.517620652 +0000 UTC m=+43.622310755 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs") pod "router-default-777cfd8465-gqkwd" (UID: "fb639d17-03f1-4d5a-ae49-2f913f4458a8") : secret "router-metrics-certs-default" not found Jul 28 06:52:05.609618 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.609585 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-9vqrc"] Jul 28 06:52:05.612915 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:05.612884 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a29fe04_4fca_43eb_a716_23a566025dd8.slice/crio-1bd6158efb2f36ad8465875b21f448aeb0d423681fbd8cca562b091e1efbbde9 WatchSource:0}: Error finding container 1bd6158efb2f36ad8465875b21f448aeb0d423681fbd8cca562b091e1efbbde9: Status 404 returned error can't find the container with id 1bd6158efb2f36ad8465875b21f448aeb0d423681fbd8cca562b091e1efbbde9 Jul 28 06:52:05.612915 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.612907 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh"] Jul 28 06:52:05.615651 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:05.615627 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b1db04_1403_4a27_aa67_92bdf5369cfb.slice/crio-9b6d2c5b098ba3e8762e5b77c2f670a3a1a74b84a6d91ad412ab7b112e3e1ab9 WatchSource:0}: Error finding container 9b6d2c5b098ba3e8762e5b77c2f670a3a1a74b84a6d91ad412ab7b112e3e1ab9: Status 404 returned error can't find the container with id 9b6d2c5b098ba3e8762e5b77c2f670a3a1a74b84a6d91ad412ab7b112e3e1ab9 Jul 28 06:52:05.647229 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.647197 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9vqrc" event={"ID":"5a29fe04-4fca-43eb-a716-23a566025dd8","Type":"ContainerStarted","Data":"1bd6158efb2f36ad8465875b21f448aeb0d423681fbd8cca562b091e1efbbde9"} Jul 28 06:52:05.648213 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.648192 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" event={"ID":"13b1db04-1403-4a27-aa67-92bdf5369cfb","Type":"ContainerStarted","Data":"9b6d2c5b098ba3e8762e5b77c2f670a3a1a74b84a6d91ad412ab7b112e3e1ab9"} Jul 28 06:52:05.649194 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.649174 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" event={"ID":"0d42bcac-022f-4189-9937-6f1f633097ca","Type":"ContainerStarted","Data":"d586bd8ca21abb3b40c7b2ffb79a61739be6c747c8370a005d93ddcc099dab6f"} Jul 28 06:52:05.650320 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.650300 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-pz549" event={"ID":"abbf8914-c198-470e-aa64-59beb776cf8c","Type":"ContainerStarted","Data":"603f46363dd33609203626943a80ecc1622325daed07df18c4ee25c7591d1a73"} Jul 28 06:52:05.651327 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.651309 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" event={"ID":"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81","Type":"ContainerStarted","Data":"18a1ce94618f95676519799756d712b78efbf9892d6e40be0c90b40a9576063d"} Jul 28 06:52:05.652273 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.652255 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v59t2" event={"ID":"60ae09ae-e158-4dfa-a8be-b6749a669ca9","Type":"ContainerStarted","Data":"a3eb13170bcef27f801b3e66db04df56c953563fe8bfe1a01eb27b2c9e32faa6"} Jul 28 06:52:05.719409 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:05.719316 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lksts\" (UID: \"d4368546-2213-46cf-b048-e93209e1f417\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:05.719797 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.719476 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 06:52:05.719797 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:05.719536 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert podName:d4368546-2213-46cf-b048-e93209e1f417 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:06.71951969 +0000 UTC m=+43.824209789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lksts" (UID: "d4368546-2213-46cf-b048-e93209e1f417") : secret "networking-console-plugin-cert" not found Jul 28 06:52:06.426823 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:06.426779 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:06.427010 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:06.426973 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 06:52:06.427070 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:06.427042 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls podName:8f79ab98-bd74-484b-a89e-1c92e1648192 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:08.427020765 +0000 UTC m=+45.531710855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nt2qc" (UID: "8f79ab98-bd74-484b-a89e-1c92e1648192") : secret "cluster-monitoring-operator-tls" not found Jul 28 06:52:06.527703 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:06.527663 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:06.527891 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:06.527717 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:06.527891 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:06.527810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f9n6w\" (UID: \"606e3d81-68fb-49c3-b4fb-73c2fbf22de9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:06.528097 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:06.528063 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 06:52:06.528194 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:06.528149 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls podName:606e3d81-68fb-49c3-b4fb-73c2fbf22de9 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:08.528129925 +0000 UTC m=+45.632820017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls") pod "cluster-samples-operator-6748489656-f9n6w" (UID: "606e3d81-68fb-49c3-b4fb-73c2fbf22de9") : secret "samples-operator-tls" not found Jul 28 06:52:06.528579 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:06.528560 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 06:52:06.528658 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:06.528616 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs podName:fb639d17-03f1-4d5a-ae49-2f913f4458a8 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:08.528600435 +0000 UTC m=+45.633290527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs") pod "router-default-777cfd8465-gqkwd" (UID: "fb639d17-03f1-4d5a-ae49-2f913f4458a8") : secret "router-metrics-certs-default" not found Jul 28 06:52:06.528725 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:06.528687 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle podName:fb639d17-03f1-4d5a-ae49-2f913f4458a8 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:08.528674 +0000 UTC m=+45.633364093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle") pod "router-default-777cfd8465-gqkwd" (UID: "fb639d17-03f1-4d5a-ae49-2f913f4458a8") : configmap references non-existent config key: service-ca.crt Jul 28 06:52:06.730725 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:06.729983 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lksts\" (UID: \"d4368546-2213-46cf-b048-e93209e1f417\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:06.730725 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:06.730253 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 06:52:06.730725 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:06.730321 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert podName:d4368546-2213-46cf-b048-e93209e1f417 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:08.730301706 +0000 UTC m=+45.834991797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lksts" (UID: "d4368546-2213-46cf-b048-e93209e1f417") : secret "networking-console-plugin-cert" not found Jul 28 06:52:07.006056 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:07.005923 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:07.034600 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:07.034037 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:52:07.034600 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:07.034236 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:52:07.034600 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:07.034365 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:52:07.034600 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:07.034382 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb8d58dd6-5bhvj: secret "image-registry-tls" not found Jul 28 06:52:07.034600 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:07.034439 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls podName:0e2757c8-14cb-46df-901b-d6b1f1076002 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:15.034420219 +0000 UTC m=+52.139110310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls") pod "image-registry-bb8d58dd6-5bhvj" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002") : secret "image-registry-tls" not found Jul 28 06:52:07.034600 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:07.034465 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:07.034600 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:07.034507 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls podName:020008a7-3d30-42f9-b649-c94fed431d83 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:15.034494246 +0000 UTC m=+52.139184347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls") pod "dns-default-98g5h" (UID: "020008a7-3d30-42f9-b649-c94fed431d83") : secret "dns-default-metrics-tls" not found Jul 28 06:52:07.108233 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:07.108193 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:07.206998 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:07.206959 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:08.448196 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:08.448101 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:08.448695 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:08.448294 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 06:52:08.448695 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:08.448385 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls podName:8f79ab98-bd74-484b-a89e-1c92e1648192 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:12.448362335 +0000 UTC m=+49.553052427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nt2qc" (UID: "8f79ab98-bd74-484b-a89e-1c92e1648192") : secret "cluster-monitoring-operator-tls" not found Jul 28 06:52:08.549491 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:08.549450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f9n6w\" (UID: \"606e3d81-68fb-49c3-b4fb-73c2fbf22de9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:08.549720 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:08.549607 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:08.549720 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:08.549633 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 06:52:08.549720 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:08.549639 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:08.549720 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:08.549720 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls podName:606e3d81-68fb-49c3-b4fb-73c2fbf22de9 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:12.549698784 +0000 UTC m=+49.654388879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls") pod "cluster-samples-operator-6748489656-f9n6w" (UID: "606e3d81-68fb-49c3-b4fb-73c2fbf22de9") : secret "samples-operator-tls" not found Jul 28 06:52:08.549999 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:08.549750 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle podName:fb639d17-03f1-4d5a-ae49-2f913f4458a8 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:12.549738992 +0000 UTC m=+49.654429086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle") pod "router-default-777cfd8465-gqkwd" (UID: "fb639d17-03f1-4d5a-ae49-2f913f4458a8") : configmap references non-existent config key: service-ca.crt Jul 28 06:52:08.549999 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:08.549796 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 06:52:08.549999 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:08.549844 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs podName:fb639d17-03f1-4d5a-ae49-2f913f4458a8 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:12.549828078 +0000 UTC m=+49.654518169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs") pod "router-default-777cfd8465-gqkwd" (UID: "fb639d17-03f1-4d5a-ae49-2f913f4458a8") : secret "router-metrics-certs-default" not found Jul 28 06:52:08.751235 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:08.751145 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lksts\" (UID: \"d4368546-2213-46cf-b048-e93209e1f417\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:08.751416 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:08.751313 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 06:52:08.751416 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:08.751405 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert podName:d4368546-2213-46cf-b048-e93209e1f417 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:12.751389596 +0000 UTC m=+49.856079687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lksts" (UID: "d4368546-2213-46cf-b048-e93209e1f417") : secret "networking-console-plugin-cert" not found Jul 28 06:52:10.554812 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:10.554748 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:10.620224 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:10.620191 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:11.515092 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:11.515056 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:11.616740 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:11.616710 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:12.483201 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.483144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:12.483424 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:12.483407 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 06:52:12.483505 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:12.483472 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls podName:8f79ab98-bd74-484b-a89e-1c92e1648192 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:20.483452899 +0000 UTC m=+57.588143001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nt2qc" (UID: "8f79ab98-bd74-484b-a89e-1c92e1648192") : secret "cluster-monitoring-operator-tls" not found Jul 28 06:52:12.584317 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.584274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:12.584317 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.584328 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:12.584541 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.584398 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f9n6w\" (UID: \"606e3d81-68fb-49c3-b4fb-73c2fbf22de9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:12.584541 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:12.584460 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 06:52:12.584541 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:12.584535 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle podName:fb639d17-03f1-4d5a-ae49-2f913f4458a8 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:20.584512522 +0000 UTC m=+57.689202627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle") pod "router-default-777cfd8465-gqkwd" (UID: "fb639d17-03f1-4d5a-ae49-2f913f4458a8") : configmap references non-existent config key: service-ca.crt Jul 28 06:52:12.584718 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:12.584564 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs podName:fb639d17-03f1-4d5a-ae49-2f913f4458a8 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:20.584552858 +0000 UTC m=+57.689242952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs") pod "router-default-777cfd8465-gqkwd" (UID: "fb639d17-03f1-4d5a-ae49-2f913f4458a8") : secret "router-metrics-certs-default" not found Jul 28 06:52:12.584718 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:12.584576 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 06:52:12.584718 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:12.584628 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls podName:606e3d81-68fb-49c3-b4fb-73c2fbf22de9 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:20.584612806 +0000 UTC m=+57.689302901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls") pod "cluster-samples-operator-6748489656-f9n6w" (UID: "606e3d81-68fb-49c3-b4fb-73c2fbf22de9") : secret "samples-operator-tls" not found Jul 28 06:52:12.674447 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.674409 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9vqrc" event={"ID":"5a29fe04-4fca-43eb-a716-23a566025dd8","Type":"ContainerStarted","Data":"01ff442fe0a7004150df8dc13dc7a856270c605cd1f8fa598ab16fa3e1b626ac"} Jul 28 06:52:12.676526 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.676415 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" event={"ID":"13b1db04-1403-4a27-aa67-92bdf5369cfb","Type":"ContainerStarted","Data":"95006c1c0f856a3e61cfd56b8ee4af6528436ccc1656cc9de98ed106d18ff4e8"} Jul 28 06:52:12.678408 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.678382 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/0.log" Jul 28 06:52:12.678532 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.678428 2554 generic.go:356] "Generic (PLEG): container finished" podID="0d42bcac-022f-4189-9937-6f1f633097ca" containerID="1b475222d59e87d6813a712575a8c974e290886ad4d050fe707b10e01e11ebf7" exitCode=255 Jul 28 06:52:12.678532 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.678507 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" event={"ID":"0d42bcac-022f-4189-9937-6f1f633097ca","Type":"ContainerDied","Data":"1b475222d59e87d6813a712575a8c974e290886ad4d050fe707b10e01e11ebf7"} Jul 28 06:52:12.678997 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.678695 2554 scope.go:117] "RemoveContainer" containerID="1b475222d59e87d6813a712575a8c974e290886ad4d050fe707b10e01e11ebf7" Jul 28 06:52:12.680578 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.680398 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-pz549" event={"ID":"abbf8914-c198-470e-aa64-59beb776cf8c","Type":"ContainerStarted","Data":"e7712cb1d9c0fd62d225238ff1ca42939124c2e6111d4fed7de744622c7af6fa"} Jul 28 06:52:12.682519 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.682468 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" event={"ID":"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81","Type":"ContainerStarted","Data":"3c6d1eb8312aee6785f9b7f0476b75e0cbe4dc7bf0a840b9b3b950b61a7c38b2"} Jul 28 06:52:12.684182 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.684158 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v59t2" event={"ID":"60ae09ae-e158-4dfa-a8be-b6749a669ca9","Type":"ContainerStarted","Data":"5779ffff2b3f9ebd8c701610769fa098258b070fc979e67638c900fa596ae519"} Jul 28 06:52:12.690770 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.690168 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9vqrc" podStartSLOduration=2.589228959 podStartE2EDuration="8.690149946s" totalImagesPullingTime="6.100920987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:12.689492592 +0000 UTC m=+49.794182715" watchObservedRunningTime="2026-07-28 06:52:12.690149946 +0000 UTC m=+49.794840057" Jul 28 06:52:12.708124 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.708062 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v59t2" podStartSLOduration=2.473741929 podStartE2EDuration="8.708039568s" totalImagesPullingTime="6.234297639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:12.707179085 +0000 UTC m=+49.811869193" watchObservedRunningTime="2026-07-28 06:52:12.708039568 +0000 UTC m=+49.812729689" Jul 28 06:52:12.745329 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.745012 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" podStartSLOduration=2.235648775 podStartE2EDuration="8.744972332s" totalImagesPullingTime="6.509323557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:12.744831787 +0000 UTC m=+49.849521898" watchObservedRunningTime="2026-07-28 06:52:12.744972332 +0000 UTC m=+49.849662442" Jul 28 06:52:12.767135 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.767066 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-pz549" podStartSLOduration=2.313292351 podStartE2EDuration="8.767040383s" totalImagesPullingTime="6.453748032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:12.765582448 +0000 UTC m=+49.870272563" watchObservedRunningTime="2026-07-28 06:52:12.767040383 +0000 UTC m=+49.871730495" Jul 28 06:52:12.783621 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.783520 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" podStartSLOduration=2.695625123 podStartE2EDuration="8.783497521s" totalImagesPullingTime="6.087872398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:12.78160939 +0000 UTC m=+49.886299500" watchObservedRunningTime="2026-07-28 06:52:12.783497521 +0000 UTC m=+49.888187631" Jul 28 06:52:12.786580 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.785730 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lksts\" (UID: \"d4368546-2213-46cf-b048-e93209e1f417\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:12.788793 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:12.788658 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 06:52:12.788793 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:12.788726 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert podName:d4368546-2213-46cf-b048-e93209e1f417 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:20.788705418 +0000 UTC m=+57.893395508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lksts" (UID: "d4368546-2213-46cf-b048-e93209e1f417") : secret "networking-console-plugin-cert" not found Jul 28 06:52:12.806355 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.806209 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:12.907536 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:12.907481 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:13.150814 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.150747 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-599tf"] Jul 28 06:52:13.171116 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.171080 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-599tf"] Jul 28 06:52:13.171297 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.171199 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.173877 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.173848 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 06:52:13.173877 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.173874 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nplzg\"" Jul 28 06:52:13.174125 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.174108 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 06:52:13.190511 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.190485 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.190667 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.190535 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/566be829-dfc4-4c97-9799-18a6afec6996-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.190667 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.190621 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/566be829-dfc4-4c97-9799-18a6afec6996-crio-socket\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.190746 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.190677 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/566be829-dfc4-4c97-9799-18a6afec6996-data-volume\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.190801 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.190740 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t64wk\" (UniqueName: \"kubernetes.io/projected/566be829-dfc4-4c97-9799-18a6afec6996-kube-api-access-t64wk\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.195617 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.195506 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:13.260939 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.260908 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:13.291165 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.291128 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/566be829-dfc4-4c97-9799-18a6afec6996-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.291328 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.291206 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/566be829-dfc4-4c97-9799-18a6afec6996-crio-socket\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.291328 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.291254 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/566be829-dfc4-4c97-9799-18a6afec6996-data-volume\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.291328 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.291276 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t64wk\" (UniqueName: \"kubernetes.io/projected/566be829-dfc4-4c97-9799-18a6afec6996-kube-api-access-t64wk\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.291328 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:13.291289 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:52:13.291549 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.291340 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/566be829-dfc4-4c97-9799-18a6afec6996-crio-socket\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.291549 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.291349 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.291549 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:13.291370 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/566be829-dfc4-4c97-9799-18a6afec6996-kube-rbac-proxy-cm podName:566be829-dfc4-4c97-9799-18a6afec6996 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:13.791347785 +0000 UTC m=+50.896037878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/566be829-dfc4-4c97-9799-18a6afec6996-kube-rbac-proxy-cm") pod "insights-runtime-extractor-599tf" (UID: "566be829-dfc4-4c97-9799-18a6afec6996") : configmap "kube-rbac-proxy" not found Jul 28 06:52:13.291549 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:13.291433 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:52:13.291549 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:13.291488 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls podName:566be829-dfc4-4c97-9799-18a6afec6996 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:13.79147315 +0000 UTC m=+50.896163243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls") pod "insights-runtime-extractor-599tf" (UID: "566be829-dfc4-4c97-9799-18a6afec6996") : secret "insights-runtime-extractor-tls" not found Jul 28 06:52:13.291856 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.291660 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/566be829-dfc4-4c97-9799-18a6afec6996-data-volume\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.299536 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.299512 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t64wk\" (UniqueName: \"kubernetes.io/projected/566be829-dfc4-4c97-9799-18a6afec6996-kube-api-access-t64wk\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.418843 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.418682 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:13.495343 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.495301 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:13.593148 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.593112 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:13.689451 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.689369 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/1.log" Jul 28 06:52:13.689931 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.689907 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/0.log" Jul 28 06:52:13.689991 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.689966 2554 generic.go:356] "Generic (PLEG): container finished" podID="0d42bcac-022f-4189-9937-6f1f633097ca" containerID="c68225bea8379d8a4ff0f7197c3c5d6e96e45d6e5f2b5802155494994026093f" exitCode=255 Jul 28 06:52:13.690061 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.690013 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" event={"ID":"0d42bcac-022f-4189-9937-6f1f633097ca","Type":"ContainerDied","Data":"c68225bea8379d8a4ff0f7197c3c5d6e96e45d6e5f2b5802155494994026093f"} Jul 28 06:52:13.690120 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.690091 2554 scope.go:117] "RemoveContainer" containerID="1b475222d59e87d6813a712575a8c974e290886ad4d050fe707b10e01e11ebf7" Jul 28 06:52:13.690386 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.690354 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:13.690529 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.690390 2554 scope.go:117] "RemoveContainer" containerID="c68225bea8379d8a4ff0f7197c3c5d6e96e45d6e5f2b5802155494994026093f" Jul 28 06:52:13.690634 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:13.690610 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-pjwt8_openshift-console-operator(0d42bcac-022f-4189-9937-6f1f633097ca)\"" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" podUID="0d42bcac-022f-4189-9937-6f1f633097ca" Jul 28 06:52:13.797627 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.797587 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.797842 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.797749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/566be829-dfc4-4c97-9799-18a6afec6996-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:13.797842 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:13.797776 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:52:13.797842 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:13.797813 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:52:13.798009 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:13.797849 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls podName:566be829-dfc4-4c97-9799-18a6afec6996 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:14.797827342 +0000 UTC m=+51.902517432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls") pod "insights-runtime-extractor-599tf" (UID: "566be829-dfc4-4c97-9799-18a6afec6996") : secret "insights-runtime-extractor-tls" not found Jul 28 06:52:13.798009 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:13.797923 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/566be829-dfc4-4c97-9799-18a6afec6996-kube-rbac-proxy-cm podName:566be829-dfc4-4c97-9799-18a6afec6996 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:14.797902849 +0000 UTC m=+51.902592941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/566be829-dfc4-4c97-9799-18a6afec6996-kube-rbac-proxy-cm") pod "insights-runtime-extractor-599tf" (UID: "566be829-dfc4-4c97-9799-18a6afec6996") : configmap "kube-rbac-proxy" not found Jul 28 06:52:13.865297 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:13.865263 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:14.343715 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:14.343657 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:14.442144 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:14.442112 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:14.697933 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:14.697850 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/1.log" Jul 28 06:52:14.698286 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:14.698192 2554 scope.go:117] "RemoveContainer" containerID="c68225bea8379d8a4ff0f7197c3c5d6e96e45d6e5f2b5802155494994026093f" Jul 28 06:52:14.698361 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:14.698340 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-pjwt8_openshift-console-operator(0d42bcac-022f-4189-9937-6f1f633097ca)\"" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" podUID="0d42bcac-022f-4189-9937-6f1f633097ca" Jul 28 06:52:14.808035 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:14.807995 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:14.808229 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:14.808071 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/566be829-dfc4-4c97-9799-18a6afec6996-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:14.808229 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:14.808139 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:52:14.808229 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:14.808157 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:52:14.808229 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:14.808210 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls podName:566be829-dfc4-4c97-9799-18a6afec6996 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:16.808191205 +0000 UTC m=+53.912881293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls") pod "insights-runtime-extractor-599tf" (UID: "566be829-dfc4-4c97-9799-18a6afec6996") : secret "insights-runtime-extractor-tls" not found Jul 28 06:52:14.808395 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:14.808250 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/566be829-dfc4-4c97-9799-18a6afec6996-kube-rbac-proxy-cm podName:566be829-dfc4-4c97-9799-18a6afec6996 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:16.808221185 +0000 UTC m=+53.912911286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/566be829-dfc4-4c97-9799-18a6afec6996-kube-rbac-proxy-cm") pod "insights-runtime-extractor-599tf" (UID: "566be829-dfc4-4c97-9799-18a6afec6996") : configmap "kube-rbac-proxy" not found Jul 28 06:52:14.940997 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:14.940970 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6f54g_ea272cb3-32b4-4d87-a15f-0a2be6dc8d06/dns-node-resolver/0.log" Jul 28 06:52:15.080681 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:15.080589 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:15.080681 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:15.080676 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:15.111131 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:15.111099 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:52:15.111259 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:15.111243 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:15.111324 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:15.111300 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls podName:020008a7-3d30-42f9-b649-c94fed431d83 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:31.111285833 +0000 UTC m=+68.215975920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls") pod "dns-default-98g5h" (UID: "020008a7-3d30-42f9-b649-c94fed431d83") : secret "dns-default-metrics-tls" not found Jul 28 06:52:15.111324 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:15.111304 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:52:15.111324 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:15.111315 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb8d58dd6-5bhvj: secret "image-registry-tls" not found Jul 28 06:52:15.111476 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:15.111350 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls podName:0e2757c8-14cb-46df-901b-d6b1f1076002 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:31.111339624 +0000 UTC m=+68.216029727 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls") pod "image-registry-bb8d58dd6-5bhvj" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002") : secret "image-registry-tls" not found Jul 28 06:52:15.111476 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:15.111244 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:52:15.278961 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:15.278927 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:15.376411 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:15.376375 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:15.428188 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:15.428146 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:15.701208 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:15.701134 2554 scope.go:117] "RemoveContainer" containerID="c68225bea8379d8a4ff0f7197c3c5d6e96e45d6e5f2b5802155494994026093f" Jul 28 06:52:15.701572 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:15.701289 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-pjwt8_openshift-console-operator(0d42bcac-022f-4189-9937-6f1f633097ca)\"" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" podUID="0d42bcac-022f-4189-9937-6f1f633097ca" Jul 28 06:52:15.909894 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:15.909859 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:16.009424 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:16.009336 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:16.141978 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:16.141953 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sbnt5_4f8d803f-7f02-4da7-9bca-04ab104246a7/node-ca/0.log" Jul 28 06:52:16.182883 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:16.182820 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:16.755343 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:16.755311 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:16.814696 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:16.814665 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:16.827362 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:16.827335 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:16.827532 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:16.827391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/566be829-dfc4-4c97-9799-18a6afec6996-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:16.827532 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:16.827491 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:52:16.827652 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:16.827567 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls podName:566be829-dfc4-4c97-9799-18a6afec6996 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:20.827546932 +0000 UTC m=+57.932237027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls") pod "insights-runtime-extractor-599tf" (UID: "566be829-dfc4-4c97-9799-18a6afec6996") : secret "insights-runtime-extractor-tls" not found Jul 28 06:52:16.827907 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:16.827888 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/566be829-dfc4-4c97-9799-18a6afec6996-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:16.941626 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:16.941599 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pvkjq_fd7e1042-4a95-48b1-a22a-cd1407f09119/serve-healthcheck-canary/0.log" Jul 28 06:52:20.094540 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:20.094504 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:20.343120 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:20.343081 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:20.441429 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:20.441333 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:20.562204 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:20.562149 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:20.562422 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:20.562327 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 06:52:20.562422 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:20.562410 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls podName:8f79ab98-bd74-484b-a89e-1c92e1648192 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:36.562389182 +0000 UTC m=+73.667079275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-nt2qc" (UID: "8f79ab98-bd74-484b-a89e-1c92e1648192") : secret "cluster-monitoring-operator-tls" not found Jul 28 06:52:20.581694 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:20.581664 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:20.663265 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:20.663214 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:20.663265 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:20.663270 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:20.663440 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:20.663315 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f9n6w\" (UID: \"606e3d81-68fb-49c3-b4fb-73c2fbf22de9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:20.663440 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:20.663370 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 06:52:20.663440 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:20.663416 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 06:52:20.663541 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:20.663442 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs podName:fb639d17-03f1-4d5a-ae49-2f913f4458a8 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:36.66342571 +0000 UTC m=+73.768115798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs") pod "router-default-777cfd8465-gqkwd" (UID: "fb639d17-03f1-4d5a-ae49-2f913f4458a8") : secret "router-metrics-certs-default" not found Jul 28 06:52:20.663541 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:20.663456 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle podName:fb639d17-03f1-4d5a-ae49-2f913f4458a8 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:36.663450513 +0000 UTC m=+73.768140601 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle") pod "router-default-777cfd8465-gqkwd" (UID: "fb639d17-03f1-4d5a-ae49-2f913f4458a8") : configmap references non-existent config key: service-ca.crt Jul 28 06:52:20.663541 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:20.663467 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls podName:606e3d81-68fb-49c3-b4fb-73c2fbf22de9 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:36.663462048 +0000 UTC m=+73.768152136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls") pod "cluster-samples-operator-6748489656-f9n6w" (UID: "606e3d81-68fb-49c3-b4fb-73c2fbf22de9") : secret "samples-operator-tls" not found Jul 28 06:52:20.825657 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:20.825576 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:20.865631 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:20.865587 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:20.865794 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:20.865656 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lksts\" (UID: \"d4368546-2213-46cf-b048-e93209e1f417\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:20.865794 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:20.865731 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:52:20.865876 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:20.865812 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 06:52:20.865876 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:20.865827 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls podName:566be829-dfc4-4c97-9799-18a6afec6996 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:28.865810549 +0000 UTC m=+65.970500637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls") pod "insights-runtime-extractor-599tf" (UID: "566be829-dfc4-4c97-9799-18a6afec6996") : secret "insights-runtime-extractor-tls" not found Jul 28 06:52:20.865876 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:20.865857 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert podName:d4368546-2213-46cf-b048-e93209e1f417 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:36.865844706 +0000 UTC m=+73.970534794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lksts" (UID: "d4368546-2213-46cf-b048-e93209e1f417") : secret "networking-console-plugin-cert" not found Jul 28 06:52:20.924959 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:20.924905 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:21.035392 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:21.035358 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:22.006366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:22.006333 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:22.074203 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:22.074172 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:22.432362 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:22.432325 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:22.638886 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:22.638859 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:22.831117 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:22.831028 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:23.049179 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:23.049144 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:23.611039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:23.611013 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhsp6" Jul 28 06:52:23.838267 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:23.838233 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:23.894182 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:23.894102 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:24.029618 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:24.029588 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:24.237184 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:24.237105 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:24.676336 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:24.676300 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:24.776274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:24.776241 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:25.039228 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:25.039149 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:25.233536 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:25.233506 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:25.835574 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:25.835539 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:26.038260 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:26.038231 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:26.414423 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:26.414396 2554 scope.go:117] "RemoveContainer" containerID="c68225bea8379d8a4ff0f7197c3c5d6e96e45d6e5f2b5802155494994026093f" Jul 28 06:52:26.636872 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:26.636833 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:26.693621 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:26.693539 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:26.734588 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:26.734561 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/2.log" Jul 28 06:52:26.735019 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:26.735005 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/1.log" Jul 28 06:52:26.735079 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:26.735040 2554 generic.go:356] "Generic (PLEG): container finished" podID="0d42bcac-022f-4189-9937-6f1f633097ca" containerID="ee4472c69c536facb140707b067ed2952f2401f7c1e16880896fb953a7e9c9a1" exitCode=255 Jul 28 06:52:26.735114 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:26.735079 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" event={"ID":"0d42bcac-022f-4189-9937-6f1f633097ca","Type":"ContainerDied","Data":"ee4472c69c536facb140707b067ed2952f2401f7c1e16880896fb953a7e9c9a1"} Jul 28 06:52:26.735148 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:26.735127 2554 scope.go:117] "RemoveContainer" containerID="c68225bea8379d8a4ff0f7197c3c5d6e96e45d6e5f2b5802155494994026093f" Jul 28 06:52:26.735479 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:26.735455 2554 scope.go:117] "RemoveContainer" containerID="ee4472c69c536facb140707b067ed2952f2401f7c1e16880896fb953a7e9c9a1" Jul 28 06:52:26.735677 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:26.735653 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-pjwt8_openshift-console-operator(0d42bcac-022f-4189-9937-6f1f633097ca)\"" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" podUID="0d42bcac-022f-4189-9937-6f1f633097ca" Jul 28 06:52:27.038781 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:27.038679 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:27.236169 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:27.236130 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:27.739664 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:27.739631 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/2.log" Jul 28 06:52:27.835151 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:27.835124 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:28.239567 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:28.239536 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:28.422925 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:28.422892 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:28.632957 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:28.632926 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:28.835556 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:28.835525 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:28.938603 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:28.938510 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:28.940914 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:28.940893 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/566be829-dfc4-4c97-9799-18a6afec6996-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-599tf\" (UID: \"566be829-dfc4-4c97-9799-18a6afec6996\") " pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:29.040091 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.040048 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:52:29.040091 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.040095 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:52:29.042717 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.042699 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 06:52:29.043554 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.043537 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 06:52:29.052565 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.052538 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cbb34ff-cb3d-4f84-92f3-8a72dbb938de-original-pull-secret\") pod \"global-pull-secret-syncer-ltj9k\" (UID: \"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de\") " pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:52:29.052682 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.052585 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03922df9-9b4e-4dec-80de-12e819531552-metrics-certs\") pod \"network-metrics-daemon-jkdfq\" (UID: \"03922df9-9b4e-4dec-80de-12e819531552\") " pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:52:29.084066 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.084033 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nplzg\"" Jul 28 06:52:29.092049 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.092026 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-599tf" Jul 28 06:52:29.141667 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.141633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txfb\" (UniqueName: \"kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb\") pod \"network-check-target-j8vjh\" (UID: \"15292834-c484-4c15-9ab0-a9f85d854b6d\") " pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:52:29.144331 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.144305 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8txfb\" (UniqueName: \"kubernetes.io/projected/15292834-c484-4c15-9ab0-a9f85d854b6d-kube-api-access-8txfb\") pod \"network-check-target-j8vjh\" (UID: \"15292834-c484-4c15-9ab0-a9f85d854b6d\") " pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:52:29.222473 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.222389 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ltj9k" Jul 28 06:52:29.227412 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.227381 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-599tf"] Jul 28 06:52:29.229941 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.229924 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4jsfj\"" Jul 28 06:52:29.230169 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:29.230147 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566be829_dfc4_4c97_9799_18a6afec6996.slice/crio-b3342fa6ebf426434cce5bbfdca847115e9767f128a6f3ebc6d1c10cbb30834c WatchSource:0}: Error finding container b3342fa6ebf426434cce5bbfdca847115e9767f128a6f3ebc6d1c10cbb30834c: Status 404 returned error can't find the container with id b3342fa6ebf426434cce5bbfdca847115e9767f128a6f3ebc6d1c10cbb30834c Jul 28 06:52:29.237688 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.237668 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdfq" Jul 28 06:52:29.256029 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.255990 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:29.357495 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.357456 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ltj9k"] Jul 28 06:52:29.361402 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:29.361372 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbb34ff_cb3d_4f84_92f3_8a72dbb938de.slice/crio-1290fb3ef3726051e67beae300b669cf03546a5873cb7426d8b9fb0b5c9d99ca WatchSource:0}: Error finding container 1290fb3ef3726051e67beae300b669cf03546a5873cb7426d8b9fb0b5c9d99ca: Status 404 returned error can't find the container with id 1290fb3ef3726051e67beae300b669cf03546a5873cb7426d8b9fb0b5c9d99ca Jul 28 06:52:29.374309 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.374283 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jkdfq"] Jul 28 06:52:29.376998 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:29.376971 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03922df9_9b4e_4dec_80de_12e819531552.slice/crio-ed7d1c7f7ede2deed40cbb55c2d1c9604e726af6a6daa597e2a88a159a832c60 WatchSource:0}: Error finding container ed7d1c7f7ede2deed40cbb55c2d1c9604e726af6a6daa597e2a88a159a832c60: Status 404 returned error can't find the container with id ed7d1c7f7ede2deed40cbb55c2d1c9604e726af6a6daa597e2a88a159a832c60 Jul 28 06:52:29.426941 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.426912 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-982bk\"" Jul 28 06:52:29.435243 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.435208 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:52:29.558201 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.558170 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j8vjh"] Jul 28 06:52:29.560642 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:29.560606 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15292834_c484_4c15_9ab0_a9f85d854b6d.slice/crio-c32a4cbef777892cb7490e1e59a4a6604b4774b4620c21f3fbc46278f7678981 WatchSource:0}: Error finding container c32a4cbef777892cb7490e1e59a4a6604b4774b4620c21f3fbc46278f7678981: Status 404 returned error can't find the container with id c32a4cbef777892cb7490e1e59a4a6604b4774b4620c21f3fbc46278f7678981 Jul 28 06:52:29.638409 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.638304 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:29.750842 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.750697 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkdfq" event={"ID":"03922df9-9b4e-4dec-80de-12e819531552","Type":"ContainerStarted","Data":"ed7d1c7f7ede2deed40cbb55c2d1c9604e726af6a6daa597e2a88a159a832c60"} Jul 28 06:52:29.753424 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.753180 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j8vjh" event={"ID":"15292834-c484-4c15-9ab0-a9f85d854b6d","Type":"ContainerStarted","Data":"c9d32c413669f9f139c851b3ef695c7f592aab3215ecbd03977ee57cbe230e82"} Jul 28 06:52:29.753424 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.753242 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:52:29.753424 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.753263 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j8vjh" event={"ID":"15292834-c484-4c15-9ab0-a9f85d854b6d","Type":"ContainerStarted","Data":"c32a4cbef777892cb7490e1e59a4a6604b4774b4620c21f3fbc46278f7678981"} Jul 28 06:52:29.755219 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.755180 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ltj9k" event={"ID":"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de","Type":"ContainerStarted","Data":"1290fb3ef3726051e67beae300b669cf03546a5873cb7426d8b9fb0b5c9d99ca"} Jul 28 06:52:29.757586 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.757518 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-599tf" event={"ID":"566be829-dfc4-4c97-9799-18a6afec6996","Type":"ContainerStarted","Data":"b3342fa6ebf426434cce5bbfdca847115e9767f128a6f3ebc6d1c10cbb30834c"} Jul 28 06:52:29.769617 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:29.769559 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j8vjh" podStartSLOduration=65.769528908 podStartE2EDuration="1m5.769528908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:51:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:29.768127405 +0000 UTC m=+66.872817517" watchObservedRunningTime="2026-07-28 06:52:29.769528908 +0000 UTC m=+66.874219019" Jul 28 06:52:30.278315 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:30.278229 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:30.639499 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:30.639464 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:30.763628 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:30.763527 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkdfq" event={"ID":"03922df9-9b4e-4dec-80de-12e819531552","Type":"ContainerStarted","Data":"ac5de5a373349da1ba44da68bba72c0c523498004a3380e74d47e0bd2fee1a6f"} Jul 28 06:52:30.835593 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:30.835508 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:31.042377 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.042342 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:31.163194 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.163155 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:52:31.163396 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.163310 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:52:31.166037 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.166006 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/020008a7-3d30-42f9-b649-c94fed431d83-metrics-tls\") pod \"dns-default-98g5h\" (UID: \"020008a7-3d30-42f9-b649-c94fed431d83\") " pod="openshift-dns/dns-default-98g5h" Jul 28 06:52:31.167138 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.167114 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls\") pod \"image-registry-bb8d58dd6-5bhvj\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:52:31.337794 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.337741 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xdvwc\"" Jul 28 06:52:31.346280 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.346045 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:52:31.358081 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.358052 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tddhc\"" Jul 28 06:52:31.365836 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.365805 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-98g5h" Jul 28 06:52:31.552900 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.552868 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bb8d58dd6-5bhvj"] Jul 28 06:52:31.556665 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:31.556636 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2757c8_14cb_46df_901b_d6b1f1076002.slice/crio-d2fd82c4fb6e3a9e5647cda06df9fa26209bf1ea4e7d4c17518977206018a635 WatchSource:0}: Error finding container d2fd82c4fb6e3a9e5647cda06df9fa26209bf1ea4e7d4c17518977206018a635: Status 404 returned error can't find the container with id d2fd82c4fb6e3a9e5647cda06df9fa26209bf1ea4e7d4c17518977206018a635 Jul 28 06:52:31.573877 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.573735 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-98g5h"] Jul 28 06:52:31.577408 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:31.577351 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020008a7_3d30_42f9_b649_c94fed431d83.slice/crio-c2f2e455165273dbdac475210bc179268776cf62b6a7985b3d0e4309b240557d WatchSource:0}: Error finding container c2f2e455165273dbdac475210bc179268776cf62b6a7985b3d0e4309b240557d: Status 404 returned error can't find the container with id c2f2e455165273dbdac475210bc179268776cf62b6a7985b3d0e4309b240557d Jul 28 06:52:31.768518 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.768427 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98g5h" event={"ID":"020008a7-3d30-42f9-b649-c94fed431d83","Type":"ContainerStarted","Data":"c2f2e455165273dbdac475210bc179268776cf62b6a7985b3d0e4309b240557d"} Jul 28 06:52:31.770883 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.770849 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" event={"ID":"0e2757c8-14cb-46df-901b-d6b1f1076002","Type":"ContainerStarted","Data":"5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67"} Jul 28 06:52:31.771055 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.770904 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" event={"ID":"0e2757c8-14cb-46df-901b-d6b1f1076002","Type":"ContainerStarted","Data":"d2fd82c4fb6e3a9e5647cda06df9fa26209bf1ea4e7d4c17518977206018a635"} Jul 28 06:52:31.771156 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.771125 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:52:31.773154 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.773124 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkdfq" event={"ID":"03922df9-9b4e-4dec-80de-12e819531552","Type":"ContainerStarted","Data":"372c2b93aa3ec3fa8f531a290c1293b31d9dca061119067ad6136c16cea3c2de"} Jul 28 06:52:31.790231 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.790175 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" podStartSLOduration=45.790152851 podStartE2EDuration="45.790152851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:51:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:31.789195039 +0000 UTC m=+68.893885150" watchObservedRunningTime="2026-07-28 06:52:31.790152851 +0000 UTC m=+68.894842962" Jul 28 06:52:31.804292 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:31.804239 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jkdfq" podStartSLOduration=66.596356731 podStartE2EDuration="1m7.804218618s" totalImagesPullingTime="1.207861887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:31.803280368 +0000 UTC m=+68.907970483" watchObservedRunningTime="2026-07-28 06:52:31.804218618 +0000 UTC m=+68.908908728" Jul 28 06:52:35.080123 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:35.080086 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:35.080556 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:35.080153 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:35.080556 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:35.080522 2554 scope.go:117] "RemoveContainer" containerID="ee4472c69c536facb140707b067ed2952f2401f7c1e16880896fb953a7e9c9a1" Jul 28 06:52:35.080738 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:35.080714 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-pjwt8_openshift-console-operator(0d42bcac-022f-4189-9937-6f1f633097ca)\"" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" podUID="0d42bcac-022f-4189-9937-6f1f633097ca" Jul 28 06:52:35.789582 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:35.789548 2554 scope.go:117] "RemoveContainer" containerID="ee4472c69c536facb140707b067ed2952f2401f7c1e16880896fb953a7e9c9a1" Jul 28 06:52:35.789797 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:35.789749 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-pjwt8_openshift-console-operator(0d42bcac-022f-4189-9937-6f1f633097ca)\"" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" podUID="0d42bcac-022f-4189-9937-6f1f633097ca" Jul 28 06:52:36.474640 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.474600 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:36.558533 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.558497 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:36.615601 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.615557 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:36.618421 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.618391 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f79ab98-bd74-484b-a89e-1c92e1648192-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-nt2qc\" (UID: \"8f79ab98-bd74-484b-a89e-1c92e1648192\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:36.652906 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.652863 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:36.717044 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.716950 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:36.717044 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.716993 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:36.717044 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.717039 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f9n6w\" (UID: \"606e3d81-68fb-49c3-b4fb-73c2fbf22de9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:36.717817 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.717793 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb639d17-03f1-4d5a-ae49-2f913f4458a8-service-ca-bundle\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:36.719829 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.719801 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/606e3d81-68fb-49c3-b4fb-73c2fbf22de9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-f9n6w\" (UID: \"606e3d81-68fb-49c3-b4fb-73c2fbf22de9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:36.719989 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.719968 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb639d17-03f1-4d5a-ae49-2f913f4458a8-metrics-certs\") pod \"router-default-777cfd8465-gqkwd\" (UID: \"fb639d17-03f1-4d5a-ae49-2f913f4458a8\") " pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:36.752142 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.752110 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:36.817497 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.817393 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hd5kp\"" Jul 28 06:52:36.825476 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.825432 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" Jul 28 06:52:36.890016 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.889980 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sr2gn\"" Jul 28 06:52:36.898230 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.898190 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" Jul 28 06:52:36.900577 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.900555 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v657k\"" Jul 28 06:52:36.908791 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.908747 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:36.918360 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.918216 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lksts\" (UID: \"d4368546-2213-46cf-b048-e93209e1f417\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:36.921189 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:36.921077 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4368546-2213-46cf-b048-e93209e1f417-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lksts\" (UID: \"d4368546-2213-46cf-b048-e93209e1f417\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:37.022288 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.021980 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:37.061381 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.061292 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc"] Jul 28 06:52:37.065310 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:37.065279 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f79ab98_bd74_484b_a89e_1c92e1648192.slice/crio-6b31716c9783094e9c6ec5807c73a3079a55aa9f48a4104ff84cfaf5c32034a2 WatchSource:0}: Error finding container 6b31716c9783094e9c6ec5807c73a3079a55aa9f48a4104ff84cfaf5c32034a2: Status 404 returned error can't find the container with id 6b31716c9783094e9c6ec5807c73a3079a55aa9f48a4104ff84cfaf5c32034a2 Jul 28 06:52:37.103467 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.103436 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fd8mh\"" Jul 28 06:52:37.112265 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.111969 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" Jul 28 06:52:37.118818 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.118717 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:37.121624 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.121594 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-777cfd8465-gqkwd"] Jul 28 06:52:37.127015 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:37.126926 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb639d17_03f1_4d5a_ae49_2f913f4458a8.slice/crio-48dab9ea6af90134a6ea32d85e86fde51f6b3ef17d5f52d7874c0c1ef5b88cfa WatchSource:0}: Error finding container 48dab9ea6af90134a6ea32d85e86fde51f6b3ef17d5f52d7874c0c1ef5b88cfa: Status 404 returned error can't find the container with id 48dab9ea6af90134a6ea32d85e86fde51f6b3ef17d5f52d7874c0c1ef5b88cfa Jul 28 06:52:37.148583 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.148342 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w"] Jul 28 06:52:37.294511 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.294478 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-lksts"] Jul 28 06:52:37.297467 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:37.297443 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4368546_2213_46cf_b048_e93209e1f417.slice/crio-331e50d43b0543f4f5eba6c5652dc9a8411cc241e567cc27d4fdcc9715324775 WatchSource:0}: Error finding container 331e50d43b0543f4f5eba6c5652dc9a8411cc241e567cc27d4fdcc9715324775: Status 404 returned error can't find the container with id 331e50d43b0543f4f5eba6c5652dc9a8411cc241e567cc27d4fdcc9715324775 Jul 28 06:52:37.420565 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.420525 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:37.481441 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.481402 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:37.801070 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.800986 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" event={"ID":"8f79ab98-bd74-484b-a89e-1c92e1648192","Type":"ContainerStarted","Data":"6b31716c9783094e9c6ec5807c73a3079a55aa9f48a4104ff84cfaf5c32034a2"} Jul 28 06:52:37.803527 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.803489 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ltj9k" event={"ID":"6cbb34ff-cb3d-4f84-92f3-8a72dbb938de","Type":"ContainerStarted","Data":"04ba064265c4f88529772ce4e97aaaaead8add7cf804ef9aafe96ca2abaed320"} Jul 28 06:52:37.806335 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.806297 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-599tf" event={"ID":"566be829-dfc4-4c97-9799-18a6afec6996","Type":"ContainerStarted","Data":"9b2ac70d2253c5e725bfbbcd99f1716c362b110f743834b7869e2a865f9f9d74"} Jul 28 06:52:37.808284 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.808204 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" event={"ID":"606e3d81-68fb-49c3-b4fb-73c2fbf22de9","Type":"ContainerStarted","Data":"57528ee1033485bae7d33df5a4fadf93d5babdfb0fb72950ed0bf979cc34d062"} Jul 28 06:52:37.817545 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.817425 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:37.820599 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.819793 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98g5h" event={"ID":"020008a7-3d30-42f9-b649-c94fed431d83","Type":"ContainerStarted","Data":"8e130a93828731485262b16bbebbb078fb176fe73999534b794773ad66c797ff"} Jul 28 06:52:37.820599 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.819907 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98g5h" event={"ID":"020008a7-3d30-42f9-b649-c94fed431d83","Type":"ContainerStarted","Data":"f4a3e310ea30d8d2021f982288200f8ee0e52c144fd5baed2fb40b34f89fa794"} Jul 28 06:52:37.820599 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.820548 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-98g5h" Jul 28 06:52:37.826077 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.823289 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" event={"ID":"d4368546-2213-46cf-b048-e93209e1f417","Type":"ContainerStarted","Data":"331e50d43b0543f4f5eba6c5652dc9a8411cc241e567cc27d4fdcc9715324775"} Jul 28 06:52:37.826077 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.824306 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ltj9k" podStartSLOduration=66.308974019 podStartE2EDuration="1m13.82428578s" totalImagesPullingTime="7.515311761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:37.82380748 +0000 UTC m=+74.928497592" watchObservedRunningTime="2026-07-28 06:52:37.82428578 +0000 UTC m=+74.928975907" Jul 28 06:52:37.832996 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.832327 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-777cfd8465-gqkwd" event={"ID":"fb639d17-03f1-4d5a-ae49-2f913f4458a8","Type":"ContainerStarted","Data":"f19b027335fa840dd3698b0330bc8938553bb68e77e6e3334d2c315fe5645132"} Jul 28 06:52:37.833251 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.833230 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-777cfd8465-gqkwd" event={"ID":"fb639d17-03f1-4d5a-ae49-2f913f4458a8","Type":"ContainerStarted","Data":"48dab9ea6af90134a6ea32d85e86fde51f6b3ef17d5f52d7874c0c1ef5b88cfa"} Jul 28 06:52:37.867338 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.867274 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-98g5h" podStartSLOduration=33.533693336 podStartE2EDuration="38.867229516s" totalImagesPullingTime="5.33353618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:37.843376797 +0000 UTC m=+74.948066908" watchObservedRunningTime="2026-07-28 06:52:37.867229516 +0000 UTC m=+74.971919628" Jul 28 06:52:37.867523 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.867394 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-777cfd8465-gqkwd" podStartSLOduration=33.867388608 podStartE2EDuration="33.867388608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:37.866734118 +0000 UTC m=+74.971424230" watchObservedRunningTime="2026-07-28 06:52:37.867388608 +0000 UTC m=+74.972078718" Jul 28 06:52:37.909524 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.909489 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:37.912555 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.912523 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:37.918102 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:37.918052 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:38.805952 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:38.805894 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:38.837859 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:38.837795 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:38.839177 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:38.839142 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-777cfd8465-gqkwd" Jul 28 06:52:38.859360 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:38.859311 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:39.210159 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:39.210125 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:39.310743 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:39.310705 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:42.563976 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:42.563934 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:42.662044 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:42.662001 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:42.733659 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:42.733628 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:42.853893 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:42.853854 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" event={"ID":"d4368546-2213-46cf-b048-e93209e1f417","Type":"ContainerStarted","Data":"6228697609fe73129cc8ab5897be8f93b075118b8a24cab0ed9137e05871b370"} Jul 28 06:52:42.855608 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:42.855573 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" event={"ID":"8f79ab98-bd74-484b-a89e-1c92e1648192","Type":"ContainerStarted","Data":"5cbe2c6691632ab5a66819defd02b2545c58c4e2e6595fa1ef46279c5cc46cb6"} Jul 28 06:52:42.857570 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:42.857539 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-599tf" event={"ID":"566be829-dfc4-4c97-9799-18a6afec6996","Type":"ContainerStarted","Data":"2d086fe209105747cfc92e2e2b45d29213adefcb614f6c732e3233ff8d1aea6a"} Jul 28 06:52:42.859398 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:42.859371 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" event={"ID":"606e3d81-68fb-49c3-b4fb-73c2fbf22de9","Type":"ContainerStarted","Data":"8e158099a6860bcb5734ee9d7d7f806f39b3e9644a48f2dd620b9957135b2b8c"} Jul 28 06:52:42.859541 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:42.859419 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" event={"ID":"606e3d81-68fb-49c3-b4fb-73c2fbf22de9","Type":"ContainerStarted","Data":"49cc80815dd7f97f3a0fd756c232650c2732627cb43bacf14cebf3db47f0a662"} Jul 28 06:52:42.869282 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:42.869229 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lksts" podStartSLOduration=34.908482915 podStartE2EDuration="38.869212154s" totalImagesPullingTime="3.960729239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:42.868060656 +0000 UTC m=+79.972750767" watchObservedRunningTime="2026-07-28 06:52:42.869212154 +0000 UTC m=+79.973902287" Jul 28 06:52:42.884815 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:42.884743 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-f9n6w" podStartSLOduration=34.107882549 podStartE2EDuration="38.884722893s" totalImagesPullingTime="4.776840344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:42.883585714 +0000 UTC m=+79.988275824" watchObservedRunningTime="2026-07-28 06:52:42.884722893 +0000 UTC m=+79.989413002" Jul 28 06:52:42.900284 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:42.900213 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-nt2qc" podStartSLOduration=33.825013274 podStartE2EDuration="38.900187552s" totalImagesPullingTime="5.075174278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:42.898336499 +0000 UTC m=+80.003026608" watchObservedRunningTime="2026-07-28 06:52:42.900187552 +0000 UTC m=+80.004877643" Jul 28 06:52:42.935534 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:42.935499 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:43.040698 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:43.040653 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:43.098989 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:43.098940 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:44.532447 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:44.532331 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:44.595630 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:44.595596 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:45.599821 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:45.599778 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:45.651614 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:45.651575 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:46.750403 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:46.750344 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:46.810971 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:46.810924 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:46.878195 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:46.878159 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-599tf" event={"ID":"566be829-dfc4-4c97-9799-18a6afec6996","Type":"ContainerStarted","Data":"196646ee477737e40a98344d154120ae437869be53ff8c1e6b93b7be9871757d"} Jul 28 06:52:46.895159 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:46.895104 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-599tf" podStartSLOduration=17.236302485 podStartE2EDuration="33.895088078s" totalImagesPullingTime="16.658785593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:46.894512009 +0000 UTC m=+83.999202119" watchObservedRunningTime="2026-07-28 06:52:46.895088078 +0000 UTC m=+83.999778184" Jul 28 06:52:47.153071 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:47.153034 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:47.510972 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:47.510885 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:47.611500 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:47.611467 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:47.810698 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:47.810616 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:47.911112 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:47.911080 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:48.012422 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:48.012382 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:48.457484 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:48.457453 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:48.511805 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:48.511771 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:48.843849 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:48.843816 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-98g5h" Jul 28 06:52:49.400102 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:49.400070 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:50.414467 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:50.414428 2554 scope.go:117] "RemoveContainer" containerID="ee4472c69c536facb140707b067ed2952f2401f7c1e16880896fb953a7e9c9a1" Jul 28 06:52:50.895585 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:50.895556 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/2.log" Jul 28 06:52:50.895796 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:50.895611 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" event={"ID":"0d42bcac-022f-4189-9937-6f1f633097ca","Type":"ContainerStarted","Data":"609418a991baa55c50d677d709c6a3217037ce7fccdd4302087bf307b5881b22"} Jul 28 06:52:50.896011 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:50.895991 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:50.910249 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:50.910214 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:50.916299 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:50.916239 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" podStartSLOduration=40.495150614 podStartE2EDuration="46.916219649s" totalImagesPullingTime="6.421069035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:50.915123998 +0000 UTC m=+88.019814123" watchObservedRunningTime="2026-07-28 06:52:50.916219649 +0000 UTC m=+88.020909794" Jul 28 06:52:51.134026 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.133994 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-pjwt8" Jul 28 06:52:51.144542 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.144472 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:51.190548 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.190459 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7n8wd"] Jul 28 06:52:51.193612 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.193586 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.196246 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.196188 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 06:52:51.196683 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.196661 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 06:52:51.196896 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.196662 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 06:52:51.197087 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.197070 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jvsvh\"" Jul 28 06:52:51.197991 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.197971 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 06:52:51.234525 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.234481 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a301638-f322-4edf-9205-0b29887a8264-sys\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.234525 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.234524 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-textfile\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.234750 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.234543 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-wtmp\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.234750 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.234625 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-tls\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.234750 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.234671 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.234750 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.234731 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a301638-f322-4edf-9205-0b29887a8264-metrics-client-ca\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.234750 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.234770 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsp7f\" (UniqueName: \"kubernetes.io/projected/0a301638-f322-4edf-9205-0b29887a8264-kube-api-access-fsp7f\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.234953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.234817 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a301638-f322-4edf-9205-0b29887a8264-root\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.234953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.234844 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-accelerators-collector-config\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.251444 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.251408 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:51.326764 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.326717 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-cmqrs"] Jul 28 06:52:51.328988 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.328964 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-cmqrs" Jul 28 06:52:51.331958 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.331931 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 06:52:51.332214 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.332191 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 06:52:51.332307 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.332289 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4bs9f\"" Jul 28 06:52:51.335217 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.335197 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-textfile\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.335217 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.335224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-wtmp\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.335394 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.335251 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-tls\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.335394 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.335275 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.335394 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.335297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a301638-f322-4edf-9205-0b29887a8264-metrics-client-ca\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.335394 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.335312 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsp7f\" (UniqueName: \"kubernetes.io/projected/0a301638-f322-4edf-9205-0b29887a8264-kube-api-access-fsp7f\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.335394 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.335339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a301638-f322-4edf-9205-0b29887a8264-root\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.335394 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.335361 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-accelerators-collector-config\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.335689 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:51.335407 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 06:52:51.335689 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.335406 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grb7h\" (UniqueName: \"kubernetes.io/projected/aff18aa7-337c-45c5-9682-6386f62c2350-kube-api-access-grb7h\") pod \"downloads-7c97dc4555-cmqrs\" (UID: \"aff18aa7-337c-45c5-9682-6386f62c2350\") " pod="openshift-console/downloads-7c97dc4555-cmqrs" Jul 28 06:52:51.335837 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.335727 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-textfile\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.335837 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.335439 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a301638-f322-4edf-9205-0b29887a8264-root\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.336013 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:52:51.335991 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-tls podName:0a301638-f322-4edf-9205-0b29887a8264 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:51.835448345 +0000 UTC m=+88.940138450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-tls") pod "node-exporter-7n8wd" (UID: "0a301638-f322-4edf-9205-0b29887a8264") : secret "node-exporter-tls" not found Jul 28 06:52:51.336103 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.336092 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a301638-f322-4edf-9205-0b29887a8264-sys\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.336437 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.336402 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a301638-f322-4edf-9205-0b29887a8264-sys\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.336437 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.335453 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-wtmp\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.336572 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.336458 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a301638-f322-4edf-9205-0b29887a8264-metrics-client-ca\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.336789 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.336706 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-accelerators-collector-config\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.343496 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.343469 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-cmqrs"] Jul 28 06:52:51.343621 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.343578 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.352417 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.352389 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsp7f\" (UniqueName: \"kubernetes.io/projected/0a301638-f322-4edf-9205-0b29887a8264-kube-api-access-fsp7f\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.361536 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.361502 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:51.436975 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.436938 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grb7h\" (UniqueName: \"kubernetes.io/projected/aff18aa7-337c-45c5-9682-6386f62c2350-kube-api-access-grb7h\") pod \"downloads-7c97dc4555-cmqrs\" (UID: \"aff18aa7-337c-45c5-9682-6386f62c2350\") " pod="openshift-console/downloads-7c97dc4555-cmqrs" Jul 28 06:52:51.446680 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.446596 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grb7h\" (UniqueName: \"kubernetes.io/projected/aff18aa7-337c-45c5-9682-6386f62c2350-kube-api-access-grb7h\") pod \"downloads-7c97dc4555-cmqrs\" (UID: \"aff18aa7-337c-45c5-9682-6386f62c2350\") " pod="openshift-console/downloads-7c97dc4555-cmqrs" Jul 28 06:52:51.473750 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.472975 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:51.579861 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.579828 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:51.642626 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.642590 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-cmqrs" Jul 28 06:52:51.676813 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.676779 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:51.775954 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.775925 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-cmqrs"] Jul 28 06:52:51.778920 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:51.778890 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff18aa7_337c_45c5_9682_6386f62c2350.slice/crio-1a6d37fee241d7219538777dec7eed0e66a12c729839b815190bc3f0edb73a2f WatchSource:0}: Error finding container 1a6d37fee241d7219538777dec7eed0e66a12c729839b815190bc3f0edb73a2f: Status 404 returned error can't find the container with id 1a6d37fee241d7219538777dec7eed0e66a12c729839b815190bc3f0edb73a2f Jul 28 06:52:51.840620 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.840584 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-tls\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.843142 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.843116 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a301638-f322-4edf-9205-0b29887a8264-node-exporter-tls\") pod \"node-exporter-7n8wd\" (UID: \"0a301638-f322-4edf-9205-0b29887a8264\") " pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:51.901122 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:51.901087 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-cmqrs" event={"ID":"aff18aa7-337c-45c5-9682-6386f62c2350","Type":"ContainerStarted","Data":"1a6d37fee241d7219538777dec7eed0e66a12c729839b815190bc3f0edb73a2f"} Jul 28 06:52:52.002744 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:52.002648 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:52.104227 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:52.104181 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:52.107332 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:52.107304 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7n8wd" Jul 28 06:52:52.118430 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:52.118399 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a301638_f322_4edf_9205_0b29887a8264.slice/crio-0f4fa2075066b9c1bbf762382cff7807c4f85d556dd4ec8125e80dd47a7099b1 WatchSource:0}: Error finding container 0f4fa2075066b9c1bbf762382cff7807c4f85d556dd4ec8125e80dd47a7099b1: Status 404 returned error can't find the container with id 0f4fa2075066b9c1bbf762382cff7807c4f85d556dd4ec8125e80dd47a7099b1 Jul 28 06:52:52.206073 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:52.206034 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:52.292393 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:52.292290 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:52.420023 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:52.419983 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:52.512123 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:52.512086 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:52.613495 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:52.613370 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:52.788717 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:52.788427 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:52:52.821867 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:52.821832 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:52.909620 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:52.909520 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n8wd" event={"ID":"0a301638-f322-4edf-9205-0b29887a8264","Type":"ContainerStarted","Data":"0f4fa2075066b9c1bbf762382cff7807c4f85d556dd4ec8125e80dd47a7099b1"} Jul 28 06:52:53.175370 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:53.175318 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:53.286314 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:53.286254 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:53.662935 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:53.662888 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:53.916747 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:53.916639 2554 generic.go:356] "Generic (PLEG): container finished" podID="0a301638-f322-4edf-9205-0b29887a8264" containerID="814a96f0e2d8dde246a22e383ecbfb485f7ef8000e0da33fede9cf911e145e86" exitCode=0 Jul 28 06:52:53.916937 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:53.916749 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n8wd" event={"ID":"0a301638-f322-4edf-9205-0b29887a8264","Type":"ContainerDied","Data":"814a96f0e2d8dde246a22e383ecbfb485f7ef8000e0da33fede9cf911e145e86"} Jul 28 06:52:54.094074 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.094035 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:54.199366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.199279 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:54.223273 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.223236 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68ff77d4ff-llswv"] Jul 28 06:52:54.226446 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.226418 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.229547 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.229517 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 06:52:54.230010 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.229988 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 06:52:54.230126 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.230040 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-asckpct41liho\"" Jul 28 06:52:54.230243 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.230227 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dgfn5\"" Jul 28 06:52:54.230341 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.230309 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 06:52:54.230546 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.230518 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 06:52:54.230819 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.230518 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 06:52:54.244326 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.244292 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68ff77d4ff-llswv"] Jul 28 06:52:54.261746 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.261707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.261954 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.261781 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.261954 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.261857 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a936091-052b-43c0-9210-59dd959a8b90-metrics-client-ca\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.261954 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.261908 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.262100 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.262001 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.262100 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.262029 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-grpc-tls\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.262100 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.262094 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqb8d\" (UniqueName: \"kubernetes.io/projected/6a936091-052b-43c0-9210-59dd959a8b90-kube-api-access-jqb8d\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.262212 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.262159 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-tls\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.271553 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.271524 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:54.363089 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.363049 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-grpc-tls\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.363296 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.363099 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqb8d\" (UniqueName: \"kubernetes.io/projected/6a936091-052b-43c0-9210-59dd959a8b90-kube-api-access-jqb8d\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.363296 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.363146 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-tls\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.363296 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.363170 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.363296 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.363191 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.363563 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.363540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a936091-052b-43c0-9210-59dd959a8b90-metrics-client-ca\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.363632 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.363595 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.363723 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.363698 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.364399 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.364349 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a936091-052b-43c0-9210-59dd959a8b90-metrics-client-ca\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.366485 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.366433 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-grpc-tls\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.366485 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.366461 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-tls\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.366687 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.366670 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.366881 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.366857 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.366959 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.366857 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.367179 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.367150 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a936091-052b-43c0-9210-59dd959a8b90-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.373500 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.373465 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqb8d\" (UniqueName: \"kubernetes.io/projected/6a936091-052b-43c0-9210-59dd959a8b90-kube-api-access-jqb8d\") pod \"thanos-querier-68ff77d4ff-llswv\" (UID: \"6a936091-052b-43c0-9210-59dd959a8b90\") " pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.538932 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.538844 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:54.675454 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.675420 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:54.709983 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.709947 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68ff77d4ff-llswv"] Jul 28 06:52:54.712506 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:54.712460 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a936091_052b_43c0_9210_59dd959a8b90.slice/crio-7a6622a7144f78504a099604ad1998aea50d8748cf07ac3a17f33160657739de WatchSource:0}: Error finding container 7a6622a7144f78504a099604ad1998aea50d8748cf07ac3a17f33160657739de: Status 404 returned error can't find the container with id 7a6622a7144f78504a099604ad1998aea50d8748cf07ac3a17f33160657739de Jul 28 06:52:54.778561 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.778508 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:54.876934 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.876899 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:54.923622 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.923579 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n8wd" event={"ID":"0a301638-f322-4edf-9205-0b29887a8264","Type":"ContainerStarted","Data":"335a6678a10a9be3437175a3294f5f8b360c2bf50a338ba09762981ed09c5ca8"} Jul 28 06:52:54.923908 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.923652 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n8wd" event={"ID":"0a301638-f322-4edf-9205-0b29887a8264","Type":"ContainerStarted","Data":"c759b8f04c7145a0dd15248214a2d5b5ad7846d918893bc3bceb06f5712768d3"} Jul 28 06:52:54.925186 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.925149 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" event={"ID":"6a936091-052b-43c0-9210-59dd959a8b90","Type":"ContainerStarted","Data":"7a6622a7144f78504a099604ad1998aea50d8748cf07ac3a17f33160657739de"} Jul 28 06:52:54.947418 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:54.947352 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7n8wd" podStartSLOduration=2.8178328759999998 podStartE2EDuration="3.947332033s" totalImagesPullingTime="1.042825612s" totalInitContainerRuntime="86.673545ms" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:54.946187532 +0000 UTC m=+92.050877643" watchObservedRunningTime="2026-07-28 06:52:54.947332033 +0000 UTC m=+92.052022146" Jul 28 06:52:55.557446 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.557406 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5778f6c5c9-nfs9g"] Jul 28 06:52:55.560190 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.560156 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.564004 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.563970 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 06:52:55.564649 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.564416 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ch8mkrpqglqf4\"" Jul 28 06:52:55.564649 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.564470 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-92p5s\"" Jul 28 06:52:55.564649 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.564486 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 06:52:55.564979 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.564812 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 06:52:55.564979 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.564817 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 06:52:55.571209 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.571186 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5778f6c5c9-nfs9g"] Jul 28 06:52:55.574970 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.574769 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13923bf0-5af9-4f86-9828-845a3ef80f2c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.574970 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.574825 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/13923bf0-5af9-4f86-9828-845a3ef80f2c-secret-metrics-server-tls\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.574970 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.574863 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/13923bf0-5af9-4f86-9828-845a3ef80f2c-secret-metrics-server-client-certs\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.574970 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.574883 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th7lc\" (UniqueName: \"kubernetes.io/projected/13923bf0-5af9-4f86-9828-845a3ef80f2c-kube-api-access-th7lc\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.574970 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.574925 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/13923bf0-5af9-4f86-9828-845a3ef80f2c-metrics-server-audit-profiles\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.574970 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.574972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13923bf0-5af9-4f86-9828-845a3ef80f2c-client-ca-bundle\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.575339 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.574997 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/13923bf0-5af9-4f86-9828-845a3ef80f2c-audit-log\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.675639 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.675582 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/13923bf0-5af9-4f86-9828-845a3ef80f2c-metrics-server-audit-profiles\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.675639 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.675638 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13923bf0-5af9-4f86-9828-845a3ef80f2c-client-ca-bundle\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.676153 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.675667 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/13923bf0-5af9-4f86-9828-845a3ef80f2c-audit-log\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.676153 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.675702 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13923bf0-5af9-4f86-9828-845a3ef80f2c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.676153 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.675747 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/13923bf0-5af9-4f86-9828-845a3ef80f2c-secret-metrics-server-tls\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.676153 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.675821 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/13923bf0-5af9-4f86-9828-845a3ef80f2c-secret-metrics-server-client-certs\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.676153 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.675848 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th7lc\" (UniqueName: \"kubernetes.io/projected/13923bf0-5af9-4f86-9828-845a3ef80f2c-kube-api-access-th7lc\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.677178 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.677126 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13923bf0-5af9-4f86-9828-845a3ef80f2c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.677178 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.677137 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/13923bf0-5af9-4f86-9828-845a3ef80f2c-audit-log\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.677401 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.677252 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/13923bf0-5af9-4f86-9828-845a3ef80f2c-metrics-server-audit-profiles\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.680000 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.679968 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13923bf0-5af9-4f86-9828-845a3ef80f2c-client-ca-bundle\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.680147 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.680026 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/13923bf0-5af9-4f86-9828-845a3ef80f2c-secret-metrics-server-client-certs\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.680147 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.680098 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/13923bf0-5af9-4f86-9828-845a3ef80f2c-secret-metrics-server-tls\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.685848 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.685784 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th7lc\" (UniqueName: \"kubernetes.io/projected/13923bf0-5af9-4f86-9828-845a3ef80f2c-kube-api-access-th7lc\") pod \"metrics-server-5778f6c5c9-nfs9g\" (UID: \"13923bf0-5af9-4f86-9828-845a3ef80f2c\") " pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.875504 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.875243 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:52:55.923072 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:55.923034 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:56.025724 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:56.025640 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:56.057461 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:56.057429 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5778f6c5c9-nfs9g"] Jul 28 06:52:56.060541 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:56.060507 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13923bf0_5af9_4f86_9828_845a3ef80f2c.slice/crio-8279072e92eb90562c78e5129d707b506c26d81d8f4cdc66c6aa4b840a06c26e WatchSource:0}: Error finding container 8279072e92eb90562c78e5129d707b506c26d81d8f4cdc66c6aa4b840a06c26e: Status 404 returned error can't find the container with id 8279072e92eb90562c78e5129d707b506c26d81d8f4cdc66c6aa4b840a06c26e Jul 28 06:52:56.281086 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:56.280951 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:56.937658 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:56.937619 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" event={"ID":"13923bf0-5af9-4f86-9828-845a3ef80f2c","Type":"ContainerStarted","Data":"8279072e92eb90562c78e5129d707b506c26d81d8f4cdc66c6aa4b840a06c26e"} Jul 28 06:52:56.939619 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:56.939498 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" event={"ID":"6a936091-052b-43c0-9210-59dd959a8b90","Type":"ContainerStarted","Data":"8d02e6298b5163ef0843638877c71519c1f97ea7e361b5ab4441992ea5906bc5"} Jul 28 06:52:57.352789 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.352726 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:57.353455 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.353427 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 06:52:57.357267 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.357229 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.361953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.360165 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 06:52:57.361953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.360410 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-j43p67da0agv\"" Jul 28 06:52:57.361953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.360599 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 06:52:57.361953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.360812 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 06:52:57.361953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.361038 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cdmk8\"" Jul 28 06:52:57.361953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.361467 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 06:52:57.361953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.361481 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 06:52:57.361953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.361667 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 06:52:57.361953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.361790 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 06:52:57.361953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.361833 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 06:52:57.361953 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.361835 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 06:52:57.362625 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.362017 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 06:52:57.362625 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.362456 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 06:52:57.362735 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.362652 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 06:52:57.362812 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.362795 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 06:52:57.364805 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.364765 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 06:52:57.374158 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.374109 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 06:52:57.393329 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393292 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.393329 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393345 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.393665 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393386 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.393665 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393421 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.393665 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393447 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.393665 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393480 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.393665 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393561 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.393665 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393592 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-config\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.393665 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393614 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.393665 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393639 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.394160 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393736 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.394160 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393817 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.394160 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393882 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.394160 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393915 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.394160 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393938 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.394160 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393962 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhgrr\" (UniqueName: \"kubernetes.io/projected/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-kube-api-access-dhgrr\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.394160 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.393994 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.394160 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.394024 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.394160 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.394050 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.394160 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.394078 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.494978 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495017 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495045 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhgrr\" (UniqueName: \"kubernetes.io/projected/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-kube-api-access-dhgrr\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495075 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495176 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495196 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495222 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495241 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495271 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495311 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495338 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495401 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495427 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495483 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495507 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-config\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495522 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.496785 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.497746 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495577 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.497746 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495593 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.497746 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.495615 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.498304 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.497987 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.499600 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.498594 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.499600 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.499306 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.499600 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.499515 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.501169 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.500391 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.501169 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.500947 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.501932 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.501877 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.502980 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.502942 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.503204 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.503159 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.503956 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.503871 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-config\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.503956 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.503905 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.504125 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.504016 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.504185 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.504134 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.504520 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.504470 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.504660 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.504637 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.504743 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.504720 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.505977 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.505910 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.506255 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.506230 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.506365 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.506346 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.509447 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.509420 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhgrr\" (UniqueName: \"kubernetes.io/projected/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-kube-api-access-dhgrr\") pod \"prometheus-k8s-0\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.565663 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.565623 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:57.672057 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.671962 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:52:57.738636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.738599 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:57.947635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.947534 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" event={"ID":"6a936091-052b-43c0-9210-59dd959a8b90","Type":"ContainerStarted","Data":"af7190f88c2d805d6cca709850373f9672af7eeb21cd7acca6ac7ed913336bbe"} Jul 28 06:52:57.947635 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:57.947614 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" event={"ID":"6a936091-052b-43c0-9210-59dd959a8b90","Type":"ContainerStarted","Data":"778780936cac2e4bf2f369072980940aba5294f99f8062711c7e21c919128b85"} Jul 28 06:52:58.232939 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:58.232912 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 06:52:58.236181 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:52:58.236144 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016f86c6_c19a_4ae5_9e3d_8d87cca283e6.slice/crio-7242a43858858c1f4d42c30472a7003a8e4fb405ff8ddea82a192a62605f8842 WatchSource:0}: Error finding container 7242a43858858c1f4d42c30472a7003a8e4fb405ff8ddea82a192a62605f8842: Status 404 returned error can't find the container with id 7242a43858858c1f4d42c30472a7003a8e4fb405ff8ddea82a192a62605f8842 Jul 28 06:52:58.955553 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:58.955393 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerStarted","Data":"7242a43858858c1f4d42c30472a7003a8e4fb405ff8ddea82a192a62605f8842"} Jul 28 06:52:58.958178 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:58.958018 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" event={"ID":"13923bf0-5af9-4f86-9828-845a3ef80f2c","Type":"ContainerStarted","Data":"8a0ba843ee5ac7dd422e15b88f100c877d9ad09e3766678f37930de4aa5c6cd8"} Jul 28 06:52:58.963320 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:58.963104 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" event={"ID":"6a936091-052b-43c0-9210-59dd959a8b90","Type":"ContainerStarted","Data":"cfc3708ea53b4f1024401bf225018a36f752ef80fbe239d15c3d3beb46512d93"} Jul 28 06:52:58.963320 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:58.963228 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" event={"ID":"6a936091-052b-43c0-9210-59dd959a8b90","Type":"ContainerStarted","Data":"2f8b23db3685932ccf88f2c373fdbb032bebc6808f8868cd2ef7293d782e262e"} Jul 28 06:52:58.963320 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:58.963272 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" event={"ID":"6a936091-052b-43c0-9210-59dd959a8b90","Type":"ContainerStarted","Data":"c264cea2f7cd28643de98fec93797140f42132da86ab7c9edaad92cbf1bf035a"} Jul 28 06:52:58.963650 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:58.963506 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:52:58.981103 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:58.980986 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" podStartSLOduration=1.951818216 podStartE2EDuration="3.980929596s" totalImagesPullingTime="2.02911138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:58.98040433 +0000 UTC m=+96.085094443" watchObservedRunningTime="2026-07-28 06:52:58.980929596 +0000 UTC m=+96.085619713" Jul 28 06:52:59.000051 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:58.999733 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" podStartSLOduration=1.369032413 podStartE2EDuration="4.999713202s" totalImagesPullingTime="3.630680789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:58.999326497 +0000 UTC m=+96.104016608" watchObservedRunningTime="2026-07-28 06:52:58.999713202 +0000 UTC m=+96.104403312" Jul 28 06:52:59.435580 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:59.435546 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bb8d58dd6-5bhvj"] Jul 28 06:52:59.511319 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:59.511278 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:59.577335 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:59.577296 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:59.970609 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:59.970569 2554 generic.go:356] "Generic (PLEG): container finished" podID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerID="ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466" exitCode=0 Jul 28 06:52:59.971052 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:52:59.970661 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerDied","Data":"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466"} Jul 28 06:53:00.766699 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:00.766658 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j8vjh" Jul 28 06:53:04.977515 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:04.977483 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68ff77d4ff-llswv" Jul 28 06:53:06.029065 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:06.029027 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:06.086354 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:06.086315 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:07.012055 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:07.012021 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:07.061857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:07.061823 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:08.114589 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:08.114555 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:08.171691 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:08.171652 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:09.431636 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:09.431602 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:09.489326 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:09.489280 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:11.037666 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:11.037415 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerStarted","Data":"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7"} Jul 28 06:53:11.037666 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:11.037508 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerStarted","Data":"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1"} Jul 28 06:53:11.037666 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:11.037549 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerStarted","Data":"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1"} Jul 28 06:53:11.045985 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:11.043746 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-cmqrs" event={"ID":"aff18aa7-337c-45c5-9682-6386f62c2350","Type":"ContainerStarted","Data":"cf5ea4408ef8cf4e3f2e461eed43a5b740e0bce0356a828471bf0808f8c40f1e"} Jul 28 06:53:11.046379 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:11.046343 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-cmqrs" Jul 28 06:53:11.046645 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:11.046615 2554 patch_prober.go:28] interesting pod/downloads-7c97dc4555-cmqrs container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused" start-of-body= Jul 28 06:53:11.047290 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:11.047020 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-cmqrs" podUID="aff18aa7-337c-45c5-9682-6386f62c2350" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused" Jul 28 06:53:12.053960 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:12.053918 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerStarted","Data":"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175"} Jul 28 06:53:12.054441 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:12.054007 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerStarted","Data":"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc"} Jul 28 06:53:12.054441 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:12.054045 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerStarted","Data":"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855"} Jul 28 06:53:12.058525 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:12.058503 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-cmqrs" Jul 28 06:53:12.086108 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:12.086046 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-cmqrs" podStartSLOduration=2.100023184 podStartE2EDuration="21.086024511s" totalImagesPullingTime="18.986001327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:53:11.079647977 +0000 UTC m=+108.184338088" watchObservedRunningTime="2026-07-28 06:53:12.086024511 +0000 UTC m=+109.190714621" Jul 28 06:53:12.087397 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:12.087340 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.183345238 podStartE2EDuration="15.087218516s" totalImagesPullingTime="11.877916465s" totalInitContainerRuntime="25.956813ms" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:53:12.081670179 +0000 UTC m=+109.186360289" watchObservedRunningTime="2026-07-28 06:53:12.087218516 +0000 UTC m=+109.191908645" Jul 28 06:53:12.673222 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:12.673175 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:53:12.831144 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:12.831107 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:14.237096 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:14.237059 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:14.288261 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:14.288203 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:15.876263 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:15.876218 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:53:15.876716 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:15.876313 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:53:19.838580 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:19.838547 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:20.858470 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:20.858436 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:20.959954 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:20.959921 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:22.264265 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:22.264228 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:22.361248 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:22.361220 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:23.107646 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:23.107612 2554 generic.go:356] "Generic (PLEG): container finished" podID="13b1db04-1403-4a27-aa67-92bdf5369cfb" containerID="95006c1c0f856a3e61cfd56b8ee4af6528436ccc1656cc9de98ed106d18ff4e8" exitCode=0 Jul 28 06:53:23.107841 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:23.107690 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" event={"ID":"13b1db04-1403-4a27-aa67-92bdf5369cfb","Type":"ContainerDied","Data":"95006c1c0f856a3e61cfd56b8ee4af6528436ccc1656cc9de98ed106d18ff4e8"} Jul 28 06:53:23.108084 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:23.108067 2554 scope.go:117] "RemoveContainer" containerID="95006c1c0f856a3e61cfd56b8ee4af6528436ccc1656cc9de98ed106d18ff4e8" Jul 28 06:53:23.109308 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:23.109291 2554 generic.go:356] "Generic (PLEG): container finished" podID="b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81" containerID="3c6d1eb8312aee6785f9b7f0476b75e0cbe4dc7bf0a840b9b3b950b61a7c38b2" exitCode=0 Jul 28 06:53:23.109373 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:23.109338 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" event={"ID":"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81","Type":"ContainerDied","Data":"3c6d1eb8312aee6785f9b7f0476b75e0cbe4dc7bf0a840b9b3b950b61a7c38b2"} Jul 28 06:53:23.109585 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:23.109572 2554 scope.go:117] "RemoveContainer" containerID="3c6d1eb8312aee6785f9b7f0476b75e0cbe4dc7bf0a840b9b3b950b61a7c38b2" Jul 28 06:53:24.117082 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.117046 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh" event={"ID":"13b1db04-1403-4a27-aa67-92bdf5369cfb","Type":"ContainerStarted","Data":"af6487ed19ae1c60b2d12af529fedb261bba01a9a9a338a25eb6a9fe201f0041"} Jul 28 06:53:24.118853 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.118823 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cb5vw" event={"ID":"b9accb7f-ca3d-45cc-b5a0-3af1b7ed3f81","Type":"ContainerStarted","Data":"3b680b132a2f9592772db9b7d309f9adc4ea6ffcaead05468aa63e112f7238a2"} Jul 28 06:53:24.464872 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.464777 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" podUID="0e2757c8-14cb-46df-901b-d6b1f1076002" containerName="registry" containerID="cri-o://5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67" gracePeriod=30 Jul 28 06:53:24.743908 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.743826 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:53:24.870064 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.870029 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e2757c8-14cb-46df-901b-d6b1f1076002-image-registry-private-configuration\") pod \"0e2757c8-14cb-46df-901b-d6b1f1076002\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " Jul 28 06:53:24.870256 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.870084 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e2757c8-14cb-46df-901b-d6b1f1076002-trusted-ca\") pod \"0e2757c8-14cb-46df-901b-d6b1f1076002\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " Jul 28 06:53:24.870256 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.870116 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-certificates\") pod \"0e2757c8-14cb-46df-901b-d6b1f1076002\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " Jul 28 06:53:24.870256 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.870160 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls\") pod \"0e2757c8-14cb-46df-901b-d6b1f1076002\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " Jul 28 06:53:24.870256 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.870188 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5nrs\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-kube-api-access-z5nrs\") pod \"0e2757c8-14cb-46df-901b-d6b1f1076002\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " Jul 28 06:53:24.870256 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.870217 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-bound-sa-token\") pod \"0e2757c8-14cb-46df-901b-d6b1f1076002\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " Jul 28 06:53:24.870526 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.870265 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e2757c8-14cb-46df-901b-d6b1f1076002-ca-trust-extracted\") pod \"0e2757c8-14cb-46df-901b-d6b1f1076002\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " Jul 28 06:53:24.870526 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.870296 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e2757c8-14cb-46df-901b-d6b1f1076002-installation-pull-secrets\") pod \"0e2757c8-14cb-46df-901b-d6b1f1076002\" (UID: \"0e2757c8-14cb-46df-901b-d6b1f1076002\") " Jul 28 06:53:24.870628 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.870605 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e2757c8-14cb-46df-901b-d6b1f1076002-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0e2757c8-14cb-46df-901b-d6b1f1076002" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:53:24.870681 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.870615 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0e2757c8-14cb-46df-901b-d6b1f1076002" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:53:24.872993 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.872955 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e2757c8-14cb-46df-901b-d6b1f1076002-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0e2757c8-14cb-46df-901b-d6b1f1076002" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:53:24.873146 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.873020 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-kube-api-access-z5nrs" (OuterVolumeSpecName: "kube-api-access-z5nrs") pod "0e2757c8-14cb-46df-901b-d6b1f1076002" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002"). InnerVolumeSpecName "kube-api-access-z5nrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 06:53:24.873146 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.873080 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e2757c8-14cb-46df-901b-d6b1f1076002-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0e2757c8-14cb-46df-901b-d6b1f1076002" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:53:24.873146 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.873118 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0e2757c8-14cb-46df-901b-d6b1f1076002" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 06:53:24.873261 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.873189 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0e2757c8-14cb-46df-901b-d6b1f1076002" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 06:53:24.879260 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.879212 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2757c8-14cb-46df-901b-d6b1f1076002-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0e2757c8-14cb-46df-901b-d6b1f1076002" (UID: "0e2757c8-14cb-46df-901b-d6b1f1076002"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 06:53:24.971716 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.971681 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e2757c8-14cb-46df-901b-d6b1f1076002-image-registry-private-configuration\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:53:24.971716 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.971717 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e2757c8-14cb-46df-901b-d6b1f1076002-trusted-ca\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:53:24.971716 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.971731 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-certificates\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:53:24.971980 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.971745 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-registry-tls\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:53:24.971980 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.971786 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5nrs\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-kube-api-access-z5nrs\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:53:24.971980 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.971802 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e2757c8-14cb-46df-901b-d6b1f1076002-bound-sa-token\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:53:24.971980 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.971815 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e2757c8-14cb-46df-901b-d6b1f1076002-ca-trust-extracted\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:53:24.971980 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:24.971830 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e2757c8-14cb-46df-901b-d6b1f1076002-installation-pull-secrets\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:53:25.124889 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:25.124856 2554 generic.go:356] "Generic (PLEG): container finished" podID="0e2757c8-14cb-46df-901b-d6b1f1076002" containerID="5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67" exitCode=0 Jul 28 06:53:25.125358 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:25.124899 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" Jul 28 06:53:25.125358 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:25.124927 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" event={"ID":"0e2757c8-14cb-46df-901b-d6b1f1076002","Type":"ContainerDied","Data":"5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67"} Jul 28 06:53:25.125358 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:25.124969 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb8d58dd6-5bhvj" event={"ID":"0e2757c8-14cb-46df-901b-d6b1f1076002","Type":"ContainerDied","Data":"d2fd82c4fb6e3a9e5647cda06df9fa26209bf1ea4e7d4c17518977206018a635"} Jul 28 06:53:25.125358 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:25.124989 2554 scope.go:117] "RemoveContainer" containerID="5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67" Jul 28 06:53:25.138127 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:25.138106 2554 scope.go:117] "RemoveContainer" containerID="5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67" Jul 28 06:53:25.138464 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:53:25.138442 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67\": container with ID starting with 5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67 not found: ID does not exist" containerID="5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67" Jul 28 06:53:25.138524 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:25.138473 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67"} err="failed to get container status \"5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67\": rpc error: code = NotFound desc = could not find container \"5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67\": container with ID starting with 5d9627008cf773be99900b668d9f734420feb4db8ee2e393da4727aa01629c67 not found: ID does not exist" Jul 28 06:53:25.148436 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:25.148413 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bb8d58dd6-5bhvj"] Jul 28 06:53:25.152375 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:25.152349 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bb8d58dd6-5bhvj"] Jul 28 06:53:25.418973 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:25.418888 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e2757c8-14cb-46df-901b-d6b1f1076002" path="/var/lib/kubelet/pods/0e2757c8-14cb-46df-901b-d6b1f1076002/volumes" Jul 28 06:53:28.140991 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:28.140957 2554 generic.go:356] "Generic (PLEG): container finished" podID="abbf8914-c198-470e-aa64-59beb776cf8c" containerID="e7712cb1d9c0fd62d225238ff1ca42939124c2e6111d4fed7de744622c7af6fa" exitCode=0 Jul 28 06:53:28.141471 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:28.141016 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-pz549" event={"ID":"abbf8914-c198-470e-aa64-59beb776cf8c","Type":"ContainerDied","Data":"e7712cb1d9c0fd62d225238ff1ca42939124c2e6111d4fed7de744622c7af6fa"} Jul 28 06:53:28.141471 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:28.141353 2554 scope.go:117] "RemoveContainer" containerID="e7712cb1d9c0fd62d225238ff1ca42939124c2e6111d4fed7de744622c7af6fa" Jul 28 06:53:29.150828 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:29.150749 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-pz549" event={"ID":"abbf8914-c198-470e-aa64-59beb776cf8c","Type":"ContainerStarted","Data":"904bd452161bd42e5838bf1fe06efd864e108a576c1c0de55d849c3561a2b18f"} Jul 28 06:53:30.923584 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:30.923552 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:35.881086 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:35.881052 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:53:35.884812 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:35.884791 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5778f6c5c9-nfs9g" Jul 28 06:53:57.672769 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:57.672724 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:53:57.688793 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:57.688749 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:53:58.284611 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:53:58.284586 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:10.350454 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:10.350421 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:54:10.557208 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:10.557173 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:54:15.709404 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:15.709318 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 06:54:15.709854 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:15.709650 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="kube-rbac-proxy" containerID="cri-o://2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc" gracePeriod=600 Jul 28 06:54:15.709854 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:15.709702 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="config-reloader" containerID="cri-o://4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1" gracePeriod=600 Jul 28 06:54:15.709854 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:15.709709 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175" gracePeriod=600 Jul 28 06:54:15.709854 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:15.709746 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="prometheus" containerID="cri-o://415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1" gracePeriod=600 Jul 28 06:54:15.709854 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:15.709704 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="kube-rbac-proxy-web" containerID="cri-o://33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855" gracePeriod=600 Jul 28 06:54:15.709854 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:15.709707 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="thanos-sidecar" containerID="cri-o://f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7" gracePeriod=600 Jul 28 06:54:15.953474 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:15.953448 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.113784 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.113736 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-1\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.113978 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.113807 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-kubelet-serving-ca-bundle\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.113978 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.113837 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.113978 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.113855 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-tls-assets\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.113978 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.113890 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-trusted-ca-bundle\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.113978 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.113930 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-serving-certs-ca-bundle\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.113978 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.113955 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-2\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.113978 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.113977 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-kube-rbac-proxy\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114002 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-thanos-prometheus-http-client-file\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114030 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-config\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114052 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-metrics-client-certs\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114104 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-0\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114130 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-tls\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114162 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-db\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114164 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114195 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-config-out\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114231 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-grpc-tls\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114257 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114295 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-metrics-client-ca\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114312 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:54:16.114334 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114319 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-web-config\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.115065 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114390 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhgrr\" (UniqueName: \"kubernetes.io/projected/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-kube-api-access-dhgrr\") pod \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\" (UID: \"016f86c6-c19a-4ae5-9e3d-8d87cca283e6\") " Jul 28 06:54:16.115065 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114399 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:54:16.115065 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114420 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:54:16.115065 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114794 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.115065 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114818 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.115065 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114834 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.115065 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.114848 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.115566 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.115513 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 06:54:16.116913 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.116890 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 06:54:16.117159 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.117129 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:54:16.117159 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.117151 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-config" (OuterVolumeSpecName: "config") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:54:16.117844 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.117497 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:54:16.117844 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.117529 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:54:16.117844 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.117570 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:54:16.118064 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.117857 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-kube-api-access-dhgrr" (OuterVolumeSpecName: "kube-api-access-dhgrr") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "kube-api-access-dhgrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 06:54:16.118064 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.117948 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:54:16.118064 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.117954 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:54:16.118442 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.118420 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:54:16.119156 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.119132 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:54:16.119682 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.119662 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-config-out" (OuterVolumeSpecName: "config-out") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 06:54:16.119922 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.119902 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:54:16.119987 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.119936 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:54:16.128095 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.128072 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-web-config" (OuterVolumeSpecName: "web-config") pod "016f86c6-c19a-4ae5-9e3d-8d87cca283e6" (UID: "016f86c6-c19a-4ae5-9e3d-8d87cca283e6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:54:16.215871 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215819 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.215871 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215863 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-tls-assets\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.215871 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215876 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.215871 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215886 2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-kube-rbac-proxy\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.216118 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215895 2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.216118 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215905 2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-config\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.216118 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215915 2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-metrics-client-certs\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.216118 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215923 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.216118 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215931 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.216118 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215939 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-prometheus-k8s-db\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.216118 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215948 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-config-out\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.216118 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215955 2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-grpc-tls\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.216118 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215963 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.216118 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215971 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-configmap-metrics-client-ca\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.216118 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215979 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-web-config\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.216118 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.215987 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhgrr\" (UniqueName: \"kubernetes.io/projected/016f86c6-c19a-4ae5-9e3d-8d87cca283e6-kube-api-access-dhgrr\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 06:54:16.347576 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347540 2554 generic.go:356] "Generic (PLEG): container finished" podID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerID="03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175" exitCode=0 Jul 28 06:54:16.347576 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347571 2554 generic.go:356] "Generic (PLEG): container finished" podID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerID="2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc" exitCode=0 Jul 28 06:54:16.347576 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347580 2554 generic.go:356] "Generic (PLEG): container finished" podID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerID="33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855" exitCode=0 Jul 28 06:54:16.347576 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347588 2554 generic.go:356] "Generic (PLEG): container finished" podID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerID="f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7" exitCode=0 Jul 28 06:54:16.347885 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347597 2554 generic.go:356] "Generic (PLEG): container finished" podID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerID="4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1" exitCode=0 Jul 28 06:54:16.347885 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347606 2554 generic.go:356] "Generic (PLEG): container finished" podID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerID="415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1" exitCode=0 Jul 28 06:54:16.347885 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347619 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerDied","Data":"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175"} Jul 28 06:54:16.347885 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347651 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.347885 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347725 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerDied","Data":"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc"} Jul 28 06:54:16.347885 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347766 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerDied","Data":"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855"} Jul 28 06:54:16.347885 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347783 2554 scope.go:117] "RemoveContainer" containerID="03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175" Jul 28 06:54:16.347885 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347793 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerDied","Data":"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7"} Jul 28 06:54:16.347885 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347819 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerDied","Data":"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1"} Jul 28 06:54:16.347885 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347843 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerDied","Data":"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1"} Jul 28 06:54:16.347885 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.347866 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"016f86c6-c19a-4ae5-9e3d-8d87cca283e6","Type":"ContainerDied","Data":"7242a43858858c1f4d42c30472a7003a8e4fb405ff8ddea82a192a62605f8842"} Jul 28 06:54:16.356276 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.356253 2554 scope.go:117] "RemoveContainer" containerID="2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc" Jul 28 06:54:16.363576 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.363557 2554 scope.go:117] "RemoveContainer" containerID="33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855" Jul 28 06:54:16.370791 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.370770 2554 scope.go:117] "RemoveContainer" containerID="f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7" Jul 28 06:54:16.372378 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.372355 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 06:54:16.376896 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.376872 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 06:54:16.378643 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.378623 2554 scope.go:117] "RemoveContainer" containerID="4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1" Jul 28 06:54:16.385998 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.385981 2554 scope.go:117] "RemoveContainer" containerID="415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1" Jul 28 06:54:16.393715 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.393698 2554 scope.go:117] "RemoveContainer" containerID="ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466" Jul 28 06:54:16.400738 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.400717 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 06:54:16.401054 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401041 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="prometheus" Jul 28 06:54:16.401099 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401056 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="prometheus" Jul 28 06:54:16.401099 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401064 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="kube-rbac-proxy-thanos" Jul 28 06:54:16.401099 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401074 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="kube-rbac-proxy-thanos" Jul 28 06:54:16.401099 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401085 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e2757c8-14cb-46df-901b-d6b1f1076002" containerName="registry" Jul 28 06:54:16.401099 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401091 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e2757c8-14cb-46df-901b-d6b1f1076002" containerName="registry" Jul 28 06:54:16.401099 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401097 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="kube-rbac-proxy" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401103 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="kube-rbac-proxy" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401118 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="config-reloader" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401123 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="config-reloader" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401129 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="thanos-sidecar" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401134 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="thanos-sidecar" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401140 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="init-config-reloader" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401149 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="init-config-reloader" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401158 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="kube-rbac-proxy-web" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401162 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="kube-rbac-proxy-web" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401213 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="kube-rbac-proxy-thanos" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401224 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="kube-rbac-proxy" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401234 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="thanos-sidecar" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401241 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e2757c8-14cb-46df-901b-d6b1f1076002" containerName="registry" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401246 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="config-reloader" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401252 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="kube-rbac-proxy-web" Jul 28 06:54:16.401274 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401259 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" containerName="prometheus" Jul 28 06:54:16.401900 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401305 2554 scope.go:117] "RemoveContainer" containerID="03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175" Jul 28 06:54:16.401900 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:54:16.401593 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": container with ID starting with 03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175 not found: ID does not exist" containerID="03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175" Jul 28 06:54:16.401900 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401617 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175"} err="failed to get container status \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": rpc error: code = NotFound desc = could not find container \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": container with ID starting with 03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175 not found: ID does not exist" Jul 28 06:54:16.401900 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401635 2554 scope.go:117] "RemoveContainer" containerID="2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc" Jul 28 06:54:16.401900 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:54:16.401877 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": container with ID starting with 2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc not found: ID does not exist" containerID="2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc" Jul 28 06:54:16.402072 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401900 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc"} err="failed to get container status \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": rpc error: code = NotFound desc = could not find container \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": container with ID starting with 2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc not found: ID does not exist" Jul 28 06:54:16.402072 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.401918 2554 scope.go:117] "RemoveContainer" containerID="33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855" Jul 28 06:54:16.402147 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:54:16.402130 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": container with ID starting with 33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855 not found: ID does not exist" containerID="33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855" Jul 28 06:54:16.402181 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.402145 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855"} err="failed to get container status \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": rpc error: code = NotFound desc = could not find container \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": container with ID starting with 33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855 not found: ID does not exist" Jul 28 06:54:16.402181 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.402158 2554 scope.go:117] "RemoveContainer" containerID="f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7" Jul 28 06:54:16.402356 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:54:16.402341 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": container with ID starting with f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7 not found: ID does not exist" containerID="f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7" Jul 28 06:54:16.402399 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.402360 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7"} err="failed to get container status \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": rpc error: code = NotFound desc = could not find container \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": container with ID starting with f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7 not found: ID does not exist" Jul 28 06:54:16.402399 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.402373 2554 scope.go:117] "RemoveContainer" containerID="4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1" Jul 28 06:54:16.402553 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:54:16.402540 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": container with ID starting with 4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1 not found: ID does not exist" containerID="4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1" Jul 28 06:54:16.402591 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.402557 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1"} err="failed to get container status \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": rpc error: code = NotFound desc = could not find container \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": container with ID starting with 4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1 not found: ID does not exist" Jul 28 06:54:16.402591 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.402569 2554 scope.go:117] "RemoveContainer" containerID="415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1" Jul 28 06:54:16.402733 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:54:16.402717 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": container with ID starting with 415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1 not found: ID does not exist" containerID="415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1" Jul 28 06:54:16.402796 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.402734 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1"} err="failed to get container status \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": rpc error: code = NotFound desc = could not find container \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": container with ID starting with 415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1 not found: ID does not exist" Jul 28 06:54:16.402796 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.402749 2554 scope.go:117] "RemoveContainer" containerID="ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466" Jul 28 06:54:16.402993 ip-10-0-130-140 kubenswrapper[2554]: E0728 06:54:16.402974 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": container with ID starting with ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466 not found: ID does not exist" containerID="ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466" Jul 28 06:54:16.403063 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.403001 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466"} err="failed to get container status \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": rpc error: code = NotFound desc = could not find container \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": container with ID starting with ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466 not found: ID does not exist" Jul 28 06:54:16.403063 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.403022 2554 scope.go:117] "RemoveContainer" containerID="03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175" Jul 28 06:54:16.403273 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.403257 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175"} err="failed to get container status \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": rpc error: code = NotFound desc = could not find container \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": container with ID starting with 03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175 not found: ID does not exist" Jul 28 06:54:16.403327 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.403275 2554 scope.go:117] "RemoveContainer" containerID="2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc" Jul 28 06:54:16.403516 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.403488 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc"} err="failed to get container status \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": rpc error: code = NotFound desc = could not find container \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": container with ID starting with 2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc not found: ID does not exist" Jul 28 06:54:16.403560 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.403516 2554 scope.go:117] "RemoveContainer" containerID="33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855" Jul 28 06:54:16.403749 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.403720 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855"} err="failed to get container status \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": rpc error: code = NotFound desc = could not find container \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": container with ID starting with 33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855 not found: ID does not exist" Jul 28 06:54:16.403749 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.403783 2554 scope.go:117] "RemoveContainer" containerID="f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7" Jul 28 06:54:16.404039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.404018 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7"} err="failed to get container status \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": rpc error: code = NotFound desc = could not find container \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": container with ID starting with f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7 not found: ID does not exist" Jul 28 06:54:16.404039 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.404042 2554 scope.go:117] "RemoveContainer" containerID="4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1" Jul 28 06:54:16.404255 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.404236 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1"} err="failed to get container status \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": rpc error: code = NotFound desc = could not find container \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": container with ID starting with 4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1 not found: ID does not exist" Jul 28 06:54:16.404311 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.404256 2554 scope.go:117] "RemoveContainer" containerID="415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1" Jul 28 06:54:16.404477 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.404461 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1"} err="failed to get container status \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": rpc error: code = NotFound desc = could not find container \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": container with ID starting with 415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1 not found: ID does not exist" Jul 28 06:54:16.404517 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.404479 2554 scope.go:117] "RemoveContainer" containerID="ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466" Jul 28 06:54:16.404834 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.404686 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466"} err="failed to get container status \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": rpc error: code = NotFound desc = could not find container \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": container with ID starting with ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466 not found: ID does not exist" Jul 28 06:54:16.404834 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.404708 2554 scope.go:117] "RemoveContainer" containerID="03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175" Jul 28 06:54:16.404945 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.404907 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175"} err="failed to get container status \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": rpc error: code = NotFound desc = could not find container \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": container with ID starting with 03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175 not found: ID does not exist" Jul 28 06:54:16.404945 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.404919 2554 scope.go:117] "RemoveContainer" containerID="2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc" Jul 28 06:54:16.405124 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.405109 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc"} err="failed to get container status \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": rpc error: code = NotFound desc = could not find container \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": container with ID starting with 2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc not found: ID does not exist" Jul 28 06:54:16.405176 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.405124 2554 scope.go:117] "RemoveContainer" containerID="33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855" Jul 28 06:54:16.405310 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.405290 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855"} err="failed to get container status \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": rpc error: code = NotFound desc = could not find container \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": container with ID starting with 33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855 not found: ID does not exist" Jul 28 06:54:16.405310 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.405309 2554 scope.go:117] "RemoveContainer" containerID="f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7" Jul 28 06:54:16.405481 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.405464 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.405541 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.405495 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7"} err="failed to get container status \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": rpc error: code = NotFound desc = could not find container \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": container with ID starting with f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7 not found: ID does not exist" Jul 28 06:54:16.405541 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.405507 2554 scope.go:117] "RemoveContainer" containerID="4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1" Jul 28 06:54:16.405866 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.405722 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1"} err="failed to get container status \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": rpc error: code = NotFound desc = could not find container \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": container with ID starting with 4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1 not found: ID does not exist" Jul 28 06:54:16.405866 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.405744 2554 scope.go:117] "RemoveContainer" containerID="415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1" Jul 28 06:54:16.406076 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.406052 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1"} err="failed to get container status \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": rpc error: code = NotFound desc = could not find container \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": container with ID starting with 415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1 not found: ID does not exist" Jul 28 06:54:16.406076 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.406075 2554 scope.go:117] "RemoveContainer" containerID="ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466" Jul 28 06:54:16.406347 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.406325 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466"} err="failed to get container status \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": rpc error: code = NotFound desc = could not find container \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": container with ID starting with ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466 not found: ID does not exist" Jul 28 06:54:16.406414 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.406348 2554 scope.go:117] "RemoveContainer" containerID="03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175" Jul 28 06:54:16.406587 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.406560 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175"} err="failed to get container status \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": rpc error: code = NotFound desc = could not find container \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": container with ID starting with 03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175 not found: ID does not exist" Jul 28 06:54:16.406587 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.406580 2554 scope.go:117] "RemoveContainer" containerID="2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc" Jul 28 06:54:16.406927 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.406902 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc"} err="failed to get container status \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": rpc error: code = NotFound desc = could not find container \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": container with ID starting with 2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc not found: ID does not exist" Jul 28 06:54:16.407002 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.406928 2554 scope.go:117] "RemoveContainer" containerID="33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855" Jul 28 06:54:16.407196 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.407180 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855"} err="failed to get container status \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": rpc error: code = NotFound desc = could not find container \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": container with ID starting with 33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855 not found: ID does not exist" Jul 28 06:54:16.407253 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.407197 2554 scope.go:117] "RemoveContainer" containerID="f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7" Jul 28 06:54:16.407471 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.407454 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7"} err="failed to get container status \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": rpc error: code = NotFound desc = could not find container \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": container with ID starting with f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7 not found: ID does not exist" Jul 28 06:54:16.407532 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.407474 2554 scope.go:117] "RemoveContainer" containerID="4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1" Jul 28 06:54:16.407714 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.407697 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1"} err="failed to get container status \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": rpc error: code = NotFound desc = could not find container \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": container with ID starting with 4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1 not found: ID does not exist" Jul 28 06:54:16.407801 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.407718 2554 scope.go:117] "RemoveContainer" containerID="415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1" Jul 28 06:54:16.408001 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.407981 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1"} err="failed to get container status \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": rpc error: code = NotFound desc = could not find container \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": container with ID starting with 415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1 not found: ID does not exist" Jul 28 06:54:16.408001 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.408000 2554 scope.go:117] "RemoveContainer" containerID="ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466" Jul 28 06:54:16.408203 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.408188 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 06:54:16.408262 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.408244 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466"} err="failed to get container status \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": rpc error: code = NotFound desc = could not find container \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": container with ID starting with ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466 not found: ID does not exist" Jul 28 06:54:16.408303 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.408265 2554 scope.go:117] "RemoveContainer" containerID="03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175" Jul 28 06:54:16.408358 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.408291 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 06:54:16.408453 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.408439 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cdmk8\"" Jul 28 06:54:16.408502 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.408188 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 06:54:16.408558 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.408507 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175"} err="failed to get container status \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": rpc error: code = NotFound desc = could not find container \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": container with ID starting with 03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175 not found: ID does not exist" Jul 28 06:54:16.408558 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.408526 2554 scope.go:117] "RemoveContainer" containerID="2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc" Jul 28 06:54:16.408718 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.408674 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 06:54:16.408842 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.408797 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc"} err="failed to get container status \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": rpc error: code = NotFound desc = could not find container \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": container with ID starting with 2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc not found: ID does not exist" Jul 28 06:54:16.408842 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.408843 2554 scope.go:117] "RemoveContainer" containerID="33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855" Jul 28 06:54:16.409100 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409084 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 06:54:16.409214 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409102 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855"} err="failed to get container status \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": rpc error: code = NotFound desc = could not find container \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": container with ID starting with 33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855 not found: ID does not exist" Jul 28 06:54:16.409214 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409122 2554 scope.go:117] "RemoveContainer" containerID="f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7" Jul 28 06:54:16.409366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409257 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 06:54:16.409366 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409299 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 06:54:16.409513 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409374 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 06:54:16.409513 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409258 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 06:54:16.409637 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409556 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7"} err="failed to get container status \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": rpc error: code = NotFound desc = could not find container \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": container with ID starting with f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7 not found: ID does not exist" Jul 28 06:54:16.409637 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409579 2554 scope.go:117] "RemoveContainer" containerID="4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1" Jul 28 06:54:16.409637 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409602 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 06:54:16.409898 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409835 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 06:54:16.409898 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409861 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1"} err="failed to get container status \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": rpc error: code = NotFound desc = could not find container \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": container with ID starting with 4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1 not found: ID does not exist" Jul 28 06:54:16.409898 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409883 2554 scope.go:117] "RemoveContainer" containerID="415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1" Jul 28 06:54:16.410080 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409917 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 06:54:16.410080 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.409942 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-j43p67da0agv\"" Jul 28 06:54:16.410230 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.410205 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1"} err="failed to get container status \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": rpc error: code = NotFound desc = could not find container \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": container with ID starting with 415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1 not found: ID does not exist" Jul 28 06:54:16.410335 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.410240 2554 scope.go:117] "RemoveContainer" containerID="ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466" Jul 28 06:54:16.410578 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.410549 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466"} err="failed to get container status \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": rpc error: code = NotFound desc = could not find container \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": container with ID starting with ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466 not found: ID does not exist" Jul 28 06:54:16.410578 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.410574 2554 scope.go:117] "RemoveContainer" containerID="03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175" Jul 28 06:54:16.410866 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.410843 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175"} err="failed to get container status \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": rpc error: code = NotFound desc = could not find container \"03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175\": container with ID starting with 03927b1e5942231b74683ba9471c11ce5917009c9481ce77650b59e78caa7175 not found: ID does not exist" Jul 28 06:54:16.410866 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.410862 2554 scope.go:117] "RemoveContainer" containerID="2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc" Jul 28 06:54:16.411110 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.411090 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc"} err="failed to get container status \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": rpc error: code = NotFound desc = could not find container \"2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc\": container with ID starting with 2c8648fbe500748b060ab3cde0a53d6106bd00a0ce1e1869ae64544cdda712dc not found: ID does not exist" Jul 28 06:54:16.411172 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.411110 2554 scope.go:117] "RemoveContainer" containerID="33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855" Jul 28 06:54:16.411388 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.411329 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855"} err="failed to get container status \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": rpc error: code = NotFound desc = could not find container \"33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855\": container with ID starting with 33f3e382e79714d6a4830dcde5a67e732df4941fe18396fe222956b87e34d855 not found: ID does not exist" Jul 28 06:54:16.411388 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.411375 2554 scope.go:117] "RemoveContainer" containerID="f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7" Jul 28 06:54:16.411654 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.411628 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7"} err="failed to get container status \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": rpc error: code = NotFound desc = could not find container \"f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7\": container with ID starting with f89215921edf61325ef6bc8a6206ddc84b7525713e581b170168e226340d5ed7 not found: ID does not exist" Jul 28 06:54:16.411743 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.411655 2554 scope.go:117] "RemoveContainer" containerID="4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1" Jul 28 06:54:16.411933 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.411915 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1"} err="failed to get container status \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": rpc error: code = NotFound desc = could not find container \"4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1\": container with ID starting with 4c73c67e59643d9b9e74b2595046d49714efc45e13dbbb155bba78be83256fe1 not found: ID does not exist" Jul 28 06:54:16.411990 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.411933 2554 scope.go:117] "RemoveContainer" containerID="415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1" Jul 28 06:54:16.412160 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.412132 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1"} err="failed to get container status \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": rpc error: code = NotFound desc = could not find container \"415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1\": container with ID starting with 415d5114da6f3958a2dd85a51cbae851fe5eba26ff4a49fee01938d3671d71b1 not found: ID does not exist" Jul 28 06:54:16.412261 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.412162 2554 scope.go:117] "RemoveContainer" containerID="ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466" Jul 28 06:54:16.412513 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.412489 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466"} err="failed to get container status \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": rpc error: code = NotFound desc = could not find container \"ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466\": container with ID starting with ac071a0ec619fde78175599a2efba8696fcaa8d8de14c57cba3ef560895a7466 not found: ID does not exist" Jul 28 06:54:16.412653 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.412633 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 06:54:16.414108 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.414090 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 06:54:16.420490 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.420470 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 06:54:16.518749 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.518712 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.518749 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.518746 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519051 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.518824 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519051 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.518872 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-web-config\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519051 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.518904 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519051 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.518926 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519051 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.518953 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abf7fffb-58b3-47c0-b597-9d1100b4118e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519051 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.518974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhmjt\" (UniqueName: \"kubernetes.io/projected/abf7fffb-58b3-47c0-b597-9d1100b4118e-kube-api-access-dhmjt\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519051 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.519008 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519051 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.519035 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519341 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.519068 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abf7fffb-58b3-47c0-b597-9d1100b4118e-config-out\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519341 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.519119 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519341 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.519151 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519341 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.519170 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519341 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.519203 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519341 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.519224 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519341 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.519258 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519341 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.519275 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519341 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.519315 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-config\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.519341 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.519332 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620162 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620054 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620162 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620113 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620162 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620140 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-config\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620162 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620155 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620485 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620183 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620485 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620199 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620485 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620220 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620485 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620316 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-web-config\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620683 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620683 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620584 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620683 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620615 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abf7fffb-58b3-47c0-b597-9d1100b4118e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620683 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620644 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhmjt\" (UniqueName: \"kubernetes.io/projected/abf7fffb-58b3-47c0-b597-9d1100b4118e-kube-api-access-dhmjt\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620905 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620688 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620905 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620713 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620905 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abf7fffb-58b3-47c0-b597-9d1100b4118e-config-out\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620905 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620776 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.620905 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.620799 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.621267 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.621246 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.621350 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.621277 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.621849 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.621827 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.623173 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.623145 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.624223 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.623331 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.624223 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.623400 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-config\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.624223 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.623447 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/abf7fffb-58b3-47c0-b597-9d1100b4118e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.624223 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.623453 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.624223 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.623511 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.624223 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.623554 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.624223 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.623574 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.624223 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.623612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.624223 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.623661 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.624223 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.624183 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.624806 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.624686 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.625087 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.625067 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.625241 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.625219 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/abf7fffb-58b3-47c0-b597-9d1100b4118e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.625527 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.625504 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/abf7fffb-58b3-47c0-b597-9d1100b4118e-config-out\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.626049 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.626029 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.626129 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.626049 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.626242 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.626227 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-web-config\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.626309 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.626294 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/abf7fffb-58b3-47c0-b597-9d1100b4118e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.630226 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.630202 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhmjt\" (UniqueName: \"kubernetes.io/projected/abf7fffb-58b3-47c0-b597-9d1100b4118e-kube-api-access-dhmjt\") pod \"prometheus-k8s-0\" (UID: \"abf7fffb-58b3-47c0-b597-9d1100b4118e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.717271 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.717220 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:16.858397 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:16.858285 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 06:54:16.860835 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:54:16.860812 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf7fffb_58b3_47c0_b597_9d1100b4118e.slice/crio-6b400d4eeb878dc745580ce459026ee82dfd17502e34f2a98702c6a483dfcb72 WatchSource:0}: Error finding container 6b400d4eeb878dc745580ce459026ee82dfd17502e34f2a98702c6a483dfcb72: Status 404 returned error can't find the container with id 6b400d4eeb878dc745580ce459026ee82dfd17502e34f2a98702c6a483dfcb72 Jul 28 06:54:17.354093 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:17.354061 2554 generic.go:356] "Generic (PLEG): container finished" podID="abf7fffb-58b3-47c0-b597-9d1100b4118e" containerID="ed672a7bf37de034c18d78c8f1c3515fdd9da50c9812bf30a69525132d951328" exitCode=0 Jul 28 06:54:17.354246 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:17.354147 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abf7fffb-58b3-47c0-b597-9d1100b4118e","Type":"ContainerDied","Data":"ed672a7bf37de034c18d78c8f1c3515fdd9da50c9812bf30a69525132d951328"} Jul 28 06:54:17.354246 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:17.354218 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abf7fffb-58b3-47c0-b597-9d1100b4118e","Type":"ContainerStarted","Data":"6b400d4eeb878dc745580ce459026ee82dfd17502e34f2a98702c6a483dfcb72"} Jul 28 06:54:17.423511 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:17.422215 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016f86c6-c19a-4ae5-9e3d-8d87cca283e6" path="/var/lib/kubelet/pods/016f86c6-c19a-4ae5-9e3d-8d87cca283e6/volumes" Jul 28 06:54:18.363343 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:18.363302 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abf7fffb-58b3-47c0-b597-9d1100b4118e","Type":"ContainerStarted","Data":"d52b6c3cbecb61aa0f26dfbf8856302e675f0be965876cde5f136c7fa4b44b7f"} Jul 28 06:54:18.363723 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:18.363364 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abf7fffb-58b3-47c0-b597-9d1100b4118e","Type":"ContainerStarted","Data":"f88409388076603c03bd19df04ae3b86adc1100ad2b575a2e5c7f082fe2e6eae"} Jul 28 06:54:18.363723 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:18.363390 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abf7fffb-58b3-47c0-b597-9d1100b4118e","Type":"ContainerStarted","Data":"54697088b6c12b8900e17c74410d43a9af44436d7d8b2736282a1b0dbaf03332"} Jul 28 06:54:18.363723 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:18.363417 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abf7fffb-58b3-47c0-b597-9d1100b4118e","Type":"ContainerStarted","Data":"d637c9a7ef7bdf54d95c13119b6817ec6edf4848c7f70c69600eb43cb5b50cca"} Jul 28 06:54:18.363723 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:18.363440 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abf7fffb-58b3-47c0-b597-9d1100b4118e","Type":"ContainerStarted","Data":"9f72447ecfafe4926fcb09b15e45b15440c4e19220ce691c6d7b0e728d901d05"} Jul 28 06:54:18.363723 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:18.363464 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"abf7fffb-58b3-47c0-b597-9d1100b4118e","Type":"ContainerStarted","Data":"c9d532ca841eda38c3a4abac7714eb42aae5f90639459bc09a191aeb995eaa65"} Jul 28 06:54:18.393195 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:18.393140 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.370429485 podStartE2EDuration="2.393118576s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.689091ms" isStatefulPod=false podCreationTimestamp="2026-07-28 06:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:54:18.391409108 +0000 UTC m=+175.496099218" watchObservedRunningTime="2026-07-28 06:54:18.393118576 +0000 UTC m=+175.497808686" Jul 28 06:54:18.785709 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:18.785632 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:54:18.846932 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:18.846899 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:54:21.717915 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:21.717877 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:54:29.894681 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:29.894648 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:54:29.995183 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:29.995144 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:54:30.048824 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:30.048792 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:54:59.300568 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:54:59.300534 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:55:16.717728 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:55:16.717685 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:55:16.733832 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:55:16.733802 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:55:17.624683 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:55:17.624654 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:55:25.580869 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:55:25.580840 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:55:25.633194 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:55:25.633165 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:55:37.588304 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:55:37.588269 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:55:37.644966 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:55:37.644936 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:55:51.420894 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:55:51.420859 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:55:51.520696 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:55:51.520662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:55:52.025734 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:55:52.025704 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:55:52.119528 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:55:52.119498 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:55:53.446161 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:55:53.446124 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:02.201416 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:02.201385 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:02.302271 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:02.302239 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:02.403374 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:02.403337 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:02.456291 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:02.456208 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:10.565191 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:10.565159 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:23.269874 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:23.269846 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/2.log" Jul 28 06:56:23.279675 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:23.279646 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovn-acl-logging/0.log" Jul 28 06:56:23.281821 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:23.281798 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/2.log" Jul 28 06:56:23.286781 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:23.286742 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovn-acl-logging/0.log" Jul 28 06:56:23.287244 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:23.287225 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 06:56:25.731141 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:25.731103 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:25.830846 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:25.830817 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:47.424058 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:47.424027 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:48.566163 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:48.566128 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:50.838490 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:50.838456 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:50.899069 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:50.899042 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:52.700966 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:52.700936 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:52.807680 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:52.807644 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:54.722565 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:54.722531 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:55.099362 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:55.099335 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:55.471800 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:55.471657 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:55.560379 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:55.560346 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:59.984126 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:56:59.984075 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:00.081497 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:57:00.081464 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:03.506218 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:57:03.506185 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:14.714090 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:57:14.713996 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:14.813900 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:57:14.813865 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:26.265258 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:57:26.265225 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:26.365730 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:57:26.365699 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:35.855085 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:57:35.855039 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:36.261880 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:57:36.261739 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:36.315908 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:57:36.315877 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:38.263893 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:57:38.263859 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:25.813241 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:58:25.813194 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:25.903204 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:58:25.903173 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:25.969155 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:58:25.969122 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:14.847099 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:14.847060 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:14.948815 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:14.948782 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:17.096008 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.095973 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt"] Jul 28 06:59:17.098171 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.098155 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:17.100927 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.100896 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:17.103693 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.103634 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 28 06:59:17.103877 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.103745 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-7zzs6\"" Jul 28 06:59:17.103952 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.103912 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 28 06:59:17.104599 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.104581 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 28 06:59:17.104721 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.104606 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 28 06:59:17.124345 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.124309 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt"] Jul 28 06:59:17.162265 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.162223 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjmg4\" (UniqueName: \"kubernetes.io/projected/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-kube-api-access-sjmg4\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt\" (UID: \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:17.162265 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.162273 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt\" (UID: \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:17.162482 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.162394 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt\" (UID: \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:17.263654 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.263612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt\" (UID: \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:17.263910 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.263711 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt\" (UID: \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:17.263910 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.263810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjmg4\" (UniqueName: \"kubernetes.io/projected/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-kube-api-access-sjmg4\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt\" (UID: \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:17.264394 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.264349 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt\" (UID: \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:17.266265 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.266202 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt\" (UID: \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:17.273943 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.273918 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjmg4\" (UniqueName: \"kubernetes.io/projected/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-kube-api-access-sjmg4\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt\" (UID: \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:17.415112 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.415018 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:17.552341 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.552306 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt"] Jul 28 06:59:17.554973 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:59:17.554943 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc29c40e5_cdd5_4fe9_8734_4717aedb5fd3.slice/crio-588502977b635370c43e9e9a03fa828b14d760492540d9c19a17e3d1cf9be958 WatchSource:0}: Error finding container 588502977b635370c43e9e9a03fa828b14d760492540d9c19a17e3d1cf9be958: Status 404 returned error can't find the container with id 588502977b635370c43e9e9a03fa828b14d760492540d9c19a17e3d1cf9be958 Jul 28 06:59:17.557001 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.556985 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 06:59:17.634261 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:17.634231 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:18.563167 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:18.563128 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" event={"ID":"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3","Type":"ContainerStarted","Data":"588502977b635370c43e9e9a03fa828b14d760492540d9c19a17e3d1cf9be958"} Jul 28 06:59:20.572297 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:20.572260 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" event={"ID":"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3","Type":"ContainerStarted","Data":"7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775"} Jul 28 06:59:20.572857 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:20.572386 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:20.590337 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:20.590292 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" podStartSLOduration=1.262474446 podStartE2EDuration="3.590277357s" totalImagesPullingTime="2.327802911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:59:20.589005362 +0000 UTC m=+477.693695473" watchObservedRunningTime="2026-07-28 06:59:20.590277357 +0000 UTC m=+477.694967509" Jul 28 06:59:20.770465 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:20.770430 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:24.261182 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:24.261148 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:24.353951 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:24.353920 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:24.438025 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:24.437999 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:24.956764 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:24.956705 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:25.058358 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:25.058327 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:34.901189 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:34.901158 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:35.001200 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:35.001170 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:35.102532 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:35.102499 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:36.284571 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:36.284534 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:36.581806 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:36.581707 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 06:59:37.854719 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:37.854686 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:37.890896 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:37.890859 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-q6czs"] Jul 28 06:59:37.896448 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:37.896406 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-q6czs" Jul 28 06:59:37.900145 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:37.900116 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dlqzp\"" Jul 28 06:59:37.903981 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:37.903953 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-q6czs"] Jul 28 06:59:38.050569 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:38.050529 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86wws\" (UniqueName: \"kubernetes.io/projected/3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf-kube-api-access-86wws\") pod \"test-trainjob-workflow-node-0-0-q6czs\" (UID: \"3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf\") " pod="opendatahub/test-trainjob-workflow-node-0-0-q6czs" Jul 28 06:59:38.152008 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:38.151917 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86wws\" (UniqueName: \"kubernetes.io/projected/3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf-kube-api-access-86wws\") pod \"test-trainjob-workflow-node-0-0-q6czs\" (UID: \"3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf\") " pod="opendatahub/test-trainjob-workflow-node-0-0-q6czs" Jul 28 06:59:38.160997 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:38.160962 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86wws\" (UniqueName: \"kubernetes.io/projected/3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf-kube-api-access-86wws\") pod \"test-trainjob-workflow-node-0-0-q6czs\" (UID: \"3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf\") " pod="opendatahub/test-trainjob-workflow-node-0-0-q6czs" Jul 28 06:59:38.208212 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:38.208164 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-q6czs" Jul 28 06:59:38.343495 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:38.343471 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-q6czs"] Jul 28 06:59:38.346118 ip-10-0-130-140 kubenswrapper[2554]: W0728 06:59:38.346089 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cca3e9c_d8e2_4751_ba2a_c0ebf0d291bf.slice/crio-2f72e03fd88e9052f8cdb1b99c5dfcb93adcab1a514c412ab712475628c79df6 WatchSource:0}: Error finding container 2f72e03fd88e9052f8cdb1b99c5dfcb93adcab1a514c412ab712475628c79df6: Status 404 returned error can't find the container with id 2f72e03fd88e9052f8cdb1b99c5dfcb93adcab1a514c412ab712475628c79df6 Jul 28 06:59:38.645405 ip-10-0-130-140 kubenswrapper[2554]: I0728 06:59:38.645371 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-q6czs" event={"ID":"3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf","Type":"ContainerStarted","Data":"2f72e03fd88e9052f8cdb1b99c5dfcb93adcab1a514c412ab712475628c79df6"} Jul 28 07:00:31.587594 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:31.587496 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:31.688861 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:31.688823 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:43.983908 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:43.983860 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-q6czs" event={"ID":"3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf","Type":"ContainerStarted","Data":"4df387aa4f1029e2361a524cbc074f98abb1f6133430c60e309b584e9f9103a7"} Jul 28 07:00:46.998114 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:46.998080 2554 generic.go:356] "Generic (PLEG): container finished" podID="3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf" containerID="4df387aa4f1029e2361a524cbc074f98abb1f6133430c60e309b584e9f9103a7" exitCode=0 Jul 28 07:00:46.998503 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:46.998153 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-q6czs" event={"ID":"3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf","Type":"ContainerDied","Data":"4df387aa4f1029e2361a524cbc074f98abb1f6133430c60e309b584e9f9103a7"} Jul 28 07:00:48.169897 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:48.169861 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-q6czs" Jul 28 07:00:48.227620 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:48.227584 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86wws\" (UniqueName: \"kubernetes.io/projected/3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf-kube-api-access-86wws\") pod \"3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf\" (UID: \"3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf\") " Jul 28 07:00:48.229831 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:48.229807 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf-kube-api-access-86wws" (OuterVolumeSpecName: "kube-api-access-86wws") pod "3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf" (UID: "3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf"). InnerVolumeSpecName "kube-api-access-86wws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:00:48.328354 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:48.328265 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86wws\" (UniqueName: \"kubernetes.io/projected/3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf-kube-api-access-86wws\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 07:00:49.007773 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:49.007724 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-q6czs" Jul 28 07:00:49.007974 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:49.007727 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-q6czs" event={"ID":"3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf","Type":"ContainerDied","Data":"2f72e03fd88e9052f8cdb1b99c5dfcb93adcab1a514c412ab712475628c79df6"} Jul 28 07:00:49.007974 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:49.007825 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f72e03fd88e9052f8cdb1b99c5dfcb93adcab1a514c412ab712475628c79df6" Jul 28 07:00:50.028569 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.028536 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-q6czs"] Jul 28 07:00:50.032304 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.032279 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-q6czs"] Jul 28 07:00:50.064426 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.064393 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:50.184265 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.184221 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt"] Jul 28 07:00:50.184464 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.184421 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" podUID="c29c40e5-cdd5-4fe9-8734-4717aedb5fd3" containerName="manager" containerID="cri-o://7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775" gracePeriod=30 Jul 28 07:00:50.188392 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.188362 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:50.292163 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.292089 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:50.400846 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.400816 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:50.463297 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.463253 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 07:00:50.488621 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.488573 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:50.545864 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.545771 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-kubeflow-trainer-config\") pod \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\" (UID: \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\") " Jul 28 07:00:50.546038 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.545873 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjmg4\" (UniqueName: \"kubernetes.io/projected/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-kube-api-access-sjmg4\") pod \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\" (UID: \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\") " Jul 28 07:00:50.546038 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.545920 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-cert\") pod \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\" (UID: \"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3\") " Jul 28 07:00:50.547926 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.547883 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-kube-api-access-sjmg4" (OuterVolumeSpecName: "kube-api-access-sjmg4") pod "c29c40e5-cdd5-4fe9-8734-4717aedb5fd3" (UID: "c29c40e5-cdd5-4fe9-8734-4717aedb5fd3"). InnerVolumeSpecName "kube-api-access-sjmg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:00:50.547926 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.547902 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-cert" (OuterVolumeSpecName: "cert") pod "c29c40e5-cdd5-4fe9-8734-4717aedb5fd3" (UID: "c29c40e5-cdd5-4fe9-8734-4717aedb5fd3"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:00:50.550425 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.550400 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "c29c40e5-cdd5-4fe9-8734-4717aedb5fd3" (UID: "c29c40e5-cdd5-4fe9-8734-4717aedb5fd3"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:00:50.647153 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.647116 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjmg4\" (UniqueName: \"kubernetes.io/projected/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-kube-api-access-sjmg4\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 07:00:50.647153 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.647146 2554 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-cert\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 07:00:50.647153 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:50.647156 2554 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3-kubeflow-trainer-config\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 07:00:51.018299 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.018262 2554 generic.go:356] "Generic (PLEG): container finished" podID="c29c40e5-cdd5-4fe9-8734-4717aedb5fd3" containerID="7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775" exitCode=0 Jul 28 07:00:51.018488 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.018317 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" Jul 28 07:00:51.018488 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.018321 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" event={"ID":"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3","Type":"ContainerDied","Data":"7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775"} Jul 28 07:00:51.018488 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.018357 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt" event={"ID":"c29c40e5-cdd5-4fe9-8734-4717aedb5fd3","Type":"ContainerDied","Data":"588502977b635370c43e9e9a03fa828b14d760492540d9c19a17e3d1cf9be958"} Jul 28 07:00:51.018488 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.018375 2554 scope.go:117] "RemoveContainer" containerID="7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775" Jul 28 07:00:51.031202 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.031176 2554 scope.go:117] "RemoveContainer" containerID="7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775" Jul 28 07:00:51.031556 ip-10-0-130-140 kubenswrapper[2554]: E0728 07:00:51.031534 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775\": container with ID starting with 7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775 not found: ID does not exist" containerID="7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775" Jul 28 07:00:51.031617 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.031569 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775"} err="failed to get container status \"7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775\": rpc error: code = NotFound desc = could not find container \"7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775\": container with ID starting with 7c67cb35bf63cafcd35c02408279d6061d3f74396dfebdd03098c1cf5abe8775 not found: ID does not exist" Jul 28 07:00:51.045265 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.045235 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt"] Jul 28 07:00:51.048438 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.048413 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-7rkgt"] Jul 28 07:00:51.419602 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.419561 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf" path="/var/lib/kubelet/pods/3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf/volumes" Jul 28 07:00:51.420072 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.420052 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c29c40e5-cdd5-4fe9-8734-4717aedb5fd3" path="/var/lib/kubelet/pods/c29c40e5-cdd5-4fe9-8734-4717aedb5fd3/volumes" Jul 28 07:00:51.448652 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.448620 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dr6gn/must-gather-s8h4z"] Jul 28 07:00:51.448969 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.448956 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c29c40e5-cdd5-4fe9-8734-4717aedb5fd3" containerName="manager" Jul 28 07:00:51.449030 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.448970 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c29c40e5-cdd5-4fe9-8734-4717aedb5fd3" containerName="manager" Jul 28 07:00:51.449030 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.448993 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf" containerName="node" Jul 28 07:00:51.449030 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.448999 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf" containerName="node" Jul 28 07:00:51.449121 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.449051 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cca3e9c-d8e2-4751-ba2a-c0ebf0d291bf" containerName="node" Jul 28 07:00:51.449121 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.449061 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c29c40e5-cdd5-4fe9-8734-4717aedb5fd3" containerName="manager" Jul 28 07:00:51.460550 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.460514 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:51.477704 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.477673 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dr6gn/must-gather-s8h4z"] Jul 28 07:00:51.477875 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.477809 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:00:51.480508 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.480481 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dr6gn\"/\"kube-root-ca.crt\"" Jul 28 07:00:51.480692 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.480571 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dr6gn\"/\"openshift-service-ca.crt\"" Jul 28 07:00:51.480692 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.480649 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dr6gn\"/\"default-dockercfg-b47lx\"" Jul 28 07:00:51.518542 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.518507 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:51.556711 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.556682 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv666\" (UniqueName: \"kubernetes.io/projected/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b-kube-api-access-mv666\") pod \"must-gather-s8h4z\" (UID: \"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b\") " pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:00:51.557015 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.556996 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b-must-gather-output\") pod \"must-gather-s8h4z\" (UID: \"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b\") " pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:00:51.658455 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.658422 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b-must-gather-output\") pod \"must-gather-s8h4z\" (UID: \"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b\") " pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:00:51.658623 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.658468 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv666\" (UniqueName: \"kubernetes.io/projected/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b-kube-api-access-mv666\") pod \"must-gather-s8h4z\" (UID: \"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b\") " pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:00:51.658839 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.658819 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b-must-gather-output\") pod \"must-gather-s8h4z\" (UID: \"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b\") " pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:00:51.666936 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.666903 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv666\" (UniqueName: \"kubernetes.io/projected/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b-kube-api-access-mv666\") pod \"must-gather-s8h4z\" (UID: \"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b\") " pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:00:51.797931 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.797853 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:00:51.959542 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:51.959519 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dr6gn/must-gather-s8h4z"] Jul 28 07:00:51.962253 ip-10-0-130-140 kubenswrapper[2554]: W0728 07:00:51.962225 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52b8e134_3cfc_4f31_a44a_cdfbbe9de30b.slice/crio-3ef4a9843cf7a040a2f1f5db3d514795d7e18ea6721ff422781993053d2af426 WatchSource:0}: Error finding container 3ef4a9843cf7a040a2f1f5db3d514795d7e18ea6721ff422781993053d2af426: Status 404 returned error can't find the container with id 3ef4a9843cf7a040a2f1f5db3d514795d7e18ea6721ff422781993053d2af426 Jul 28 07:00:52.023986 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:00:52.023950 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" event={"ID":"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b","Type":"ContainerStarted","Data":"3ef4a9843cf7a040a2f1f5db3d514795d7e18ea6721ff422781993053d2af426"} Jul 28 07:01:00.067949 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:00.067867 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" event={"ID":"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b","Type":"ContainerStarted","Data":"10004ab77253ca178362661905c5a0cdcb3f842aa1b3c871f62f7859049da11f"} Jul 28 07:01:00.067949 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:00.067921 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" event={"ID":"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b","Type":"ContainerStarted","Data":"cd0e65faa07c28c38f83e92638f489d9a4006231ec5449d8db7f3339e36d5c05"} Jul 28 07:01:00.084651 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:00.084594 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" podStartSLOduration=1.612432058 podStartE2EDuration="9.08457337s" totalImagesPullingTime="7.472141312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:01:00.083045229 +0000 UTC m=+577.187735340" watchObservedRunningTime="2026-07-28 07:01:00.08457337 +0000 UTC m=+577.189263480" Jul 28 07:01:23.311157 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:23.311131 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/2.log" Jul 28 07:01:23.319822 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:23.318604 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/2.log" Jul 28 07:01:23.322733 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:23.322711 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovn-acl-logging/0.log" Jul 28 07:01:23.328352 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:23.328304 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovn-acl-logging/0.log" Jul 28 07:01:47.279354 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:47.279317 2554 generic.go:356] "Generic (PLEG): container finished" podID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" containerID="cd0e65faa07c28c38f83e92638f489d9a4006231ec5449d8db7f3339e36d5c05" exitCode=0 Jul 28 07:01:47.279861 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:47.279363 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" event={"ID":"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b","Type":"ContainerDied","Data":"cd0e65faa07c28c38f83e92638f489d9a4006231ec5449d8db7f3339e36d5c05"} Jul 28 07:01:47.279861 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:47.279661 2554 scope.go:117] "RemoveContainer" containerID="cd0e65faa07c28c38f83e92638f489d9a4006231ec5449d8db7f3339e36d5c05" Jul 28 07:01:47.786943 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:47.786912 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-dr6gn_must-gather-s8h4z_52b8e134-3cfc-4f31-a44a-cdfbbe9de30b/gather/0.log" Jul 28 07:01:48.150041 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:48.150010 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:01:48.292944 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:48.292908 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:01:48.394069 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:48.394039 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:01:50.799340 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:50.799311 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ltj9k_6cbb34ff-cb3d-4f84-92f3-8a72dbb938de/global-pull-secret-syncer/0.log" Jul 28 07:01:50.896181 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:50.896145 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" Jul 28 07:01:50.967496 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:50.967461 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-140.ec2.internal_a16892ee32f85011fc1a1806c8666fbf/haproxy/0.log" Jul 28 07:01:53.122155 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.122124 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-dr6gn/must-gather-s8h4z"] Jul 28 07:01:53.122645 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.122339 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" podUID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" containerName="copy" containerID="cri-o://10004ab77253ca178362661905c5a0cdcb3f842aa1b3c871f62f7859049da11f" gracePeriod=2 Jul 28 07:01:53.124638 ip-10-0-130-140 kubenswrapper[2554]: E0728 07:01:53.124596 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s8h4z\" is forbidden: User \"system:node:ip-10-0-130-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-dr6gn\": no relationship found between node 'ip-10-0-130-140.ec2.internal' and this object" podUID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:01:53.125230 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.125207 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-dr6gn/must-gather-s8h4z"] Jul 28 07:01:53.308065 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.308039 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-dr6gn_must-gather-s8h4z_52b8e134-3cfc-4f31-a44a-cdfbbe9de30b/copy/0.log" Jul 28 07:01:53.308485 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.308456 2554 generic.go:356] "Generic (PLEG): container finished" podID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" containerID="10004ab77253ca178362661905c5a0cdcb3f842aa1b3c871f62f7859049da11f" exitCode=143 Jul 28 07:01:53.362629 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.362605 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-dr6gn_must-gather-s8h4z_52b8e134-3cfc-4f31-a44a-cdfbbe9de30b/copy/0.log" Jul 28 07:01:53.364134 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.364117 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:01:53.366581 ip-10-0-130-140 kubenswrapper[2554]: E0728 07:01:53.366555 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s8h4z\" is forbidden: User \"system:node:ip-10-0-130-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-dr6gn\": no relationship found between node 'ip-10-0-130-140.ec2.internal' and this object" podUID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:01:53.418079 ip-10-0-130-140 kubenswrapper[2554]: E0728 07:01:53.417996 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-s8h4z\" is forbidden: User \"system:node:ip-10-0-130-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-dr6gn\": no relationship found between node 'ip-10-0-130-140.ec2.internal' and this object" podUID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:01:53.430301 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.430262 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b-must-gather-output\") pod \"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b\" (UID: \"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b\") " Jul 28 07:01:53.430471 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.430336 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv666\" (UniqueName: \"kubernetes.io/projected/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b-kube-api-access-mv666\") pod \"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b\" (UID: \"52b8e134-3cfc-4f31-a44a-cdfbbe9de30b\") " Jul 28 07:01:53.431623 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.431599 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" (UID: "52b8e134-3cfc-4f31-a44a-cdfbbe9de30b"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 07:01:53.432609 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.432591 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b-kube-api-access-mv666" (OuterVolumeSpecName: "kube-api-access-mv666") pod "52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" (UID: "52b8e134-3cfc-4f31-a44a-cdfbbe9de30b"). InnerVolumeSpecName "kube-api-access-mv666". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:01:53.531183 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.531144 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv666\" (UniqueName: \"kubernetes.io/projected/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b-kube-api-access-mv666\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 07:01:53.531183 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.531173 2554 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b-must-gather-output\") on node \"ip-10-0-130-140.ec2.internal\" DevicePath \"\"" Jul 28 07:01:53.838400 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:53.838372 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:01:54.313605 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:54.313530 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-dr6gn_must-gather-s8h4z_52b8e134-3cfc-4f31-a44a-cdfbbe9de30b/copy/0.log" Jul 28 07:01:54.314060 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:54.313997 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dr6gn/must-gather-s8h4z" Jul 28 07:01:54.314060 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:54.314035 2554 scope.go:117] "RemoveContainer" containerID="10004ab77253ca178362661905c5a0cdcb3f842aa1b3c871f62f7859049da11f" Jul 28 07:01:54.322841 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:54.322790 2554 scope.go:117] "RemoveContainer" containerID="cd0e65faa07c28c38f83e92638f489d9a4006231ec5449d8db7f3339e36d5c05" Jul 28 07:01:54.862094 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:54.862067 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-nt2qc_8f79ab98-bd74-484b-a89e-1c92e1648192/cluster-monitoring-operator/0.log" Jul 28 07:01:54.988471 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:54.988444 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5778f6c5c9-nfs9g_13923bf0-5af9-4f86-9828-845a3ef80f2c/metrics-server/0.log" Jul 28 07:01:55.075238 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.075210 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7n8wd_0a301638-f322-4edf-9205-0b29887a8264/node-exporter/0.log" Jul 28 07:01:55.102822 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.102799 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7n8wd_0a301638-f322-4edf-9205-0b29887a8264/kube-rbac-proxy/0.log" Jul 28 07:01:55.126977 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.126902 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7n8wd_0a301638-f322-4edf-9205-0b29887a8264/init-textfile/0.log" Jul 28 07:01:55.402336 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.402263 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abf7fffb-58b3-47c0-b597-9d1100b4118e/prometheus/0.log" Jul 28 07:01:55.418836 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.418808 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" path="/var/lib/kubelet/pods/52b8e134-3cfc-4f31-a44a-cdfbbe9de30b/volumes" Jul 28 07:01:55.430163 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.430144 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abf7fffb-58b3-47c0-b597-9d1100b4118e/config-reloader/0.log" Jul 28 07:01:55.460360 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.460337 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abf7fffb-58b3-47c0-b597-9d1100b4118e/thanos-sidecar/0.log" Jul 28 07:01:55.485911 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.485882 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abf7fffb-58b3-47c0-b597-9d1100b4118e/kube-rbac-proxy-web/0.log" Jul 28 07:01:55.510355 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.510327 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abf7fffb-58b3-47c0-b597-9d1100b4118e/kube-rbac-proxy/0.log" Jul 28 07:01:55.532891 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.532865 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abf7fffb-58b3-47c0-b597-9d1100b4118e/kube-rbac-proxy-thanos/0.log" Jul 28 07:01:55.554263 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.554240 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_abf7fffb-58b3-47c0-b597-9d1100b4118e/init-config-reloader/0.log" Jul 28 07:01:55.791956 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.791926 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68ff77d4ff-llswv_6a936091-052b-43c0-9210-59dd959a8b90/thanos-query/0.log" Jul 28 07:01:55.820051 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.820028 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68ff77d4ff-llswv_6a936091-052b-43c0-9210-59dd959a8b90/kube-rbac-proxy-web/0.log" Jul 28 07:01:55.844624 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.844600 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68ff77d4ff-llswv_6a936091-052b-43c0-9210-59dd959a8b90/kube-rbac-proxy/0.log" Jul 28 07:01:55.870543 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.870516 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68ff77d4ff-llswv_6a936091-052b-43c0-9210-59dd959a8b90/prom-label-proxy/0.log" Jul 28 07:01:55.904255 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.904232 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68ff77d4ff-llswv_6a936091-052b-43c0-9210-59dd959a8b90/kube-rbac-proxy-rules/0.log" Jul 28 07:01:55.936285 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:55.936256 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68ff77d4ff-llswv_6a936091-052b-43c0-9210-59dd959a8b90/kube-rbac-proxy-metrics/0.log" Jul 28 07:01:57.030267 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.030240 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-lksts_d4368546-2213-46cf-b048-e93209e1f417/networking-console-plugin/0.log" Jul 28 07:01:57.437164 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.437131 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/2.log" Jul 28 07:01:57.441271 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.441240 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pjwt8_0d42bcac-022f-4189-9937-6f1f633097ca/console-operator/3.log" Jul 28 07:01:57.762505 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.762425 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn"] Jul 28 07:01:57.762736 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.762725 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" containerName="copy" Jul 28 07:01:57.762798 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.762738 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" containerName="copy" Jul 28 07:01:57.762798 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.762769 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" containerName="gather" Jul 28 07:01:57.762798 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.762777 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" containerName="gather" Jul 28 07:01:57.762893 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.762856 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" containerName="copy" Jul 28 07:01:57.762893 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.762868 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b8e134-3cfc-4f31-a44a-cdfbbe9de30b" containerName="gather" Jul 28 07:01:57.766570 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.766549 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.769109 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.769087 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8qw9c\"/\"openshift-service-ca.crt\"" Jul 28 07:01:57.769231 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.769094 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8qw9c\"/\"kube-root-ca.crt\"" Jul 28 07:01:57.770043 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.770028 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8qw9c\"/\"default-dockercfg-ftwxr\"" Jul 28 07:01:57.775263 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.775240 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn"] Jul 28 07:01:57.868203 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.868169 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-proc\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.868423 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.868219 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-lib-modules\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.868423 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.868237 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-podres\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.868423 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.868313 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-sys\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.868423 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.868361 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwmjc\" (UniqueName: \"kubernetes.io/projected/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-kube-api-access-bwmjc\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.871661 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.871638 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-cmqrs_aff18aa7-337c-45c5-9682-6386f62c2350/download-server/0.log" Jul 28 07:01:57.969609 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.969565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-lib-modules\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.969609 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.969605 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-podres\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.970194 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.969633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-sys\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.970194 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.969670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwmjc\" (UniqueName: \"kubernetes.io/projected/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-kube-api-access-bwmjc\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.970194 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.969791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-proc\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.970194 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.969818 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-lib-modules\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.970194 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.969841 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-podres\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.970194 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.969883 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-proc\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.970194 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.969918 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-sys\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:57.977592 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:57.977561 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwmjc\" (UniqueName: \"kubernetes.io/projected/95a84db1-0e0f-4d4a-81cf-f025c9ca38c2-kube-api-access-bwmjc\") pod \"perf-node-gather-daemonset-7lwtn\" (UID: \"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2\") " pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:58.077957 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:58.077852 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:58.211169 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:58.211142 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn"] Jul 28 07:01:58.213692 ip-10-0-130-140 kubenswrapper[2554]: W0728 07:01:58.213661 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod95a84db1_0e0f_4d4a_81cf_f025c9ca38c2.slice/crio-275a2f44bd2e3719e5738179b7f59dcf5d0a59e4da14a785fbb865eaa0b90d0c WatchSource:0}: Error finding container 275a2f44bd2e3719e5738179b7f59dcf5d0a59e4da14a785fbb865eaa0b90d0c: Status 404 returned error can't find the container with id 275a2f44bd2e3719e5738179b7f59dcf5d0a59e4da14a785fbb865eaa0b90d0c Jul 28 07:01:58.332653 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:58.332550 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" event={"ID":"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2","Type":"ContainerStarted","Data":"7631f24ad1440f044ba31be81404b4adaf4763b02b6919dc87cdaaef42419b5e"} Jul 28 07:01:58.332653 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:58.332611 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" event={"ID":"95a84db1-0e0f-4d4a-81cf-f025c9ca38c2","Type":"ContainerStarted","Data":"275a2f44bd2e3719e5738179b7f59dcf5d0a59e4da14a785fbb865eaa0b90d0c"} Jul 28 07:01:58.332653 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:58.332639 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:01:58.348557 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:58.348508 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" podStartSLOduration=1.348492143 podStartE2EDuration="1.348492143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:01:58.348076906 +0000 UTC m=+635.452767036" watchObservedRunningTime="2026-07-28 07:01:58.348492143 +0000 UTC m=+635.453182254" Jul 28 07:01:58.382587 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:58.382552 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-v59t2_60ae09ae-e158-4dfa-a8be-b6749a669ca9/volume-data-source-validator/0.log" Jul 28 07:01:58.680696 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:58.680661 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l97s_0fb4bd44-8dcd-44b4-b252-68ea1f99aca9/konnectivity-agent/0.log" limit=1024 Jul 28 07:01:59.159208 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:59.159183 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-98g5h_020008a7-3d30-42f9-b649-c94fed431d83/dns/0.log" Jul 28 07:01:59.184879 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:59.184852 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-98g5h_020008a7-3d30-42f9-b649-c94fed431d83/kube-rbac-proxy/0.log" Jul 28 07:01:59.326474 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:59.326448 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6f54g_ea272cb3-32b4-4d87-a15f-0a2be6dc8d06/dns-node-resolver/0.log" Jul 28 07:01:59.841460 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:01:59.841434 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sbnt5_4f8d803f-7f02-4da7-9bca-04ab104246a7/node-ca/0.log" Jul 28 07:02:00.555009 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:00.554978 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-777cfd8465-gqkwd_fb639d17-03f1-4d5a-ae49-2f913f4458a8/router/0.log" Jul 28 07:02:00.911694 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:00.911664 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pvkjq_fd7e1042-4a95-48b1-a22a-cd1407f09119/serve-healthcheck-canary/0.log" Jul 28 07:02:01.281021 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:01.280942 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-pz549_abbf8914-c198-470e-aa64-59beb776cf8c/insights-operator/0.log" Jul 28 07:02:01.281021 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:01.280954 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-pz549_abbf8914-c198-470e-aa64-59beb776cf8c/insights-operator/1.log" Jul 28 07:02:01.303024 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:01.302998 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-599tf_566be829-dfc4-4c97-9799-18a6afec6996/kube-rbac-proxy/0.log" Jul 28 07:02:01.325533 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:01.325505 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-599tf_566be829-dfc4-4c97-9799-18a6afec6996/exporter/0.log" Jul 28 07:02:01.345427 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:01.345391 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-599tf_566be829-dfc4-4c97-9799-18a6afec6996/extractor/0.log" Jul 28 07:02:04.347354 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:04.347329 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8qw9c/perf-node-gather-daemonset-7lwtn" Jul 28 07:02:06.498638 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:06.498598 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh_13b1db04-1403-4a27-aa67-92bdf5369cfb/kube-storage-version-migrator-operator/1.log" Jul 28 07:02:06.499534 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:06.499517 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-fwdmh_13b1db04-1403-4a27-aa67-92bdf5369cfb/kube-storage-version-migrator-operator/0.log" Jul 28 07:02:07.466839 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:07.466812 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cv4p9_65d16ac8-a186-4b01-af64-a1178eb64830/kube-multus-additional-cni-plugins/0.log" Jul 28 07:02:07.490609 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:07.490578 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cv4p9_65d16ac8-a186-4b01-af64-a1178eb64830/egress-router-binary-copy/0.log" Jul 28 07:02:07.512382 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:07.512361 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cv4p9_65d16ac8-a186-4b01-af64-a1178eb64830/cni-plugins/0.log" Jul 28 07:02:07.537994 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:07.537963 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cv4p9_65d16ac8-a186-4b01-af64-a1178eb64830/bond-cni-plugin/0.log" Jul 28 07:02:07.562107 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:07.562080 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cv4p9_65d16ac8-a186-4b01-af64-a1178eb64830/routeoverride-cni/0.log" Jul 28 07:02:07.583695 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:07.583664 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cv4p9_65d16ac8-a186-4b01-af64-a1178eb64830/whereabouts-cni-bincopy/0.log" Jul 28 07:02:07.604334 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:07.604307 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cv4p9_65d16ac8-a186-4b01-af64-a1178eb64830/whereabouts-cni/0.log" Jul 28 07:02:08.024296 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:08.024265 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v52f6_d8dc0d0e-e243-4869-82b8-d3ab1ec203b6/kube-multus/0.log" Jul 28 07:02:08.096412 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:08.096384 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jkdfq_03922df9-9b4e-4dec-80de-12e819531552/network-metrics-daemon/0.log" Jul 28 07:02:08.118950 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:08.118915 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jkdfq_03922df9-9b4e-4dec-80de-12e819531552/kube-rbac-proxy/0.log" Jul 28 07:02:09.321926 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:09.321896 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovn-controller/0.log" Jul 28 07:02:09.339058 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:09.339031 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovn-acl-logging/1.log" Jul 28 07:02:09.339237 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:09.339043 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovn-acl-logging/0.log" Jul 28 07:02:09.356826 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:09.356785 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/kube-rbac-proxy-node/0.log" Jul 28 07:02:09.376179 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:09.376141 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 07:02:09.393972 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:09.393945 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/northd/0.log" Jul 28 07:02:09.414611 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:09.414581 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/nbdb/0.log" Jul 28 07:02:09.436872 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:09.436847 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/sbdb/0.log" Jul 28 07:02:09.476000 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:09.475968 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhsp6_44c04fab-c090-48db-903a-41b4abd0ee63/ovnkube-controller/0.log" Jul 28 07:02:10.400522 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:10.400498 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-9vqrc_5a29fe04-4fca-43eb-a716-23a566025dd8/check-endpoints/0.log" Jul 28 07:02:10.447666 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:10.447638 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-j8vjh_15292834-c484-4c15-9ab0-a9f85d854b6d/network-check-target-container/0.log" Jul 28 07:02:11.315062 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:11.315034 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8zrm2_1e64e45e-2297-46a0-977d-510debf6875a/iptables-alerter/0.log" Jul 28 07:02:11.943838 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:11.943807 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lxc6x_c7f3b871-a2a5-4419-a2ad-cd6cd64913d5/tuned/0.log" Jul 28 07:02:13.498172 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:13.498136 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-f9n6w_606e3d81-68fb-49c3-b4fb-73c2fbf22de9/cluster-samples-operator/0.log" Jul 28 07:02:13.513379 ip-10-0-130-140 kubenswrapper[2554]: I0728 07:02:13.513344 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-f9n6w_606e3d81-68fb-49c3-b4fb-73c2fbf22de9/cluster-samples-operator-watch/0.log"